Search jobs > Markham, ON > Permanent > Principal engineer

Principal Engineer Distributed Data Processing System

Huawei Technologies Canada Co., Ltd.
Markham, ON, CA
Permanent

Our team has an immediate permanent opening for a Principal Engineer.

Job Description :

  • Work with a team of architects and engineers to develop proof-of-concept distributed systems and product components.
  • Investigate and design data processing system focusing on extra-large volume data for real-time streaming, based distributed system with the latest and state of the art hardware technology.
  • Continuous enhancements on the AI-native data analysis system to fulfill customer requirements utilizing AI techniques for public cloud capacity management and scheduling.

What you’ll bring to the team :

  • Master's or Ph.D. in Computer Science, Computer Engineering, Applied Mathematics
  • 5+ years working experience for distributed data processing system
  • High proficiency with Java and Golang, must be able to write strong / clean, brand-new code
  • Deep understanding of fundamental concepts such as distributed data processing, distributed database / storage system / file system / memory allocation / cache system, like Kafka and Flink
  • Ability to clearly articulate technical concepts and challenges
  • Highly analytical with strong problem-solving skills; Self-motivated with a proven ability to learn and take initiative
  • Experience with Linux system level development, distributed system, or scheduling algorithm is an asset
  • 30+ days ago
Related jobs
Huawei Technologies Canada Co., Ltd.
Markham, Ontario

Deep understanding of fundamental concepts such as distributed data processing, distributed database/storage system/file system/memory allocation/cache system, like Kafka and Flink. Investigate and design data processing system focusing on extra-large volume data for real-time st...

Huawei Technologies Canada Co., Ltd.
Markham, Ontario

Deep understanding of fundamental concepts such as distributed data processing, distributed database/storage system/file system/memory allocation/cache system, like Kafka and Flink. Investigate and design data processing system focusing on extra-large volume data for real-time st...

Huawei Technologies Canada Co., Ltd.
Markham, Ontario

Understanding of distributed database/storage system/file system/memory allocation/cache system. Work with a team of architects and engineers to develop proof-of-concept distributed systems and product components. Experience with Linux system level development, distributed system...

Movable Ink
Toronto, Ontario

As a Principal Data Engineer you will help drive the direction of our Data Warehouse. Partner with internal operations teams to identify, collect, and integrate data from various business systems, ensuring comprehensive and accurate data capture. Design, implement, and maintain robust data pipelines...

S.i. Systems
Toronto, Ontario

Senior Data Engineer Team Lead to oversee critical data engineering activities within the Digital Health sector. Provide strategic oversight of data engineering activities, shaping platform strategy and data architecture. Monitor and optimize ARC platform data pipelines to ensure efficient data flow...

LEELOG TECHNOLOGY
CA

Assign IT projects to systems analysts, programmers and other computer technicians. ...

S.i. Systems
Toronto, Ontario

Collaborate with data engineers, data scientists, and stakeholders to understand complex data requirements. Assist in designing, developing, and optimizing data pipelines, architectures, and data sets, ensuring efficient data ingestion, transformation, and reliable delivery using Microsoft Azure and...

Huawei Technologies Canada Co., Ltd.
Markham, Ontario

Understanding of distributed database/storage system/file system/memory allocation/cache system. Work with a team of architects and engineers to develop proof-of-concept distributed systems and product components. Experience with Linux system level development, distributed system, or scheduling algo...

Veeva Systems
Toronto, Ontario

Veeva OpenData supports the industry by providing real-time reference data across the complete healthcare ecosystem, to support commercial sales execution, compliance, and business analytics. As a Software Engineer in Opendata, you will be responsible for the new Data Platform implementation. You wi...

Movable Ink
Toronto, Ontario

We are seeking a Distributed Systems Engineer who will be responsible for the design and implementation of distributed software systems that handle data at massive speeds and scale. Movable Ink scales content personalization for marketers through data-activated content generation and AI decisioning....