Recherche d'emploi > Markham, ON > Permanent > Principal engineer

Principal Engineer Distributed Data Processing System

Huawei Technologies Canada Co., Ltd.
Markham, ON, CA
Permanent

Our team has an immediate permanent opening for a Principal Engineer.

Job Description :

  • Work with a team of architects and engineers to develop proof-of-concept distributed systems and product components.
  • Investigate and design data processing system focusing on extra-large volume data for real-time streaming, based distributed system with the latest and state of the art hardware technology.
  • Continuous enhancements on the AI-native data analysis system to fulfill customer requirements utilizing AI techniques for public cloud capacity management and scheduling.

What you’ll bring to the team :

  • Master's or Ph.D. in Computer Science, Computer Engineering, Applied Mathematics
  • 5+ years working experience for distributed data processing system
  • High proficiency with Java and Golang, must be able to write strong / clean, brand-new code
  • Deep understanding of fundamental concepts such as distributed data processing, distributed database / storage system / file system / memory allocation / cache system, like Kafka and Flink
  • Ability to clearly articulate technical concepts and challenges
  • Highly analytical with strong problem-solving skills; Self-motivated with a proven ability to learn and take initiative
  • Experience with Linux system level development, distributed system, or scheduling algorithm is an asset
  • Il y a plus de 30 jours
Emplois reliés
Offre sponsorisée
Kumaran Systems
Toronto, Ontario

Develop a comprehensive technical plan for the migration, including data ingestion, transformation, storage, and access control in Azure's Data Factory and data lake. Design and implement scalable and efficient data pipelines to ensure smooth data movement from multiple sources using Azure Databrick...

S.i. Systems
Toronto, Ontario

Business Systems Analyst with Data Mapping and Integration Processing experience to support various projects for our insurance Client. Enterprise Systems – systems that support functions within the business unit that are not focused on a single property; example: systems to support Asset Management....

Movable Ink
Toronto, Ontario

We are seeking a Distributed Systems Engineer who will be responsible for the design and implementation of distributed software systems that handle data at massive speeds and scale. Movable Ink scales content personalization for marketers through data-activated content generation and AI decisioning....

hireVouch
Remote, Canada or US, USA
Télétravail

We are looking for a highly motivated and creative Senior Systems Software engineer to join our Runtime team. You will design, develop and verify software that interacts with our chip; collaborating with hardware engineers and fellow software engineers in the process. You will craft elegant solution...

Huawei Technologies Canada Co., Ltd.
Markham, Ontario

Learn and adopt new technologies (parallel, distributed systems, large-scale data analytics system, etc. Deep understanding of AI end to end data processing, scenarios and system optimizations. Principal/Distinguished Engineer. Architect and develop framework/engine for the next-generation data + AI...

Astra North Infoteck Inc.
Toronto, Ontario

Experience working as Data Engineer with focus on big data processing and/or relational databases with good understanding of SQL. Experience working with Microsoft Azure Data Platform, specifically Azure SQL Database, Azure Data Factory, ADLS storage account, Azure Data Bricks and DevOps Experienced...

Recrute Action
Markham, Ontario

Data Engineer (FinanceSystems). The roleinvolves ensuring accurate data management across various financesystems. Design develop and maintain ETL processes to extract transform andload data from diverse sources into financesystems. Conduct data analysis andtroubleshooting to resolve datarelatedissue...

Movable Ink
Toronto, Ontario

As a Principal Data Engineer you will help drive the direction of our Data Warehouse. Partner with internal operations teams to identify, collect, and integrate data from various business systems, ensuring comprehensive and accurate data capture. Design, implement, and maintain robust data pipelines...

Astra North Infoteck Inc.
Toronto, Ontario

Experience working as Data Engineer with focus on big data processing and/or relational databases with good understanding of SQL. Experience working with Microsoft Azure Data Platform, specifically Azure SQL Database, Azure Data Factory, ADLS storage account, Azure Data Bricks and DevOps Experienced...

Movable Ink
Toronto, Ontario

As Senior Distributed Systems Engineer (Machine Learning), you will play an instrumental role in advancing the services and systems comprising our Machine Learning Platform. Proficient in database management, including designing database schema, crafting efficient queries, performing basic DBA tasks...