Search jobs > Markham, ON > Permanent > Principal engineer

Principal Engineer Distributed Data Processing System

Huawei Technologies Canada Co., Ltd.
Markham, ON, CA
Permanent

Our team has an immediate permanent opening for a Principal Engineer.

Job Description :

  • Work with a team of architects and engineers to develop proof-of-concept distributed systems and product components.
  • Investigate and design data processing system focusing on extra-large volume data for real-time streaming, based distributed system with the latest and state of the art hardware technology.
  • Continuous enhancements on the AI-native data analysis system to fulfill customer requirements utilizing AI techniques for public cloud capacity management and scheduling.

What you’ll bring to the team :

  • Master's or Ph.D. in Computer Science, Computer Engineering, Applied Mathematics
  • 5+ years working experience for distributed data processing system
  • High proficiency with Java and Golang, must be able to write strong / clean, brand-new code
  • Deep understanding of fundamental concepts such as distributed data processing, distributed database / storage system / file system / memory allocation / cache system, like Kafka and Flink
  • Ability to clearly articulate technical concepts and challenges
  • Highly analytical with strong problem-solving skills; Self-motivated with a proven ability to learn and take initiative
  • Experience with Linux system level development, distributed system, or scheduling algorithm is an asset
  • 30+ days ago
Related jobs
Huawei Technologies Canada Co., Ltd.
Markham, Ontario

Deep understanding of fundamental concepts such as distributed data processing, distributed database/storage system/file system/memory allocation/cache system, like Kafka and Flink. Investigate and design data processing system focusing on extra-large volume data for real-time st...

Promoted
Apex Systems
Toronto, Ontario

Apex Systems is a global IT services provider, and our staffing practice has an opening infor a Senior Data Engineer specializing specifically with experience in GCP, SQL and data engineering. Utilize digital media advertising data to drive forward business-critical data engineering projects, that a...

Huawei Technologies Canada Co., Ltd.
Markham, Ontario

Understanding of distributed database/storage system/file system/memory allocation/cache system. Work with a team of architects and engineers to develop proof-of-concept distributed systems and product components. Experience with Linux system level development, distributed system...

S.i. Systems
Toronto, Ontario

Data Integration: You will need to understand and integrate data from Guidewire systems into our finance systems. We are seeking a talented Finance Systems Data Engineer with strong experience in the insurance industry and expertise in ETL and PostgreSQL development to join our dynamic team. Data An...

Toronto Blue Jays
Toronto, Ontario

The Toronto Blue Jays are seeking an experienced Data Engineer to join their Baseball Systems team to help build their next generation of databases and data processing systems. Build and maintain data pipelines for processing, transforming, and integrating large volumes of baseball data from a varie...

Veeva Systems
Toronto, Ontario

As a Senior QA Engineer in Opendata, you will lead the effort for building the QA framework from the ground up and the overall QA of the Data Platform for Opendata. Veeva OpenData supports the industry by providing real-time reference data across the complete healthcare ecosystem, to support commerc...

Movable Ink
Toronto, Ontario

As Senior Distributed Systems Engineer (Machine Learning), you will play an instrumental role in advancing the services and systems comprising our Machine Learning Platform. Proficient in database management, including designing database schema, crafting efficient queries, performing basic DBA tasks...

S.i. Systems
Toronto, Ontario
Remote

X Senior Data Engineer to build data solutions and migrate SSIS packages from legacy systems to MuleSoft. ...

Movable Ink
Toronto, Ontario

As a Principal Data Engineer, you will help drive the direction of our Data Warehouse, and be hands on with teammates across all departments to enable access to our data and empower teams to make data driven decisions about the direction of our business. Partner with internal operations teams to ide...

Huawei Technologies Canada Co., Ltd.
Markham, Ontario

Learn and adopt new technologies (parallel, distributed systems, large-scale data analytics system, etc. Deep understanding of AI end to end data processing, scenarios and system optimizations. Principal/Distinguished Engineer. Architect and develop framework/engine for the next-generation data + AI...