GCP Lead Data Engineer

Infinity Solutions
ON, Canada
Temps plein
Quick Apply
  • 10+ years of experience in data engineering, performance optimization for large OLTP applications with a minimum of 4+ years of working experience as Google Cloud Platform (GCP) developer
  • Experience with the primary managed data services within GCP, including DataProc, Dataflow, BigQuery / DBT, Cloud Spanner, Cloud SQL, Cloud Pub / Sub etc.
  • Experience with Google Cloud Platform Databases (SQL, Spanner, PostgreSQL)
  • Experience working with relational / NoSQL databases
  • Experience with data streaming and technologies such as Kafka, Spark-streaming etc.
  • Experience with Infrastructure as Code (IaC) practices and frameworks like Terraform
  • Knowledge of Java microservices and Spring Boot
  • Strong architecture knowledge with experience in providing technical solutions for cloud infrastructure.
  • Working knowledge of developing and scaling JAVA REST services, using frameworks such as Spring
  • Good communication and problem-solving skills. Ability to effectively convey ideas to business and technical teams
  • Il y a 1 jour
Emplois reliés
Adastra
Markham, Ontario

As Azure Data Engineer Lead, you will handle end-to-end solutions, architecture design, and documentation for large scale data implementations (related to big data and data warehousing). Senior/Lead Azure Data Engineer (7+ years) possessing skills in solutions design and hands-on development . Knowl...

CPP Investments
Toronto, Ontario

The Lead Engineer will see the unique engineering challenges faced by one of the largest global institutional investors and apply cutting-edge technologies to inform very large investment decisions. Ability to build strong relationships, influence and communicate effectively with a diverse set of st...

Avanciers
Toronto, Ontario

Experience building data pipelines, and GCP Services, Dataproc, BigQuery, Cloud Spanner, Cloud Run functions, Dataflow, Pub/Sub etc. GCP Data Engineer in Toronto- Hybrid (FTE/Contract). Data Warehouse / Data Platforms. ELT data pipelines from scratch, working with structured, semi-structured, and un...

Figment
Toronto, Ontario

Lead the design and implementation of reliable data pipelines and data storage solutions. Lead the development and maintenance of data pipelines and ETL processes using technologies such as Dagster and DBT to ensure efficient data flow and processing. Collaborate with Engineering Leadership and Prod...

CPP Investments
Toronto, Ontario

Strong programming skills in Python, pyspark, SQL, Java with professional programming experience in a data context is a must ( data extraction, data manipulation, joins, data analysis, data model design etc. As a Lead Data Engineer, you will be working on the Data Service Applications for Public Mar...

Purple Drive
Toronto, Ontario

Data Engineer with AWSGlue Lambda SQL Python Dovps Redshift. Perform data cleansing data validation etc. Must have working knowledge in designing and implementingdata pipelines on any of the cloud providers (AWS is preferred). Must be able to work with large volumes of data coming from varioussource...

Tech Mahindra
Toronto, Ontario

Experience building data pipelines, and GCP Services, Dataproc, BigQuery, Cloud Spanner, Cloud Run functions, Dataflow, Pub/Sub etc. Have prior experience with data developer, data engineering, programming, ETL, ELT, processes for data integration. Utilize services and tools to automate data workflo...

Kumaran Systems
Toronto, Ontario

Develop a comprehensive technical plan for the migration, including data ingestion, transformation, storage, and access control in Azure's Data Factory and data lake. Design and implement scalable and efficient data pipelines to ensure smooth data movement from multiple sources using Azure Databrick...

Royal Bank of Canada>
Toronto, Ontario

Work closely with the Development team, analyzing data, designing and implementing ETL/ELT functionality to transform data for different applications purposes. Experience working with databases such as Snowflake, Databricks,. Application Development, Application Integrations, Application Maintenance...

CPP Investments
Toronto, Ontario

Build/manage data pipelines, and common data related cross cutting concerns like data catalog, data lineage, data quality, data profiling, data discovery, metadata management. Hands on experience on building cross cutting concerns like data catalog, data lineage, data quality, data profiling, data d...