GCP Lead Data Engineer

Infinity Solutions
ON, Canada
Full-time
Quick Apply
  • 10+ years of experience in data engineering, performance optimization for large OLTP applications with a minimum of 4+ years of working experience as Google Cloud Platform (GCP) developer
  • Experience with the primary managed data services within GCP, including DataProc, Dataflow, BigQuery / DBT, Cloud Spanner, Cloud SQL, Cloud Pub / Sub etc.
  • Experience with Google Cloud Platform Databases (SQL, Spanner, PostgreSQL)
  • Experience working with relational / NoSQL databases
  • Experience with data streaming and technologies such as Kafka, Spark-streaming etc.
  • Experience with Infrastructure as Code (IaC) practices and frameworks like Terraform
  • Knowledge of Java microservices and Spring Boot
  • Strong architecture knowledge with experience in providing technical solutions for cloud infrastructure.
  • Working knowledge of developing and scaling JAVA REST services, using frameworks such as Spring
  • Good communication and problem-solving skills. Ability to effectively convey ideas to business and technical teams
  • 1 day ago
Related jobs
Promoted
Viva Tech Solutions
Toronto, Ontario

Data Warehouse / Data Platforms. ELT data pipelines from scratch, working with structured, semi-structured, and unstructured data and SQL. ETL, ELT, processes for data integration. ...

Zortech Solutions
Toronto, Ontario

The Google Lead Data Engineer will play a key role in designing and implementing the Data Hub using Google cloud components working closely with the enterprise data team and data architects, solution architects, business systems analyst and data engineers</p> <p><b><u>Key Res...

Purple Drive
Toronto, Ontario

Data Engineer with AWS Glue Lambda SQLPython DovpsRedshift. Performdata cleansing data validation etc. Must haveworking knowledge in designing and implementing data pipelines onany of the cloud providers (AWS is preferred). Must be able to workwith large volumes of data coming from various sources. ...

Lyons Consulting Group
Toronto, Ontario

As a Team Lead, you will build distributed data processing solution and highly loaded database solutions for various cases including reporting, product analytics, marketing optimization and financial reporting. Year of experience as Data Engineer Tech Lead. It delivers end-to-end services and soluti...

CPP Investments
Toronto, Ontario

The Lead Engineer will see the unique engineering challenges faced by one of the largest global institutional investors and apply cutting-edge technologies to inform very large investment decisions. Ability to build strong relationships, influence and communicate effectively with a diverse set of st...

Nova Tribes Inc
Toronto, Ontario

Theideal candidate will have a deep understanding of data warehousingand cloud technologies particularly within the Google CloudPlatform (GCP) ecosystem. Dataproc BigQuery Cloud Spanner Cloud Runfunctions DataflowPub/Sub. Proficiencyin building data pipelines using. Google Cloud Platform (GCP) and r...

CPP Investments
Toronto, Ontario

Build/manage data pipelines, and common data related cross cutting concerns like data catalog, data lineage, data quality, data profiling, data discovery, metadata management. Hands on experience on building cross cutting concerns like data catalog, data lineage, data quality, data profiling, data d...

Rackspace
Remote, Canada
Remote

We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. Leverage GCP for scalable big data processing and storage solutions. We combine our expertise with the world’s leading technologies — across applications, data and security — to deliver end-to-end solu...

Purple Drive
Toronto, Ontario

Data Engineer with AWSGlue Lambda SQL Python Dovps Redshift. Perform data cleansing data validation etc. Must have working knowledge in designing and implementingdata pipelines on any of the cloud providers (AWS is preferred). Must be able to work with large volumes of data coming from varioussource...

Adastra
Markham, Ontario

As Azure Data Engineer Lead, you will handle end-to-end solutions, architecture design, and documentation for large scale data implementations (related to big data and data warehousing). Senior/Lead Azure Data Engineer (7+ years) possessing skills in solutions design and hands-on development . Knowl...