Recherche d'emploi > Toronto, ON > Temporaire > Lead data engineer

Sr. Data Engineer Lead

Purple Drive
Toronto, ON, Ontario, Canada
Temps plein

8+ years of experience in Data Engineer with AWS, Glue, Lambda, SQL, Python, Dovps, Redshift.

Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred).

Must be able to work with large volumes of data coming from various sources. Perform data cleansing, data validation etc

2. Hands on ETL developer who is good at python, SQL. AWS services like glue, glue crawlers, lambda, red shift, athena, s3, EC2, IAM, Monitoring and Logging mechanisms- AWS cloudwatch, setting up alerts.

3. Deployment knowledge on cloud. Integrate CI / CD pipeline to build artifacts and deploy changed to higher Environments.

4. Scheduling frame works Airflow, AWS Step functions

5. Excellent Communication skills, should be able to work collaboratively with other teams

Il y a 15 heures
Emplois reliés
Purple Drive
Toronto, Ontario

Data Engineer with AWSGlue Lambda SQL Python Dovps Redshift. Perform data cleansing data validation etc. Must have working knowledge in designing and implementingdata pipelines on any of the cloud providers (AWS is preferred). Must be able to work with large volumes of data coming from varioussource...

Kumaran Systems
Toronto, Ontario

Develop a comprehensive technical plan for the migration, including data ingestion, transformation, storage, and access control in Azure's Data Factory and data lake. Design and implement scalable and efficient data pipelines to ensure smooth data movement from multiple sources using Azure Databrick...

GalaxE.Solutions
Toronto, Ontario

Implement data products curated by our Chief Data Office, as well as custom data models for fit for use. Ensure data quality and integrity across various data sources and systems to ensure data accuracy, completeness, and reliability. Keep up to date with the latest industry trends and technologies ...

Fluent, Inc.
Toronto, Ontario

You are known as a strong and efficient IC Data Engineer, with the ability to assist the Data Architect vetting the translation of an Enterprise Data Model to physical data models and pipelines. As a Data Engineer you will bring your Databricks pipeline expertise to execute on building data products...

Purple Drive
Toronto, Ontario

Times New Roman",serif">8+ years of experience in Data Engineer with AWS, Glue, Lambda, SQL, Python, Dovps, Redshift. Perform data cleansing, data validation etc<br /> <br /> 2. Times New Roman",serif">Must have working knowledge in designing and implementing da...

S.i. Systems
Toronto, Ontario

Data Analysis: Understanding the data structures and terminology used in Guidewire applications will be essential for performing accurate data analysis and troubleshooting. Data Engineer to perform ETL development (PostgreSQL) on Guidewire billing/policy/claims center for a major insurance client . ...

Purple Drive
Toronto, Ontario

Data Engineer with AWS Glue Lambda SQLPython DovpsRedshift. Performdata cleansing data validation etc. Must haveworking knowledge in designing and implementing data pipelines onany of the cloud providers (AWS is preferred). Must be able to workwith large volumes of data coming from various sources. ...

Adastra
Markham, Ontario

As Azure Data Engineer Lead, you will handle end-to-end solutions, architecture design, and documentation for large scale data implementations (related to big data and data warehousing). Senior/Lead Azure Data Engineer (7+ years) possessing skills in solutions design and hands-on development . Knowl...

Purple Drive
Toronto, Ontario

Data Engineer with AWS Glue Lambda SQLPython DovpsRedshift. Perform data cleansingdata validation etc. Must have working knowledge indesigning and implementing data pipelines on any of the cloudproviders (AWS is preferred). Must be able to work with largevolumes of data coming from various sources. ...

Money Mart Financial Services
Toronto, Ontario

Be a key part of Momentum’s Data strategy by developing the next-gen Dynamic Data Engineering framework. Lead and enhance data lake platform acquiring additional data sources - structured and unstructured. Good to have: Strong knowledge on Big Data technologies such as Data Bricks, Event driven data...