Data Engineer with DBT and Azure Cloud Resources (ADLS, ADF, DataFlow).
Location : Toronto (Greater Toronto Area) - Hybrid
Employment Type : 12+ Months Contract
Job Description : We are looking for a highly skilled professional to design, build, and maintain scalable data solutions while ensuring data quality and driving data innovation.
Requirements :
- Over 3 years of experience working with Azure Cloud Resources (ADLS, ADF, DataFlow).
- At least 2 years of hands-on experience with DBT(Must).
- Proficiency in advanced SQL, data integration, and data modeling principles.
- Experience with Python programming and Git for version control.
- Familiarity with DevOps practices for automation and deployment.
- Strong technical and problem-solving skills.
Responsibilities :
Data Development & Integration : Design and build data solutions using Azure Cloud Resources (ADLS, ADF, DataFlow) in accordance with organizational standards to ensure resilience and scalability.
- Data Modeling & Metadata Management : Create, update, and maintain data models based on business needs and manage metadata repositories to ensure accurate and up-to-date information.
- ETL Processes & Data Preparation : Extract, transform, and load data from various sources, ensuring data quality, integrity, and convergence of datasets using DBT.
- Programming & Scripting : Develop scripts and programs using Python, and employ Git for version control and code management.
- DevOps & Automation : Implement DevOps practices to automate workflows and ensure continuous integration and deployment.
- Problem Resolution & Advanced SQL : Use advanced SQL skills to resolve issues within databases, data products, and processes.
Requirements / Qualifications :
- Data Development & Integration : Design and build data solutions using Azure Cloud Resources (ADLS, ADF, DataFlow) in accordance with organizational standards to ensure resilience and scalability.
- Data Modeling & Metadata Management : Create, update, and maintain data models based on business needs and manage metadata repositories to ensure accurate and up-to-date information.
- ETL Processes & Data Preparation : Extract, transform, and load data from various sources, ensuring data quality, integrity, and convergence of datasets using DBT.
- Programming & Scripting : Develop scripts and programs using Python, and employ Git for version control and code management.
- DevOps & Automation : Implement DevOps practices to automate workflows and ensure continuous integration and deployment.
- Problem Resolution & Advanced SQL : Use advanced SQL skills to resolve issues within databases, data products, and processes.
Data Engineer with DBT and Azure Cloud Resources (ADLS, ADF, DataFlow).
Data Development & Integration: Design and build data solutions using Azure Cloud Resources (ADLS, ADF, DataFlow) in accordance with organizational standards to ensure resilience and scalability. Data Development & Integration: Design and build data solutions using Azure Cloud Resources (ADLS, ADF, ...
Manager, Global Cloud and Security Engineer
The role is focused on operational and related technical support for the designated product(s) and/or cloud solutions/services and the accompanying deployment and adoption process. The role will lead several and diverse engineer team(s) in mostly global projects ensuring delivery of applications and...
Clinical Data Architect & Engineer - Now Hiring!
Through close collaboration with research scientists, statisticians, clinicians, regulatory experts, and DigitalX professionals, this role establishes and upholds robust data architecture frameworks that align harmoniously with business objectives, regulatory mandates, and industry standards. Design...
Azure Data Engineer Lead
As Azure Data Engineer Lead, you will handle end-to-end solutions, architecture design, and documentation for large scale data implementations (related to big data and data warehousing). We are an international consulting company working work with businesses and IT Leaders to extract value through d...
Integration Architect and Engineer, Data & Analytics - Urgently Hiring!
The scope of this role includes designing and implementing solutions to data and analytics use cases tailored to the unique requirements of life sciences research and development and managing day to day operations and enhancements of multiple data and analytics foundational platforms. By collaborati...
Cloud & Data Center Systems Support Analyst (Intermediate)
Proven experience providing technical design, deployment and support of Data Center Networking, Storage, Systems and Cloud based solutions. Current certifications are not mandatory, but candidates with AZ 305 and AZ 700 certifications will be viewed favorably. Strong interpersonal skills; proven tea...
Platform Engineer, SF Data & Reporting - Urgently Hiring!
Collaboration: Work collaboratively with team members within the subdivision and across other digital and business units. Digital Capability, on the other hand, focus on the growth and development of individuals within a specific. An Enterprise Business Platforms Engineer focuses on the development,...
Fullstack engineer with MLOps and Devops
The ideal candidate will have a strong background in software engineering and experience in deploying and managing AI-driven chatbot solutions in Azure cloud environments. We are looking for a skilled and innovative engineer to join our team in a multifaceted role focusing on Software Health Check (...
Senior Office 365 & Azure Engineer
This position will allow you to work alongside some of the most talented engineers in the US and Canada and afford you the opportunity to grow with an innovative managed services provider that has a 25-year history of providing a full range of IT solutions and is continuing to expand throughout Nort...
Data & Analytics - Senior Data Visualization Engineer
The mission of the Data & Analytics Department is to provide the business with actionable and accurate information to enable data-informed decision-making. As a member of the Data & Analytics Department supporting the Supply Chain division, you will be part of the team that bridges the gap between b...