Recherche d'emploi > Vancouver, BC > Temporaire > Data engineer

Lead Snowflake Data Engineer

Samay Consulting
Vancouver, British Columbia, Canada
Temps plein

Job Title : Lead Azure & Snowflake Data Engineer

Location : Vancouver, BC (Hybrid)

Employment Type : Contract

About the Role :

We are seeking a skilled and experienced Azure & Snowflake Data Engineer to join our team. As a key player, you will design, build, and maintain scalable data solutions using Microsoft Azure and Snowflake technologies.

You will collaborate with cross functional teams to ensure that our data infrastructure is optimized for performance, security, and scalability.

The project involves leveraging a ready Snowflake Adapter with a SaaS system to pull all the relevant data from the SaaS system.

If the adapter cannot be leveraged, the client plans on using Azure Data Factory to extract the data from the source system.

You would then be involved in transforming the data and preparing it for loading into the Data Warehouse

Key Responsibilities :

  • Data Pipeline Development : Design and implement end to end data pipelines to support data ingestion, transformation, and loading (ETL / ELT) using Azure Data Factory (ADF), Snowflake, Logic Apps and other relevant Azure tools.
  • Data Warehousing : Develop, maintain, and optimize large-scale data warehouses and analytical databases on Azure, including Azure SQL Data Warehouse and Snowflake
  • Data Modeling : Create and maintain logical and physical data models that align with business requirements, ensuring data integrity and scalability.
  • Cloud Integration : Develop and manage cloud based data integration solutions between various systems, including on premises, cloud, and third party data sources.
  • Data Governance : Ensure compliance with data governance and security policies, including data encryption, anonymization, and adherence to data privacy regulations.
  • Automation : Automate repetitive data tasks and implement performance tuning strategies to ensure efficient data processing.
  • Collaboration : Work closely with business stakeholders, data analysts, and software development teams to gather requirements and deliver reliable, efficient data solutions.

Required Qualifications :

Experience : 10+ years of experience working as a Data Engineer with a focus on Azure and Cloud technologies. Experience working with Snowflake is nice to have

Technical Expertise :

  • Strong experience with Azure Data Factory (ADF), Azure Data Lake, and Azure SQL Database.
  • Handson experience wth ETL / ELT pipeline development using Azure technologies.
  • Expertise in SQL & PLSQL for data transformation and processing.
  • Familiarity with Power BI or other reporting tools for data visualization
  • Cloud Technologies : Solid understanding of Azure cloud services, including storage solutions (Blob Storage, Data Lake), and compute services (Snowflake).
  • Big Data : Experience working with largescale data sets and knowledge of data partitioning, indexing, and optimization techniques.
  • Data Security : Understanding of Azure data security best practices, including encryption, role based access control (RBAC), and Azure Key Vault.
  • Data Modeling : Strong data modeling skills with experience in dimensional and relational data models.

Preferred Qualifications :

  • Certifications : Azure Data Engineer Associate or equivalent certification.
  • Experience with DevOps practices and tools such as Azure DevOps, Git, CI / CD pipelines.

Soft Skills :

  • Excellent problem-solving skills with the ability to troubleshoot complex data issues.
  • Strong verbal and written communication skills to collaborate with business stakeholders.
  • Team oriented mindset with a proactive approach to improving data processes.

Why Join Us?

Opportunity to work with cutting-edge Azure technologies and largescale data projects.

Collaborative work environment with a focus on continuous learning and development.

Competitive salary and benefits package.

Il y a 22 heures
Emplois reliés
Offre sponsorisée
Samay Consulting
Vancouver, Colombie-Britannique

Data Pipeline Development: Design and implement end to end data pipelines to support data ingestion, transformation, and loading (ETL/ELT) using Azure Data Factory (ADF), Snowflake, Logic Apps and other relevant Azure tools. Data Warehousing: Develop, maintain, and optimize large-scale data warehous...

Offre sponsorisée
ITC Infotech
Vancouver, Colombie-Britannique

We are looking for a Technical Lead candidate with strong hands-on experience in Technologies within Data Engineering Stack. Years of overall experience in Data Management, Data Analysis ETL or in similar field. Experience and Knowledge of data management fundamentals, data storage principles and ET...

S.i. Systems
Vancouver, Colombie-Britannique

Senior Data Engineer Team Lead to oversee critical data engineering activities within the Digital Health sector. Provide strategic oversight of data engineering activities, shaping platform strategy and data architecture. Act as a technical leader for the team, establishing best practices for data e...

DOW JONES
Vancouver, Colombie-Britannique

As an experienced Lead Data Engineer your responsibilities will include, but are not limited to: working with our product teams to provide timely, effective and performant solutions; contributing to the design of scalable data solutions, including the development of automated pipelines; implementing...

Offre sponsorisée
Amazon Development Centre Canada ULC
Vancouver, Colombie-Britannique

You’ll join a diverse organization which consists of software engineers, network engineers, data engineers, scientists, and software managers. We are looking for an exceptional Software Development Engineer (SDE) to build and automate our software systems that leverage data streaming solutions for d...

Offre sponsorisée
Accelerize 360
Canada

You will work closely with clients to understand their data needs, ensure data governance and security compliance, optimize costs, design efficient data pipelines, provide expert guidance on best practices, collaborate with cross-functional teams to ensure seamless integration, perform data migratio...

Offre sponsorisée
Direct IT Recruiting Inc., WBE Canada Certified
Canada
Télétravail

SKILLS: Senior Developer, Ellucian Banner, PL/SQL, API Development, Ellucian Argos, Cohorts, JavaScript, HTML, CSS. Process Refinement: Evaluating and refining the English and Math processes, ensuring the correct application of transfer credits through the relevant Banner tables (PL/SQL and. Impleme...

Offre sponsorisée
Playwire
Canada

As we continue our rapid expansion, we are seeking a Senior Software Engineer (TypeScript) to join our team. Design, develop, test, and release a next-gen web-based software platform. ...

Offre sponsorisée
freelance.ca
Canada

Participating in projects such as SAS migration to SAS Viya, Data Science Platform decommissioning, CL and PL datahub (bringing all data sources together), or supporting one of our existing AI families in data ingestion/consumption. Able to thrive in a diverse team of Business Architects, Solution A...

Offre sponsorisée
Altis Recruitment
Burnaby, Colombie-Britannique

Our client in the Information Management Services industry is seeking Warehouse Associates to perform general labour tasks in their warehouse. Experience in a warehouse environment is an asset. ...