Job Description
Senior Data Engineer - DataBricks-
Description
JOB LOCATION :
Vancouver, Calgary and Edmonton
KEY RESPONSIBILITIES :
- Architect, design and implement ETL (Extract, Transform, Load) processes to ingest data from various sources into Unity Catalog experience / knowledge is a strong asset
- Use notebooks to write code in PySpark, SparkR, or Spark SQL for data ingestion, preparation, and transformation
- Develop and manage frameworks for data ingestion and workflow orchestration using Data Factory or Dataflows
- Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver appropriate solutions
- Document data engineering processes, architecture, and configurations using Agile methodology to support use cases, ensuring standardization and reusability of work products.
REQUIRED SKILLS
- Bachelor’s degree in computer science, Information Technology, or a related field.
- 5+ years of experience in data engineering, with a focus on Microsoft Azure and related technologies.
- Hands-on experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services.
- Proficiency in SQL, Python, R, and other relevant programming languages.
- Unity Catalog Experience is desired.
- Fabric Analytics Engineer Associate or Azure Data Engineer Associate certifications are a plus.
Life at Capgemini
Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer :
- Flexible work
- Healthcare including dental, vision, mental health, and well-being programs
- Financial well-being programs and Employee Share Ownership Plan
- Paid time off and paid holidays
- Paid parental leave
- Family building benefits like adoption assistance, surrogacy, and cryopreservation
- Social well-being benefits like subsidized back-up child / elder care and tutoring
- Mentoring, coaching and learning programs
- Employee Resource Groups
- Disaster Relief
Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society.
It is a responsible and diverse group of , team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs.
It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem.
The Group reported global revenues of €22.5 billion.
Get The Future You Want Disclaimer
Data & Analytics - Senior Engineer, Digital Platform
The mission of the Data & Analytics Department is to maximize the value of Aritzia's data by making it available, insightful and actionable to foster a culture of data-driven decision making. As the Senior Engineer, Digital Platform, you will leverage modern software development and operational prac...
Senior Data Modeler/data Engineer
We are seeking a Senior Data Modeler/Data Engineer to join our Information Technology Department to play a crucial role in designing and implementing data models for a data warehouse/lakehouse that support our business requirements. Create and maintain comprehensive technical documentation for datab...
Senior Software Engineer - Data Platform
As a Software Engineer in Opendata, you will be responsible for the new Data Platform implementation. Veeva OpenData supports the industry by providing real-time reference data across the complete healthcare ecosystem, to support commercial sales execution, compliance, and business analytics. You wi...
Azure Senior Data Engineer/Architect
Are you a Data Architect or a Senior Data Engineer interested in working in a talented and collaborative team developing Cloud, Data and AI solutions for leading global clients? Do you regularly find yourself in conversations on disparate and dispersed data sources and feel the need to create a robu...
Senior Data Engineer - Data Insights (Remote) (Canada)
Proven experience as a big data engineer or a similar role, with a deep understanding of big data technologies, frameworks, and best practices. Building and maintaining data infrastructure, including data lakes, data warehouses, and real-time streaming platforms. Developing and optimizing data pipel...
Senior Data Engineer
Evaluate new technologies, design, implement, and maintain data pipelines for extraction, transformation, and loading of data from a wide variety of data sources to various data services. A senior engineer with exposure leading projects and mentoring junior developers. You have a passion for Big Dat...
Data & Analytics - Senior Data Visualization Engineer/Data Visualization Engineer
Proven skills, education, and/or applicable certifications in: Experience creating custom data visualizations and data experiences using modern tools (Tableau, Looker, Power BI)Ability to lead the design process from ideation to polished design, using sketches, wireframes, UX scenarios and mockups t...
Senior Principle Engineer Data and AI
Domain expertise in the implementation of one or more of the following: AI end to end data processing, scenarios and system optimizations, core database internals (Ex: query optimization, runtime, scheduling, storage engine, transaction processing, etc. Architect and develop framework/engine for th...
Senior Data Engineer, Baseball Systems
The Toronto Blue Jays are seeking an experienced Data Engineer to join their Baseball Systems team to help build their next generation of databases and data processing systems. Senior Data Engineer, Baseball Systems . To build and maintain databases and other systems for storing baseball data. ...
Senior Data Quality Engineer
We are looking for aSenior Data Quality Engineerto join the Central Technology Product Development team in support of Morningstar’s Business Intelligence Reporting. The QA Engineer is expected to improve the accuracy of Corporate System Dataand improve stability of data ingestion pipelines. At our c...