Job Description
Senior Data Engineer - DataBricks-
Description
JOB LOCATION :
Vancouver, Calgary and Edmonton
KEY RESPONSIBILITIES :
- Architect, design and implement ETL (Extract, Transform, Load) processes to ingest data from various sources into Unity Catalog experience / knowledge is a strong asset
- Use notebooks to write code in PySpark, SparkR, or Spark SQL for data ingestion, preparation, and transformation
- Develop and manage frameworks for data ingestion and workflow orchestration using Data Factory or Dataflows
- Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver appropriate solutions
- Document data engineering processes, architecture, and configurations using Agile methodology to support use cases, ensuring standardization and reusability of work products.
REQUIRED SKILLS
- Bachelor’s degree in computer science, Information Technology, or a related field.
- 5+ years of experience in data engineering, with a focus on Microsoft Azure and related technologies.
- Hands-on experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services.
- Proficiency in SQL, Python, R, and other relevant programming languages.
- Unity Catalog Experience is desired.
- Fabric Analytics Engineer Associate or Azure Data Engineer Associate certifications are a plus.
Life at Capgemini
Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer :
- Flexible work
- Healthcare including dental, vision, mental health, and well-being programs
- Financial well-being programs and Employee Share Ownership Plan
- Paid time off and paid holidays
- Paid parental leave
- Family building benefits like adoption assistance, surrogacy, and cryopreservation
- Social well-being benefits like subsidized back-up child / elder care and tutoring
- Mentoring, coaching and learning programs
- Employee Resource Groups
- Disaster Relief
Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society.
It is a responsible and diverse group of , team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs.
It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem.
The Group reported global revenues of €22.5 billion.
Get The Future You Want Disclaimer
Senior Data Engineer
The Senior Data Engineer is responsible for designing, developing, and maintaining data storage, processing and integration solutions focused on the customer portfolio of applications. Build, maintain and optimizes data pipelines and data processing workflows to ensure the integrity of data across s...
Senior Consultant, Data Privacy Engineer
Data literacy: finding and managing data, cleansing data, manipulating data. As a Data Privacy Engineer, you will be at the forefront of Deloitte's mission to ensure data privacy and protection. Responsible for assisting with the management of the data privacy, data protection, data usability, perfo...
Data Engineer (Databricks)
You are known as a strong and efficient IC Data Engineer, with the ability to assist the Data Architect vetting the translation of an Enterprise Data Model to physical data models and pipelines. As a Data Engineer you will bring your Databricks pipeline expertise to execute on building data products...
Senior Data Engineer
This is 4 days a week onsite! Applying to the position, you may join one of the most respected and fastest growing institutional investors in the world.Our client is a professional investment management organization that globally invests the funds to ensure long-term sustainability.The company inves...
Sr. Data Engineer (Databricks)
You are known as a strong and efficient IC Data Engineer, with the ability to assist the Data Architect vetting the translation of an Enterprise Data Model to physical data models and pipelines. As a Data Engineer you will bring your Databricks pipeline expertise to execute on building data products...
Senior Engineer - Data Governance and Quality - Deloitte Global Technology
The data governance and data quality engineer is an individual contributor that provides specialized technical and functional expertise that works in collaboration with functional teams and stakeholders to modeling, developing, enhancing and deploying technical components related to the data governa...
Senior Data Engineer
Are you passionate about using data to shape the future of Faire's product features for small and medium businesses (SMBs)? If so, we want to talk to you! We're looking for a Senior Data Engineer with a deep expertise in designing and building data systems and a dedication to applying software devel...
Azure Senior Data Engineer/Architect
Are you a Data Architect or a Senior Data Engineer interested in working in a talented and collaborative team developing Cloud, Data and AI solutions for leading global clients? Do you regularly find yourself in conversations on disparate and dispersed data sources and feel the need to create a robu...
Senior Data Engineer - Data Insights (Remote) (Canada)
Proven experience as a big data engineer or a similar role, with a deep understanding of big data technologies, frameworks, and best practices. Building and maintaining data infrastructure, including data lakes, data warehouses, and real-time streaming platforms. Developing and optimizing data pipel...
Senior Engineer - Data Governance and Quality - Deloitte Global Technology
The data governance and data quality engineer is an individual contributor that provides specialized technical and functional expertise that works in collaboration with functional teams and stakeholders to modeling, developing, enhancing and deploying technical components related to the data governa...