We are seeking a Senior Data Engineer with specialized experience in Data Lakehouse and AWS technologies to design, develop, and optimize our data management systems.
The ideal candidate will have a strong foundation in data architecture and data engineering principles, with extensive experience in AWS cloud services.
This role involves managing large datasets, ensuring data integrity, and providing scalable data storage, processing, and analytics solutions.
Key Responsibilities :
- Develop and maintain scalable and secure data architectures using AWS services like S3, Redshift, Glue, and Athena
- Design and implement efficient data pipelines within the AWS environment, facilitating seamless data integration and accessibility
- Leverage AWS analytics and machine learning services to enhance business insights and decision-making processes
- Ensure data governance, quality, and compliance within our AWS-based data lakehouse infrastructure
- Experience building and optimizing big data’ data pipelines, architectures, and data sets
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
- Collaborate with various teams to understand data needs and deliver innovative cloud-based data solutions
- Stay updated with the latest AWS technologies and data lakehouse trends to keep our data infrastructure at the forefront of innovation
Knowledge, Skills, Abilities and Competencies :
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
- Extensive experience with AWS services, particularly in data warehousing and analytics (certifications preferred)
- Proficiency in SQL, Python, or Scala for data processing and pipeline development
- Strong understanding of data lakehouse architecture and experience in implementing such systems
- Solid background in data engineering practices, including data modeling, ETL development, and data warehousing
- Excellent problem-solving abilities and strong communication skills
Senior Data Engineer
Evaluate new technologies, design, implement, and maintain data pipelines for extraction, transformation, and loading of data from a wide variety of data sources to various data services. A senior engineer with exposure leading projects and mentoring junior developers. You have a passion for Big Dat...
Senior Google Cloud Data Engineer - ELT Data Pipeline, Fivetran, Qlik, Airbyte Large data
Have prior experience with data developer, data engineering, programming, ETL, ELT, processes for data integration. Google Cloud, Data Warehouse, Data Engineering,. Data Warehouse / Data Platforms. Experience in data modelling, manipulating large data sets and handling raw SQL, and handling other cl...
Senior Consultant, Data Privacy Engineer
Data literacy: finding and managing data, cleansing data, manipulating data. As a Data Privacy Engineer, you will be at the forefront of Deloitte's mission to ensure data privacy and protection. Responsible for assisting with the management of the data privacy, data protection, data usability, perfo...
Senior Data Analyst / Engineer
Senior Data Analyst / Engineer Consultant - Edmonton, AB. Experience with real-time data ingestion and processing using tools like Azure Stream Analytics, especially for pushing data into the data lake in near-real-time. Knowledge of using Azure Databricks or Synapse for data processing, transformat...
Senior Data/ technical engineer
Senior Data/Technical engineer. We at Raise are hiring a Senior Data/Technical engineer for one of our top clients. Reporting to the Director, Resilience Data Analytics, the Data Analytics Solution Expert (DASE) will be a senior contributor to the overall success of the Technology Internal Controls ...
Senior BIG Data Engineer - CGEMJP00256160
Role: Senior BIG Data Engineer. Write SQL queries to extract data from the data warehouse - hands on experience. Create data definitions for new database files or alterations made to the already existing ones for analysis purposes. SCALA, Java, Hive, Biga Data, SPAK, HDFS, Unix shell scripting, SQL,...
Senior Big Data Hadoop ML Engineer (GCP) - Canada
We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. This role involves working in Java, and working on Machine Learning pipelines for data collection or batch inference. Leverage GCP for scalable big data processing and storage solutions. Proven experie...
Senior Consultant - Azure Data Engineer
At least 4 years of experience in designing, implementing, and maintaining robust and scalable data pipelines on Azure using services such as Azure Data Factory, Azure SQL Data Warehouse, Azure Analysis Services or any of the Azure Databricks/Synapse/Fabric. Ability to implement and manage CI/CD pip...
Senior Data Modeler/data Engineer
We are seeking a Senior Data Modeler/Data Engineer to join our Information Technology Department to play a crucial role in designing and implementing data models for a data warehouse/lakehouse that support our business requirements. Create and maintain comprehensive technical documentation for datab...
Senior Software Engineer - Data Platform
As a Software Engineer in Opendata, you will be responsible for the new Data Platform implementation. Veeva OpenData supports the industry by providing real-time reference data across the complete healthcare ecosystem, to support commercial sales execution, compliance, and business analytics. You wi...