Job Title : Sr. Data Engineer - Java
Job Location : Toronto, ON (Hybrid - 2 days / week onsite)
Positions : 2
Employment Type : FTE
Key Technology : Java, Big Data
Job Responsibilities :
- Create and maintain optimal data pipeline architecture
- Implement data products curated by our Chief Data Office, as well as custom data models for fit for use.
- Ensure data quality and integrity across various data sources and systems to ensure data accuracy, completeness, and reliability.
- Optimize data pipelines for performance and scalability.
- Provide technical support to promptly resolve escalated incidents / outages.
- Develop and document a detailed solution design, impart your subject matter expertise throughout life cycle.
- Take business, Enterprise Architecture, system performance and development standards requirements, then develop functional, technical and user interface designs for an application and / or system.
- Find ways to keep costs low, help come up with strategic solutions to support cost effectiveness and enhance stakeholder experience.
- Conduct code reviews to address quality, standards compliance, reusability and ease of maintenance, Operational Readiness Reviews, and support gating and review signoffs for solution design.
- Ensure design leverages existing reusable components, traces back to business requirements, and that new modules are designed with reusability in mind.
- Keep up to date with the latest industry trends and technologies related to data engineering.
Skills and Experience Required :
Required :
- 10+ years of relevant experience in a related field of job function.
- Experience with : Java, Spring,
- Experience with big data tools : Hadoop, HDFS, ADLS, ADF, Spark, Kafka, Databricks, Dremio etc.
- Experience with relational SQL and NoSQL databases, including Cassandra.
- Experience designing production grade, scalable applications and microservices.
- 5+ years of Capital Markets experience.
- Experience working on Agile Teams
Desired :
- Experience in Python and / or Scala
Data Engineer
Experience building data pipelines using Azure Data Factory and Databricks. ETL developers are responsible for designing and creating the data warehouse and all related extraction, transformation and load of data functions. Looking for an Integration engineer responsible for daily support and projec...
Rx Data Enrichment Engineer - Pharmacy Domain
RX data enrichment - BPS resource with 3-6 years experience Preferred experience in Pharmacy/healthcare domain specially drug data entry and enrichment/formulary updates. ...
Principal Data Engineer
As a Principal Data Engineer, you will help drive the direction of our Data Warehouse, and be hands on with teammates across all departments to enable access to our data and empower teams to make data driven decisions about the direction of our business. Data Engineer, with a focus on cloud-based Da...
Data Engineer II
Provide a broad range of data engineering functions including data modeling, data quality, data profiling, data acquisition and ingestion, extract transform load (ETL), metadata enrichment and management, data provenance and lineage, and other specialized data management functions. Elicit, analyze, ...
Canadian Armed Forces - Data Center Facility Engineer (HVAC, Mechanical, Electrician, Security Systems)
Canadian Armed Forces - Data Center Facility Engineer (HVAC, Mechanical, Electrician, Security Systems). Data Center Operations, Critical Facilities Engineer. Equinix is the world’s digital infrastructure company®, operatingover 250 data centers across the globe. Joining our operations team means th...
Lead Data Engineer
Big Data, Big Data Management, Cloud Computing, Database Development, Data Mining, Data Warehousing (DW), ETL Processing, Group Problem Solving, High Availability, Processing, Quality Management, Requirements Analysis, Unstructured Data. Platform Engineering Big Data team is looking for a Lead Data ...
Data Engineer
As a Data Engineer, you will be responsible forbuilding and maintaining the systems and processes that allow for theextraction, transformation, and loading (ETL) of data from various sources intoour Azure-based data ecosystem. Azure DevOps Engineer with D365 and F&Oexperience. ...
Software Engineer, Data Transformation Movement
Data Transformation builds and operates the transformation abstractions and infrastructure that support frictionless data development across the board, sub-minute event data to enormous daily partitions - or even for-all-time snapshots. The Data Transformation and Movement team operates the critical...
Software Engineer, Data
As a Software Engineer, Data at Autodesk Research, you will work side-by-side with world-class researchers and engineers to build new ML-powered product features that help our customers imagine, design, and make a better world. Our mission is to build scalable data pipelines to aggregate, prepare, a...
Sr. Data Engineer
Be a key part of Momentum’s Data strategy by developing the next-gen Dynamic Data Engineering framework. Good to have: Strong knowledge on Big Data technologies such as Data Bricks, Event driven data processing using Function Apps/Lambda. Lead and enhance data lake platform acquiring additional data...