Job Responsibilities :
- Create and maintain optimal data pipeline architecture
- Implement data products curated by our Chief Data Office, as well as custom data models for fit for use.
- Ensure data quality and integrity across various data sources and systems to ensure data accuracy, completeness, and reliability.
- Optimize data pipelines for performance and scalability.
- Provide technical support to promptly resolve escalated incidents / outages.
- Develop and document a detailed solution design, impart your subject matter expertise throughout life cycle.
- Take business, Enterprise Architecture, system performance and development standards requirements, then develop functional, technical and user interface designs for an application and / or system.
- Find ways to keep costs low, help come up with strategic solutions to support cost effectiveness and enhance stakeholder experience.
- Conduct code reviews to address quality, standards compliance, reusability and ease of maintenance, Operational Readiness Reviews, and support gating and review signoffs for solution design.
- Ensure design leverages existing reusable components, traces back to business requirements, and that new modules are designed with reusability in mind.
- Keep up to date with the latest industry trends and technologies related to data engineering.
Skills and Experience Required :
Required :
- 10+ years of relevant experience in a related field of job function.
- Experience with : Java, Spring,
- Experience with big data tools : Hadoop, HDFS, ADLS, ADF, Spark, Kafka, Databricks, Dremio etc.
- Experience with relational SQL and NoSQL databases, including Cassandra.
- Experience designing production grade, scalable applications and microservices.
- 5+ years of Capital Markets experience.
- Experience working on Agile Teams
Desired :
- Experience in Python and / or Scala
Sr. Data Engineer-Java
Implement data products curated by our Chief Data Office, as well as custom data models for fit for use. Ensure data quality and integrity across various data sources and systems to ensure data accuracy, completeness, and reliability. Keep up to date with the latest industry trends and technologies ...
Sr. Manager, Data Engineer SRE
BS/MS/PhD in Computer Science/Engineering preferred. SRE, DevOps, or related roles, with a focus on cloud-based infrastructure (Azure, AWS, or GCP only) and automation. Established SRE as a practice within an organization. A genuine enjoyment of learning about how things work, with the ability to as...
Java Fullstack Developer + Data Engineer
Role: Java Full stack Developer + Data Engineer. Combination of Data Engineer and Java Fullstack Dev API, AWS, Kubernetes, API, No SQL. API development, Java script, Kafka Stream, Kafka Connectors/ IBM MQ, Active MQ, AWS. Strong foundation in programming languages like JavaScript, Python, or Ruby. ...
Java Fullstack Developer + Data Engineer
Role: Java Full stack Developer + Data Engineer. Combination of Data Engineer and Java Fullstack Dev API, AWS, Kubernetes, API, No SQL. API development, Java script, Kafka Stream, Kafka Connectors/ IBM MQ, Active MQ, AWS. Strong foundation in programming languages like JavaScript, Python, or Ruby. ...
Sr. Engineer - Data Security Governance
Engineer - Data Security Governance Location: Toronto, Ontario About the Company At Slate Technologies we are bringing fresh minds and tools to the world of Smart Buildings, Smart Infrastructure, Sustainability, architecture, and construction. This includes public data such as weather, labor, a...
Sr Java Engineer
Years of hands-on senior engineer in JAVA/SPRINGBOOT/KAFKA knowledge who can help implementing the code as per the new architecture. Be able to closely collaborate with multiple application teams and able to work in a complex enterprise environment and communicate effectively with product owner, eng...
Sr. Data Engineer
Be a key part of Momentum’s Data strategy by developing the next-gen Dynamic Data Engineering framework. Good to have: Strong knowledge on Big Data technologies such as Data Bricks, Event driven data processing using Function Apps/Lambda. Lead and enhance data lake platform acquiring additional data...
SR Backend Java Engineer; Distributed Systems
We’re hiring a SR Backend Java Engineer with a strong background in large scale distributed systems. Our customer is embarking on a transition from data centers to Public cloud infrastructure, and you will work on a complete Java stack that serves hundreds of billions of transactions daily. You’ll w...
Intermediate Data Software Engineer (Java)
Software Engineer will typically progress to Senior software Engineer. What does a typical day look like for a Data Software Engineer?. You would be responsible for designing, developing, implementing, and supporting our emerging big data analytics capabilities through the development and maintenanc...
Sr. Data Engineer (Databricks)
You are known as a strong and efficient IC Data Engineer, with the ability to assist the Data Architect vetting the translation of an Enterprise Data Model to physical data models and pipelines. As a Data Engineer you will bring your Databricks pipeline expertise to execute on building data products...