Senior Data Engineer (Full Stack, Java)
Endava
Toronto, Ontario, Canada
Full-time
Job Description
- Create and maintain optimal data pipeline architecture
- Implement data products curated by our Chief Data Office, as well as custom data models for fit for use.
- Ensure data quality and integrity across various data sources and systems to ensure data accuracy, completeness, and reliability.
- Optimize data pipelines for performance and scalability.
- Provide technical support to promptly resolve escalated incidents / outages.
- Develop and document a detailed solution design, impart your subject matter expertise throughout life cycle.
- Take business, Enterprise Architecture, system performance and development standards requirements, then develop functional, technical and user interface designs for an application and / or system.
- Find ways to keep costs low, help come up with strategic solutions to support cost effectiveness and enhance stakeholder experience.
- Conduct code reviews to address quality, standards compliance, reusability and ease of maintenance, Operational Readiness Reviews, and support gating and review signoffs for solution design.
- Ensure design leverages existing reusable components, traces back to business requirements, and that new modules are designed with reusability in mind.
- Keep up to date with the latest industry trends and technologies related to data engineering.
Qualifications
- 10+ years of relevant experience in a related field of job function.
- Experience with : Java, Spring,
- Experience with big data tools : Hadoop, HDFS, ADLS, ADF, Spark, Kafka, Databricks, Dremio etc.
- Experience with relational SQL and NoSQL databases, including Cassandra.
- Experience designing production grade, scalable applications and microservices.
- 5+ years of Capital Markets experience.
- Experience working on Agile Teams
Desired :
Experience in Python and / or Scala
Additional Information
Discover some of the global benefits that empower our people to become the best version of themselves :
- Finance : Competitive salary package, share plan, company performance bonuses, value-based recognition awards, referral bonus;
- Career Development : Career coaching, global career opportunities, non-linear career paths, internal development programmes for management and technical leadership;
- Learning Opportunities : Complex projects, rotations, internal tech communities, training, certifications, coaching, online learning platforms subscriptions, pass-it-on sessions, workshops, conferences;
- Work-Life Balance : Hybrid work and flexible working hours, employee assistance programme;
- Health : Global internal wellbeing programme, access to wellbeing apps;
- Community : Global internal tech communities, hobby clubs and interest groups, inclusion and diversity programmes, events and celebrations.
28 days ago