Job Description
- Create and maintain optimal data pipeline architecture
- Implement data products curated by our Chief Data Office, as well as custom data models for fit for use.
- Ensure data quality and integrity across various data sources and systems to ensure data accuracy, completeness, and reliability.
- Optimize data pipelines for performance and scalability.
- Provide technical support to promptly resolve escalated incidents / outages.
- Develop and document a detailed solution design, impart your subject matter expertise throughout life cycle.
- Take business, Enterprise Architecture, system performance and development standards requirements, then develop functional, technical and user interface designs for an application and / or system.
- Find ways to keep costs low, help come up with strategic solutions to support cost effectiveness and enhance stakeholder experience.
- Conduct code reviews to address quality, standards compliance, reusability and ease of maintenance, Operational Readiness Reviews, and support gating and review signoffs for solution design.
- Ensure design leverages existing reusable components, traces back to business requirements, and that new modules are designed with reusability in mind.
- Keep up to date with the latest industry trends and technologies related to data engineering.
Qualifications
- 10+ years of relevant experience in a related field of job function.
- Experience with : Java, Spring,
- Experience with big data tools : Hadoop, HDFS, ADLS, ADF, Spark, Kafka, Databricks, Dremio etc.
- Experience with relational SQL and NoSQL databases, including Cassandra.
- Experience designing production grade, scalable applications and microservices.
- 5+ years of Capital Markets experience.
- Experience working on Agile Teams
Desired :
Experience in Python and / or Scala
Additional Information
Discover some of the global benefits that empower our people to become the best version of themselves :
- Finance : Competitive salary package, share plan, company performance bonuses, value-based recognition awards, referral bonus;
- Career Development : Career coaching, global career opportunities, non-linear career paths, internal development programmes for management and technical leadership;
- Learning Opportunities : Complex projects, rotations, internal tech communities, training, certifications, coaching, online learning platforms subscriptions, pass-it-on sessions, workshops, conferences;
- Work-Life Balance : Hybrid work and flexible working hours, employee assistance programme;
- Health : Global internal wellbeing programme, access to wellbeing apps;
- Community : Global internal tech communities, hobby clubs and interest groups, inclusion and diversity programmes, events and celebrations.
Senior Software Engineer (Full-Stack)
Are you a highly skilled and motivated individual with a passion for Engineering? Look no further! Ripple is seeking a Senior Software Engineer to join our exceptional team and contribute to the development of high-quality software solutions. Minimum of 7 years of experience in software engineering,...
Senior Data Engineer
AWS Glue, AWS S3, Sagemaker, Azure Data Factory, GCP Dataflow). Hadoop, Spark, or Kafka for real-time data streaming and big data processing. Docker, Kubernetes, Datadog, Terraform, and Github Actions for managing data pipeline deployments. Develop, test, and maintain data management solutions. ...
Full Stack Engineer, Internal Data Products, ML Foundations
As a Full Stack Engineer in our Internal Data Product Team, you will play a crucial role in developing high leverage tooling and user interfaces for data visualization and analysis, all of which are critical to driving data literacy and empowering decision-making across the organization. Familiarity...
Senior Full Stack Engineer - Angular / Node JS
Senior/Principal Full Stack Engineer. Experience with monitoring and observability tools (Datadog, Splunk). Position Status: Full-time, permanent. ...
Senior Full Stack Java Developer
Senior Full Stack Java Developer. Job Title: Senior Full Stack Java Developer. MUST: 8+ years of experience in Core Java, Java Collection, Java Concurrency and building thread safe code. Application Programmer Expert with 5+ years of experience and strong front and back-end development abilities usi...
Full Stack Software Engineer II, D&D Beyond
As a Full Stack Software Engineer working on the Dungeons & Dragons® (D&D) team you will help design and build the next generation of D&D’s digital toolset and marketplace, D&D Beyond. SQL Server, MySQL, Postgres) and non-relational databases (e. ...
Senior Data Engineer - Azure
Apache Hadoop, Azure SQL Data Warehouse, Big Data, Big Data Technologies, Cloud Computing, Database Development, Data Warehousing (DW), ETL Development, Microsoft Azure, Microsoft Azure SQL Database, Microsoft SQL Server, Snowflake (Platform), Snowflake Data Warehouse, Tableau (Software). RBC is see...
Senior Google Cloud Data Engineer - ELT Data Pipeline, Fivetran, Qlik, Airbyte Large data
Have prior experience with data developer, data engineering, programming, ETL, ELT, processes for data integration. Google Cloud, Data Warehouse, Data Engineering,. Data Warehouse / Data Platforms. Experience in data modelling, manipulating large data sets and handling raw SQL, and handling other cl...
Senior Platform/Data Engineer
Big Data Management, Cloud Computing, Database Development, Data Engineering, Data Mining, Data Pipelines, Data Visualization Tools, Data Warehousing (DW), ETL Processing, Extract Transform Load (ETL), Group Problem Solving, Microsoft Azure, Performance Optimizations, Python (Programming Language), ...
Senior Data Engineer
You will work closely with clients to understand their data needs, ensure data governance and security compliance, optimize costs, design efficient data pipelines, provide expert guidance on best practices, collaborate with cross-functional teams to ensure seamless integration, perform data migratio...