Data Engineer - Python, R, ETL, Hadoop

Astra North Infoteck Inc.
ON, ON, ca
Full-time
Quick Apply

Job Description

  • Python / R experience with programming languages such as Python R
  • 5+ years data engineering experience with ETL SQL NoSQL Apache Hadoop.
  • Experience executing projects as a team in Agile environments (Kanban and Scrum).
  • Experience in user interface frameworks / platforms (Angular React etc.) for integration.
  • Experience with relational and NoSQL databases.
  • Experience with DevOps Continuous Integration and Continuous Delivery (Kubernetes Maven Jenkins Stash Ansible Docker).
  • Experience using source control for feature-driven development in Git.
  • Experience with containerization
  • 18 hours ago
Related jobs
Astra North Infoteck Inc.
ON, ON, ca

Python / R experience with programming languages such as Python R. Experience with relational and NoSQL databases. ...

Astellas
Markham, Ontario

It also includes supervising the integration and management of various clinical data and data sources, such as clinical trials data, operational data, lab data, wearables data, and real-world evidence. The Clinical Data Engineer (ETL) role serves the purpose of fostering innovation and operational e...

Astra North Infoteck Inc.
Toronto, Ontario

Essential Skills: Solid Experience in Snowflake, Python, AWS, Database management and query writing. ...

E-Solutions
Toronto, Ontario

AWS ETL Data Engineer (Amazon Redshift ). Design, develop, and maintain ETL processes using AWS Glue to extract, transform, and load data from various sources (including S, ORC/Parquet/Text files) into AWS Redshift. Knowledge of big data technologies like Hadoop, Spark, or EMR. Experience with SQL, ...

ipvisibility
Ottawa, Ontario
Remote

Reviewing designingdeveloping ETL jobs to ingest data into Data Lake load data to datamarts;. Parse unstructured datasemi structured data such XML etc. Design anddevelop efficient Mapping and workflows to load data to Data Marts. Write efficient queries andreports in Hive or Impala to extract data o...

Astra North Infoteck Inc.
Toronto, Ontario

Transformation and Loading (ETL) processes using frameworks like Azure Data Factory or Synapse or Databricks; establishing the cloud connectivity between different system like ADLS ,ADF, Synapse, Databricks etc. Identifying reporting, and managing database security issues, user access/management; De...

Astellas
Markham, Ontario

It also includes supervising the integration and management of various clinical data and data sources, such as clinical trials data, operational data, lab data, wearables data, and real-world evidence. The Clinical Data Engineer (ETL) role serves the purpose of fostering innovation and operational e...

Astra North Infoteck Inc.
Toronto, Ontario

Transformation and Loading (ETL) processes using frameworks like Azure Data Factory or Synapse or Databricks; establishing the cloud connectivity between different system like ADLS ,ADF, Synapse, Databricks etc. Identifying reporting, and managing database security issues, user access/management; De...

Astra North Infoteck Inc.
Toronto, Ontario

Transformation and Loading (ETL) processes using frameworks like Azure Data Factory or Synapse or Databricks; establishing the cloud connectivity between different system like ADLS ,ADF, Synapse, Databricks etc. Identifying reporting, and managing database security issues, user access/management; De...

Astra North Infoteck Inc.
Markham, Ontario

Should have adequate experience and clear understanding of data warehouse and data mart testing. Should have exposure to large data sets and understand Data Quality Framework. Identification and Test Data Preparation Techniques. QA Automation Test tools expertise using Python. ...