Data Engineer

Manitoba Government
Winnipeg MB
$74K-$98.8K a year
Full-time

Introduction

The Provincial Information Management and Analytics (PIMA) Branch is looking for Data Engineers to join the Analysis and Development area of the Data Administration and Business Intelligence unit (DABI).

As the primary liaison for DABI-related services and functions with PIMA, the Analysis and Development area leads Master Data Management in the provincial data repository.

The area works with source data providers to review metadata before onboarding new datasets, and reviews metadata updates;

creates and facilitates data extracts for internal and external organizations, and is responsible for the development of activities that support data collection, organization, analytics, and distribution.

Conditions of Employment :

  • Must be legally entitled to work in Canada
  • Must provide a current and satisfactory Criminal Record Check
  • Must be able to work on-call or extended hours as required

Qualifications : Essential :

  • Post-secondary degree in Information Technology, Computer Science, Computer Engineering or a related field. An equivalent combination of education, training and experience may be considered.
  • Experience working as a Data Engineer or performing similar duties.
  • Proficiency in creating ETL processes to support data extraction, data transformation, data structures, metadata, dependency and workload management.
  • Experience using programming and scripting languages (e.g. C#, Python, Java, T-SQL) and Business Intelligence reporting tools.
  • Experience building and optimizing data pipelines and data sets.
  • Experience performing analyses on internal and external data to identifying opportunities for data quality improvement.
  • Experience applying methodologies in areas such as : design and modeling of databases, data systems, systems analysis, and database technology.
  • Excellent technical and non-technical verbal communication skills.
  • Excellent technical and non-technical written communication skills.
  • Excellent interpersonal skills to support and collaborate with cross-functional teams in a dynamic environment with Agile cultures.
  • Strong organizational and time management skills including the ability to respond to changing priorities and meet deadlines.

Desired :

  • Experience working within a health data environment.
  • Experience working with all areas of the big data ecosystem.
  • Experience working with cloud service providers (e.g. AWS or Microsoft Azure)
  • Experience creating ETL processes using SSIS (SQL Server Integration Service).

Duties : The Data Engineers will :

  • Provide leadership and mentorship to other data engineers;
  • Design, build, automate, test, tune, and support : Extraction, Transformation, and Loading (ETL) of data from various sources;
  • Create and implement the physical database structure; and
  • Construct and implement operational data stores or marts, based on the logical data model.
  • 30+ days ago
Related jobs
Promoted
Outlier
Winnipeg, Manitoba
Remote

Are you an experienced software engineer who would like to lend your coding expertise to train AI models?. PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of opportunities that may be of interest and sharing with our affiliates. W...

BMO
Canada, Canada

You'll consult with data scientists, the data and analytics teams, technology partners, business partners to create pipelines, governance and solutions that impact a variety of model ops, data and insight challenges across the North American Commercial Bank. Prepare modeling master data sets in coll...

TextNow
Canada

Be a champion of TextNow's data ecosystem by working with data science, engineering and infrastructure to implement data strategy for governance, security, privacy, quality,and retention that will satisfy business policies and requirements. Mentor junior data engineers and promote best practices in ...

StackAdapt
Canada

Working with large data sets and various databases including Aerospike, Elasticsearch, Redis, ScyllaDB, Redshift, TiDB, MariaDB. Our real-time advertising bidding system handles over 3,000,000 requests per second and stores several terabytes of data every day. Very strong problem solving skills in d...

Great Canadian Gaming Corp.
Canada, Canada

Experience with real-time data ingestion and processing using tools like Azure Stream Analytics, especially for pushing data into the data lake in near-real-time. Knowledge of using Azure Databricks or Synapse for data processing, transformation, and analytics within the data lake environment. Senio...

Snaphunt
Canada

You have at least 3 years experience, ideally within a Data Analyst or Data Engineer role. Demonstrated experience working with large and complex data sets as well as experience analyzing volumes of data. Developing scripts to process structured and unstructured data. Recommending, developing and im...

Great Canadian Gaming Corp.
Canada, Canada

Software Data Engineer (#62198). Mindwire Systems is seeking the services of a Software Data Engineer for a contract position with one of our Valued Clients. Interrogating data for quality assurance before building advanced data models. Advanced experience on data extract, transform/load processes w...

MongoDB
Canada

Our team has a big mission to build a data platform for MongoDB R&D to use to make data-informed decisions. Our team owns the cloud infrastructure for DevProd, and we’re expanding our focus to include a Data Platform. The mission of DevProd is to empower MongoDB developers to efficiently build a tra...

WestJet
Anywhere - Canada

WestJet Group is seeking a Data Engineer for the progressive, essential, and fun Data Engineering team. Advise on the right way to apply data engineering standards and methods, ensuring compliance, and maintain technical responsibility for all the stages and iterations of a data engineering project....

Staffmax Staffing & Recruiting
Winnipeg, Manitoba

Our client is seeking a Power Engineer with 2+ years of on site experience preferably in a data centre. Building Operator to oversee the high demand of a data centre in Winnipeg!. Data Center is a ~65,000 sq ft facility that serves the entire company and is operational 24/7. ...