Job Description
Role Description :
- Designing and developing data pipelines using Cloud Technologies based on business requirements and technical design.
- Collaborating with Stakeholders, Business Analysts and Data Architects to assist and translate business requirements to technical solutions
- Develop big data and analytic solutions leveraging new or existing technology to advance client’s all lines of business
- Exploratory data analysis by querying and processing data stores and databases and generate reports.
- Design, upgrade and implement new data workflows.
- Write and maintain technical documentation
- Executes updates, patches, and other activities required to maintain and enhance the operations of on-premise or cloud-based environments
Competencies : Data Structures
Experience (Years) : 4-6
Essential Skills :
- Experience working as Data Engineer with focus on big data processing and / or relational databases with good understanding of SQL
- Experienced with working on Structured and Semi-Structured datasets.
- Experience working with Microsoft Azure Data Platform, specifically Azure SQL Database, Azure Data Factory, ADLS storage account, Azure Data Bricks and DevOps Experienced in creating data pipelines & developing complex and optimized queries
- Experienced with Workflow Management Tools : Airflow, Crontab, CA Workload Automation
- Experience with implementing CI / CD pipeline on GitHub, Jenkins / JGP.
- Experience writing complex SQL and NoSQL jobs to analyze data in traditional DBMS (MS-SQL, Oracle) environments
- Experience with integrating to back-end / legacy environments
- Experience integrating business and technology teams
- Experienced in any of the following programming / scripting languages (SQL, Python, Shell, Scala) Excellent organizational and time management skills, strong business presence with ability to multi-task and effectively deal with competing priorities
Desirable Skills :
- Previous work experience in the financial sector (insurance or benefits industry).
- Knowledgeable or at least have the basic concept of Data Visualization in any of the following tools : Tableau, PowerBI, QlikView / QlikSense
DevOps Engineer, Docker/Jenkins – Azure Cloud
DevOps Engineer - Docker/Jenkins - Azure Cloud. On behalf of our client in the Banking Sector, PROCOM is looking for a DevOps Engineer - Docker/Jenkins - Azure Cloud. DevOps Engineer - Docker/Jenkins - Azure Cloud – Job Description. DevOps Engineer - Docker/Jenkins - Azure Cloud – Mandatory Skills. ...
Solution Architect - Java, Spark, Hadoop, Big Data, Vue.js/Node.js
Java, Spark, Hadoop, Big Data, Vue. Proven knowledge & architecture experience in, architecture (digital / digital marketing / micro / macro / monolithic services, APIs), application integration, service-oriented architecture, event-driven architecture, application architecture, distributed architec...
Data Engineer
Experience building data pipelines using Azure Data Factory and Databricks. ETL developers are responsible for designing and creating the data warehouse and all related extraction, transformation and load of data functions. Looking for an Integration engineer responsible for daily support and projec...
Azure AI / ML Platform Engineer
Understand Azure security features (data protection, authentication, RBAC, etc). Ability to troubleshoot Azure, DNS, Azure connectivity, NSG, routing. Understand security, risks and mitigations to load data and training models securely into Cloud. Write and use Azure RM and Terraform templates. ...
Canadian Armed Forces - Data Center Facility Engineer (HVAC, Mechanical, Electrician, Security Systems)
Canadian Armed Forces - Data Center Facility Engineer (HVAC, Mechanical, Electrician, Security Systems). Data Center Operations, Critical Facilities Engineer. Equinix is the world’s digital infrastructure company®, operatingover 250 data centers across the globe. Joining our operations team means th...
Clinical Data Engineer (ETL)
It also includes supervising the integration and management of various clinical data and data sources, such as clinical trials data, operational data, lab data, wearables data, and real-world evidence. Expertise in Data Engineering, Data Modeling, and adeptly managing governance processes is essenti...
Senior Data Integration Engineer
Data Engineering: Apache Airflow and Hadoop. M raised), is seeking a Software Integrations Engineer to join their dynamic team. As a Software Integrations Engineer, you will be at the forefront of developing the next generation of. Integrate APIs, databases, and third-party services to enable seamle...
Data Engineer
Later is building out the data team and is looking for a Data Engineer to streamline the collection, transformation, and storage of data using the latest technologies in cloud computing. As a Data Engineer, you will partner with data scientists and analysts to design and implement pipelines to suppo...
Data Tester (ETL & SQL)
Strong data analysis and understanding of data mapping. A strategic partner to Fortune 500 and other top companies in financial services and many other industries, Iris provides a value-driven approach - a unique blend of highly-skilled specialists, software engineering expertise, cutting-edge techn...
Staff Data Engineer
Lead designing and implementing scalable data ingestion systems for various analytics, ML/AI solutions, and both internal and external customer facing data-centric features, which includes ingestion of structured and unstructured data, on-chain and off-chain data. We are seeking a staff data enginee...