Role Description :
- Designing and developing data pipelines using Cloud Technologies based on business requirements and technical design.
- Collaborating with Stakeholders, Business Analysts and Data Architects to assist and translate business requirements to technical solutions
- Develop big data and analytic solutions leveraging new or existing technology to advance client’s all lines of business
- Exploratory data analysis by querying and processing data stores and databases and generate reports.
- Design, upgrade and implement new data workflows.
- Write and maintain technical documentation
- Executes updates, patches, and other activities required to maintain and enhance the operations of on-premise or cloud-based environments
Competencies : Data Structures
Experience (Years) : 4-6
Essential Skills :
- Experience working as Data Engineer with focus on big data processing and / or relational databases with good understanding of SQL
- Experienced with working on Structured and Semi-Structured datasets.
- Experience working with Microsoft Azure Data Platform, specifically Azure SQL Database, Azure Data Factory, ADLS storage account, Azure Data Bricks and DevOps Experienced in creating data pipelines & developing complex and optimized queries
- Experienced with Workflow Management Tools : Airflow, Crontab, CA Workload Automation
- Experience with implementing CI / CD pipeline on GitHub, Jenkins / JGP.
- Experience writing complex SQL and NoSQL jobs to analyze data in traditional DBMS (MS-SQL, Oracle) environments
- Experience with integrating to back-end / legacy environments
- Experience integrating business and technology teams
- Experienced in any of the following programming / scripting languages (SQL, Python, Shell, Scala) Excellent organizational and time management skills, strong business presence with ability to multi-task and effectively deal with competing priorities
Desirable Skills :
- Previous work experience in the financial sector (insurance or benefits industry).
- Knowledgeable or at least have the basic concept of Data Visualization in any of the following tools : Tableau, PowerBI, QlikView / QlikSense
Azure Data Architect
Demonstrating deep understanding of Azure and AWS platforms, including storage (Azure Blob Storage, AWS S3), compute (Azure VMs, AWS EC2), databases (Azure SQL Database, AWS RDS), and big data processing (Azure Databricks, AWS EMR). Knowledge of data storage and processing technologies in Azure, inc...
Data Engineer
A Data Engineer at Tactable is a professional with a deep understanding of python, data pipelines, and various types of data storage. Lead from a technical perspective and support a team of data engineers with mentoring and guidance. Proficiency with data processing frameworks such as PySpark and Pa...
Database Developer - TSQL, Azure Data Factory,ETL, Python
Transformation and Loading (ETL) processes using frameworks like Azure Data Factory or Synapse or Databricks; establishing the cloud connectivity between different system like ADLS ,ADF, Synapse, Databricks etc. Expert relational database experience, Candidate should demonstrate ability to navigate ...
Data Engineer (Azure)
In-depth knowledge of Azure services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Storage. Implement data integration patterns using Azure services such as Azure Data Factory, Azure Logic Apps, and Azure Functions. Hands on experience on designing, developing, and...
Big Data Engineer (Remote)
Big Data Engineer with Spark and Scala development experience. Familiarity with data loading tools like Talend, and Sqoop - Familiarity with cloud databases like AWS Redshift, and Aurora MySQL. Analytical and problem-solving skills applied to the Big Data domain - Strong exposure in Object Oriented ...
Lead Full Stack Data Engineer, Data Foundation, Data Platforms
Build/manage data pipelines, and common data related cross cutting concerns like data catalog, data lineage, data quality, data profiling, data discovery, metadata management. Hands on experience on building cross cutting concerns like data catalog, data lineage, data quality, data profiling, data d...
Staff Software Engineer - User Data
We're seeking a Staff Software Engineer to help lead our growing backend engineering team. Integrate data into StackAdapt’s Customer Data Platform (CDP). Our real-time advertising bidding system handles over 3,000,000 requests per second and stores several terabytes of data every day. Architect scal...
Staff Data Engineer
Lead designing and implementing scalable data ingestion systems for various analytics, ML/AI solutions, and both internal and external customer facing data-centric features, which includes ingestion of structured and unstructured data, on-chain and off-chain data. We are seeking a staff data enginee...
Lead Data Engineer, Public & Alternative Investments, Data Platforms
Strong programming skills in Python, pyspark, SQL, Java with professional programming experience in a data context is a must ( data extraction, data manipulation, joins, data analysis, data model design etc. As a Lead Data Engineer, you will be working on the Data Service Applications for Public Mar...
Sr Cloud/Network Engineer - to design, manage and deploy network cloud architectures (Azure, AWS, GCP) following agile at our large financial client - 1356146
Sr Cloud/Network Engineer - to design, manage and deploy network cloud architectures (Azure, AWS, GCP) following agile at our large financial client -. Design and deploy scalable, highly available, and secure network architectures in cloud environments (Azure, AWS, GCP). Implement and manage multi-c...