Your newpany
Our client is a leading Consulting firm looking to hire Azure Data Engineer for 1-year contract with potential for extension.
Your new role
- Design, develop, and maintain data pipelines using Azure Data Factory, incorporating XML and JSON data formats for data exchange and transformation.
- Implement and manage data storage solutions, including Azure Data Lake, ensuring the proper handling and optimization of XML and JSON data structures.
- Utilize Azure Databricks for processing and transforming large datasets, with a focus on parsing and manipulating XML and JSON data.
- Integrate external data sources and services using APIs, with a strong emphasis on XML and JSON data interchange formats.
- Ensure data quality and integrity by implementing validation checks and error-handling routines for XML and JSON data.
- Collaborate with stakeholdersto define data requirements and exchange formats, providing expertise in XML and JSON schemas.
- Develop documentation and mapping specifications for XML and JSON data integrations.
- Stay current with best practices for managing and processing XML and JSON data within Azure data services.
What you'll need to succeed
- Bachelor's degree inputer Science, Information Technology, or a related field.
- Minimum of 3 years of experience with Azure data services, including Azure Data Factory, Azure Data Lake, and Databricks.
- Proficient in working with XML and JSON data formats, including schema definition and data transformation.
- Strong knowledge of data modeling, data warehousing, and data lake concepts.
- Experience with programming languages such as SQL, Python, or Scala for data manipulation and analysis.
- Familiarity with APIdevelopment and management, particularly with XML and JSON data exchange.
- Understanding of dataernance, security, andpliance standards.
- Excellent analytical and problem-solving abilities.
- Effectivemunication skills for interacting with technical and non-technical stakeholders. Certifications in Azure Data Engineering or related fields.
Experience with additional cloud platforms like AWS or GCP. Knowledge of additional data interchange formats (e.g., YAML, CSV).
Familiarity with CI / CD pipelines and version control systems like Git.
Staff Software Engineer - Data Platform
This is where our Data Storage Platform team fits in, offering scalable storage systems (Postgresql, OpenSearch, Redis, Kafka, RocksDB), as well as building services and tools to improve their operational excellence, offering expertise to R&D teams around usage of data storage systems at high sc...
Google Cloud Platform - Data Engineer | NT1025A2
You will be responsible for designing, implementing, and optimizing data pipelines, working with both structured and unstructured data, and driving data integration solutions that power critical business insights. Chance to work with advanced data platforms and cutting-edge cloud technologies, contr...
Azure Data Engineer - Big Data Processing, Azure SQL Database
Experience working with Microsoft Azure Data Platform, specifically Azure SQL Database, Azure Data Factory, ADLS storage account, Azure Data Bricks and DevOps Experienced in creating data pipelines & developing complex and optimized queries. Experience working as Data Engineer with focus on big ...
Azure Data Engineer Lead
As Azure Data Engineer Lead, you will handle end-to-end solutions, architecture design, and documentation for large scale data implementations (related to big data and data warehousing). DatabricksAzure Data Factory (ADF) Hadoop SQL Server (SSIS) Azure Synapse . Senior/Lead Azure Data Engineer (7+ y...
Data Engineer (Azure)
In-depth knowledge of Azure services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Storage. Implement data integration patterns using Azure services such as Azure Data Factory, Azure Logic Apps, and Azure Functions. Hands on experience on designing, developing, and...
Azure Data Engineer
Hands on with Data factory, Data lakes and Databricks applications. Its consulting-led, cognitive powered portfolio of business, technology, and engineering services and solutions is delivered through its unique Location Independent Agile™ delivery model, recognized as a benchmark of excellence in s...
Senior Azure Data Engineer
Overall experience includes about 5+ years of experience in 1) data project development experience, Azure Data Engineer with hands-on experience in Azure Synapse, Databricks, SQL data warehouse and data visualization models 2) ETL experience in data warehousing concepts - data extraction, transforma...
Google Cloud Platform - Data Engineer | NT1025A2
You will be responsible for designing, implementing, and optimizing data pipelines, working with both structured and unstructured data, and driving data integration solutions that power critical business insights. Chance to work with advanced data platforms and cutting-edge cloud technologies, contr...
Senior Consultant - Azure Data Engineer
At least 4 years of experience in designing, implementing, and maintaining robust and scalable data pipelines on Azure using services such as Azure Data Factory, Azure SQL Data Warehouse, Azure Analysis Services or any of the Azure Databricks/Synapse/Fabric. Ability to implement and manage CI/CD pip...
Senior Software Engineer - Data Platform
As a Software Engineer in Opendata, you will be responsible for the new Data Platform implementation. You will be designing and building scalable distributed cloud platform and tools that enable Opendata teams to build and deliver our data assets. Lead the technical design, end-to-end architecture d...