Job Description
We are looking for a seasoned Data Platform Engineer with extensive experience in building and managing robust data platforms and pipelines.
The ideal candidate will have a deep understanding of data warehousing and cloud technologies, particularly within the Google Cloud Platform (GCP) ecosystem.
You will be responsible for designing, implementing, and optimizing data pipelines, working with both structured and unstructured data, and driving data integration solutions that power critical business insights.
This role involves collaborating with cross-functional teams to develop scalable and efficient data platforms that leverage the full suite of GCP services.
Requirements
- 10+ years of experience working with Data Warehousing and Data Platforms .
- 5+ years of experience in building ELT data pipelines from scratch, handling structured, semi-structured , and unstructured data , and working with SQL .
- Proficiency in building data pipelines using GCP Services such as Dataproc, BigQuery, Cloud Spanner, Cloud Run functions, Dataflow, Pub / Sub .
- 2+ years of experience configuring and utilizing data ingestion tools such as DBT, Qlik, Airbyte , or similar.
- 5+ years of experience working with Google Cloud Platform (GCP) .
- Strong background in data development, data engineering, programming , and managing ETL / ELT processes for data integration.
- 5+ years of experience with CI / CD pipelines and working with source control systems such as GitHub, Bitbucket , and Infrastructure as Code tools like Terraform .
- Excellent problem-solving skills, with a focus on delivering scalable and efficient data solutions.
- Strong interpersonal and communication skills, with the ability to work in cross-functional teams.
Benefits
This role offers both full-time and contract opportunities, allowing flexibility in work arrangements. Chance to work with advanced data platforms and cutting-edge cloud technologies, contributing to the success of a data-driven organization.
Requirements
5+ years of experience with Google Cloud Platform (GCP) and related services such as Google Cloud Storage. 5+ years of experience using Infrastructure as Code (IaC) tools like Terraform.
Proficiency in development languages such as Go and Python, with a minimum of 5+ years of experience. Extensive experience in working with container-based technologies like Docker and Kubernetes.
Strong background in using CI / CD tools to support continuous development and deployment processes. In-depth knowledge of various database technologies, including CloudSQL, NoSQL, and Relational databases.
Solid understanding of the software development lifecycle and the release process, especially within a container-native workflow.
5+ years of experience with configuration management tools and scripting languages such as Ansible, Bash, and Groovy. Excellent communication skills, both oral and written.
Demonstrated ability to manage teams and work collaboratively across departments. A Google Cloud Architect certification is a strong plus.