13 Nov
|
Nemetschek India
|
India
13 Nov
Nemetschek India
India
Job Description
Key Responsibilities
- Design and maintain ELT pipelines using Dataform, SQLX, and Big Query.
- Implement Bronze, Silver, and Gold data layers and dimensional data models.
- Develop incremental models, reusable Java Script functions, assertions, and workflow configurations in Dataform.
- Optimize Big Query SQL, partitioning, clustering, query performance, and compute and storage costs.
- Build and maintain CDC pipelines using Datastream, including handling updates, deletes, and schema evolution.
- Manage GCP infrastructure using Terraform, including Big Query datasets, Datastream, IAM, and service accounts.
- Implement Git Hub-based CI/CD, pull requests, code reviews, and automated Dataform validation.
- Ensure data quality, security, governance, and pipeline monitoring.
- Troubleshoot production failures, perform root-cause analysis, and implement preventive measures.
- Collaborate with BI teams and business stakeholders to deliver reliable, analytics-ready data.
Required Skills
- 6–10 years of experience in Data Engineering.
- Solid hands-on experience with GCP and Big Query.
- Production experience with Dataform, SQLX, incremental processing, assertions, and dependency management.
- Advanced SQL skills, including window functions, MERGE, ARRAY, STRUCT, UNNEST, and deduplication.
- Experience with Big Query architecture, dimensional modeling, and cost optimization.
- Working knowledge of Datastream and CDC concepts.
- Experience with Terraform, Git Hub, and CI/CD practices.
- Strong troubleshooting, problem-solving, and communication skills.
Additional Information
#Nemetschek India #LI-Hybrid #LI-SR2
📌 Data Engineer (India)
🏢 Nemetschek India
📍 India