Job Summary
Job Description: Senior Data Engineer
Role: Senior Data Engineer
Experience: 7–10+ Years
Location: India
Employment Type: Full-time
Role Overview
We are looking for an experienced Senior Data Engineer to design, build, and optimize scalable data platforms and pipelines. The ideal candidate will have strong expertise in Python, SQL, Snowflake, dbt, ETL/ELT, and cloud-based data engineering, with hands-on experience working with large and complex datasets.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines.
- Build and optimize data models and transformations using dbt.
- Develop and maintain enterprise data solutions on Snowflake.
- Write complex and highly optimized SQL queries.
- Develop data-processing and automation solutions using Python.
- Integrate data from APIs, databases, SaaS platforms, and other enterprise sources.
- Implement data quality checks, monitoring, reconciliation, and error-handling frameworks.
- Optimize pipeline performance, Snowflake queries, storage, and compute utilization.
- Work with business analysts, architects, data scientists, and application teams to translate requirements into scalable data solutions.
- Implement engineering best practices including Git, CI/CD, code reviews, testing, and documentation.
- Troubleshoot production data issues and perform root-cause analysis.
- Mentor junior data engineers and contribute to technical design and architecture discussions.
Mandatory Technical Skills
- 7+ years of experience in Data Engineering / Data Warehousing.
- Advanced SQL and strong hands-on Python experience.
- Strong experience with Snowflake.
- Hands-on experience with dbt for data transformation and modeling.
- Strong understanding of ETL/ELT, data warehousing, dimensional modeling, and data lake concepts.
- Experience with at least one major cloud platform: Azure, AWS, or GCP.
- Experience with orchestration tools such as Azure Data Factory, Apache Airflow, or similar.
- Good knowledge of Git and CI/CD.
- Experience handling high-volume datasets and performance optimization.
Good to Have
- Databricks / Apache Spark / PySpark
- Kafka or other event-streaming technologies
- Azure Data Lake / AWS S3
- Power BI or similar reporting platforms
- Snowflake performance and cost optimization
- Data governance and security concepts
- Agile/Scrum delivery experience
Key Responsibilities
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines.
- Build and optimize data models and transformations using dbt.
- Develop and maintain enterprise data solutions on Snowflake.
- Write complex and highly optimized SQL queries.
- Develop data-processing and automation solutions using Python.
- Integrate data from APIs, databases, SaaS platforms, and other enterprise sources.
- Implement data quality checks, monitoring, reconciliation, and error-handling frameworks.
- Optimize pipeline performance, Snowflake queries, storage, and compute utilization.
- Work with business analysts, architects, data scientists, and application teams to translate requirements into scalable data solutions.
- Implement engineering best practices including Git, CI/CD, code reviews, testing, and documentation.
- Troubleshoot production data issues and perform root-cause analysis.
- Mentor junior data engineers and contribute to technical design and architecture discussions.
Skill Requirements
Mandatory Technical Skills
- 7+ years of experience in Data Engineering / Data Warehousing.
- Advanced SQL and strong hands-on Python experience.
- Strong experience with Snowflake.
- Hands-on experience with dbt for data transformation and modeling.
- Solid understanding of ETL/ELT, data warehousing, dimensional modeling, and data lake concepts.
- Experience with at least one major cloud platform: Azure, AWS, or GCP.
- Experience with orchestration tools such as Azure Data Factory, Apache Airflow, or similar.
- Good knowledge of Git and CI/CD.
- Experience handling high-volume datasets and performance optimization.
Must Have Skill
Azure Database for MySQL,Azure Databricks,Data Build Tool (DBT),Snowflake
Good to Have Skill
Other Requirements
📌 Senior Technical Lead (India)
🏢 HCLTech
📍 India