Job Title : Lead Data Engineer

Experience : 8 - 12 Years

Location : Hyderabad, Telangana, India

Industry : IT Services &

- Consulting

Role Overview :

We are hiring a Lead Data Engineer to design, develop, and optimize scalable cloud data platforms and up-to-date ETL/ELT pipelines using Microsoft Fabric, Databricks, or Snowflake. In this role, you will lead the architecture, construction, and maintenance of data lakehouse and data warehouse solutions, build high-performance data pipelines, enable business analytics, and establish data engineering best practices.

Key Responsibilities :

Architecture &

- Pipeline Design :
- Design, build, and optimize scalable batch and real-time ETL/ELT pipelines, data models, and lakehouse/data warehouse architectures using Microsoft Fabric, Databricks, or Snowflake.

High-Performance Data Processing :

- Develop robust data processing, cleansing, and transformation solutions using PySpark, Python, Scala, and SQL for large and complex datasets.

Analytics &

- Visualization Support :
- Support business intelligence and self-service analytics by enabling robust data models for Power BI and other visualization tools.

Technical Leadership &

- Governance :




- Establish coding standards, reusable frameworks, and data engineering best practices while conducting code reviews and driving CI/CD practices.

Quality &

- Reliability :
- Implement data quality, governance, security, access control, and monitoring while resolving complex production and performance bottlenecks.

Required Qualifications &

Skills :

Education &

Experience :

- Bachelor's/Master's degree in Computer Science, IT, Engineering, or a related field with 6 - 10 years of core data engineering experience.

Primary Platforms (at least one) :

- Microsoft Fabric : Data Factory, Lakehouse, Data Warehouse
- Databricks : Spark, Delta Lake, PySpark, MLflow
- Snowflake : Data Warehousing, Snowpipe, Performance Optimization
- Power BI : Data Modeling, DAX, Report Development

Core Technical Expertise :

- Exceptional skills in SQL, Python/Scala, PySpark/Apache Spark, and cloud data services (Azure, AWS, or GCP).

Engineering Standards :

- Deep expertise in data modeling, ETL/ELT concepts, CI/CD, Git, and DevOps workflows.

📌 Lead Data Engineer (India)
🏢 Thinkwise Consulting
📍 India