About the Role

We're looking for a hands-on Data Engineer who is comfortable writing production-grade SQL, designing scalable ADF pipelines, and most importantly — questioning the data itself, not just moving it. You'll work across the data platform, from ingestion through reporting, turning undocumented source data into consistent, reliable, and well-governed assets. This is not a role for someone who wants to just build pipelines and move on; we're looking for someone who takes ownership of data quality and integrity end-to-end.

Key Responsibilities

- Design, build, and optimize scalable, fault-tolerant data pipelines for ingestion and processing.
- Write and maintain complex SQL stored procedures, views, and functions following engineering standards.
- Analyze data patterns to identify inconsistencies and anomalies, and perform rigorous data validation.
- Build and enforce data quality, validation frameworks, and automated testing to ensure data integrity.
- Document data models, pipelines, and data dictionaries for both technical and business stakeholders.
- Proactively seek clarification on ambiguous requirements and exercise independent judgment on technical design.
- Contribute to and enforce engineering standards (SQL, ADF, Python, Git branching conventions).
- Conduct peer code reviews using Git-based workflows.

Must-Have Skills
- 7–14 years of experience in Data Engineering.




- Strong hands-on experience with Azure Databricks, Azure SQL Server, and Azure Data Factory (ADF).
- Solid SQL skills (T-SQL is a plus).
- Python with PySpark, DataFrames, and API integrations.
- Proven experience building and optimizing production-grade ETL/data pipelines.
- Strong analytical and problem-solving skills — ability to critically evaluate data, not just process it.
- Strong documentation and communication skills.
- Stable job history with good communication skills.

Good to Have
- CI/CD & DevOps release pipelines.
- YAML configurations.
- AI/MCP tooling with LLM workflows.
- Power BI reporting.
- Experience with Snowflake or similar cloud data warehouse platforms.

What We're Looking For (Additional Note) We want candidates who are highly analytical, technically strong, and demonstrate real ownership of data quality. You should be comfortable identifying logical inconsistencies, validating data rigorously, and uncovering insights that drive business value — not just building pipelines and moving data from point A to point B.

Skills

Data Engineering, Azure Databricks, Azure SQL Server, Azure Data Factory (ADF), SQL, T-SQL, Python, PySpark, ETL, Data Validation, Data Quality, Snowflake, CI/CD, Power BI, Git, YAMLRole & responsibilities

Preferred candidate profile

📌 Senior Data Engineer (Bengaluru)
🏢 ThoughtFocus
📍 Bengaluru