Job Description
Data Engineer – Azure Databricks
n

nExperience: 6+ Years
nLocation: Bengaluru- Whitefield
nWork Mode: Hybrid – 3 days/week
nInterview Process: 2 Technical Round
n

nJob Summary
n

nWe are looking for an experienced Data Engineer with 6+ years of hands-on experience in building and managing scalable data engineering solutions. The ideal candidate should have strong expertise in Spark, Scala, Airflow, Hive, Kubernetes, Iceberg, and Azure Databricks.
nThe candidate should also have a good understanding of modern data platforms, cloud technologies, CI/CD practices, and the ability to leverage AI across the Software Development Lifecycle (SDLC) and Data Engineering to drive innovation and business value.
n

nKey Responsibilities
n
- n
- Design, develop, and maintain scalable and reliable data engineering pipelines.n
- Build data processing solutions using Apache Spark and Scala.n
- Develop and manage workflows using Apache Airflow.n
- Work with Hive, Iceberg, Kubernetes, and Docker in modern data platforms.n




- Develop and maintain CI/CD pipelines using GitHub Actions.n
- Design and implement data solutions using Azure Databricks.n
- Work with ADLS, Azure Data Factory (ADF), Delta Lake, Databricks Jobs and Pipelines.n
- Utilize Lakeflow Connect, Unity Catalog, and Databricks Compute (Classic & Serverless).n
- Implement data governance, security, and access controls using Unity Catalog.n
- Optimize data pipelines and processing workloads for performance and scalability.n
- Collaborate with data scientists, architects, product teams, and other engineering teams.n
- Apply AI capabilities and tools across the SDLC and Data Engineering lifecycle to improve productivity, automation, and business outcomes.n
- Follow engineering best practices around version control, testing, deployment, monitoring, and documentation.n

n

nRequired Skills
nMust-Have – Priority 1
n
- n
- Solid hands-on experience with Apache Sparkn
- Scalan
- Ap

📌 Senior Data Engineer (Bengaluru)
🏢 Quess IT Staffing
📍 Bengaluru