Job Description
Data Engineer – Azure Databricks
n

nExperience: 6+ Years
nLocation: Bengaluru- Whitefield
nWork Mode: Hybrid – 3 days/week
nInterview Process: 2 Technical Round
n

nJob Summary
n

nWe are looking for an experienced Data Engineer with 6+ years of hands-on experience in building and managing scalable data engineering solutions. The ideal candidate should have robust expertise in Spark, Scala, Airflow, Hive, Kubernetes, Iceberg, and Azure Databricks .
nThe candidate should also have a good understanding of modern data platforms, cloud technologies, CI/CD practices, and the ability to leverage AI across the Software Development Lifecycle (SDLC) and Data Engineering to drive innovation and business value.
n

nKey Responsibilities
n
- n
- Design, develop, and maintain scalable and reliable data engineering pipelines.n
- Build data processing solutions using Apache Spark and Scala .n
- Develop and manage workflows using Apache Airflow .n
- Work with Hive, Iceberg, Kubernetes, and Docker in modern data platforms.n




- Develop and maintain CI/CD pipelines using GitHub Actions .n
- Design and implement data solutions using Azure Databricks .n
- Work with ADLS, Azure Data Factory (ADF), Delta Lake, Databricks Jobs and Pipelines .n
- Utilize Lakeflow Connect, Unity Catalog, and Databricks Compute (Classic & Serverless) .n
- Implement data governance, security, and access controls using Unity Catalog.n
- Optimize data pipelines and processing workloads for performance and scalability.n
- Collaborate with data scientists, architects, product teams, and other engineering teams.n
- Apply AI capabilities and tools across the SDLC and Data Engineering lifecycle to improve productivity, automation, and business outcomes.n
- Follow engineering best practices around version control, testing, deployment, monitoring, and documentation.n

n

nRequired Skills
nMust-Have – Priority 1
n
- n
- Strong hands-on experience with Apache Spark n
- Scal

📌 Senior Data Engineer (Bengaluru)
🏢 Quess IT Solutions
📍 Bengaluru