Job DescriptionData Engineer – Azure Databricks
NExperience: 6+ Years
NLocation: Bengaluru- Whitefield
NWork Mode: Hybrid – 3 days/week
NInterview Process: 2 Technical Round
NJob Summary
nWe are looking for an experienced Data Engineer with 6+ years of hands-on experience in building and managing scalable data engineering solutions. The ideal candidate should have strong expertise in Spark, Scala, Airflow, Hive, Kubernetes, Iceberg, and Azure Databricks.
NThe candidate should alsohave a good understanding of up-to-date data platforms, cloud technologies, CI/CD practices, and the ability to leverage AI across the Software Development Lifecycle (SDLC) and Data Engineering to drive innovation and business value.
NKey Responsibilities
n
- N
- Design, develop, and maintain scalable and reliable data engineering pipelines. N
- Build data processing solutions using Apache Spark and Scala. N
- Develop and manage workflows using Apache Airflow. N
- Work with Hive, Iceberg, Kubernetes, and Docker in modern data platforms. N




- Develop and maintain CI/CD pipelines using GitHub Actions. N
- Design and implement data solutions using Azure Databricks. N
- Work with ADLS, Azure Data Factory (ADF), Delta Lake, Databricks Jobs and Pipelines. N
- Utilize Lakeflow Connect, Unity Catalog, and Databricks Compute (Classic & Serverless). N
- Implement data governance, security, and access controls using Unity Catalog. N
- Optimize data pipelinesand processing workloads for performance and scalability. N
- Collaborate with data scientists, architects, product teams, and other engineering teams. N
- Apply AI capabilities and tools across the SDLC and Data Engineering lifecycle to improve productivity, automation, and business outcomes. N
- Follow engineering bestpractices around version control, testing, deployment, monitoring, and documentation. N

nRequired Skills
NMust-Have – Priority 1
N
- n
- Strong hands-on experience with Apache Spark N
- Scalan
- Ap

📌 Hiring: Senior Data Engineer (Karnataka)
🏢 Quess IT Staffing
📍 Karnataka