Job DescriptionData Engineer – Azure Databricks
NExperience: 6+ Years
NLocation: Bengaluru- Whitefield
NWork Mode: Hybrid – 3 days/week
NInterview Process: 2 Technical Round
NJob Summary
nWe are looking for an experienced Data Engineer with 6+ years of hands-on experience in building and managing scalable data engineering solutions. The ideal candidate should have solid expertise in Spark, Scala, Airflow, Hive, Kubernetes, Iceberg, and Azure Databricks.
NThe candidate should alsohave a good understanding of up-to-date data platforms, cloud technologies, CI/CD practices, and the ability to leverage AI across the Software Development Lifecycle (SDLC) and Data Engineering to drive innovation and business value.
NKey Responsibilities
n
N
Design, develop, and maintain scalable and reliable data engineering pipelines. N
Build data processing solutions using Apache Spark and Scala. N
Develop and manage workflows using Apache Airflow. N
Work with Hive, Iceberg, Kubernetes, and Docker in up-to-date data platforms. N




Develop and maintain CI/CD pipelines using GitHub Actions. N
Design and implement data solutions using Azure Databricks. N
Work with ADLS, Azure Data Factory (ADF), Delta Lake, Databricks Jobs and Pipelines. N
Utilize Lakeflow Connect, Unity Catalog, and Databricks Compute (Classic & Serverless). N
Implement data governance, security, and access controls using Unity Catalog. N
Optimize data pipelinesand processing workloads for performance and scalability. N
Collaborate with data scientists, architects, product teams, and other engineering teams. N
Apply AI capabilities and tools across the SDLC and Data Engineering lifecycle to improve productivity, automation, and business outcomes. N
Follow engineering bestpractices around version control, testing, deployment, monitoring, and documentation. N

nRequired Skills
NMust-Have – Priority 1
N
n
Strong hands-on experience with Apache Spark N
Scalan
Ap

📌 Hiring: Senior Data Engineer Karnataka (India)
🏢 Quess IT Staffing
📍 India