Remote: Hybrid

Data Engineer – Azure DatabricksExperience:6+ YearsLocation:Bengaluru- WhitefieldWork Mode:Hybrid – 3 days/weekInterview Process:2 Technical RoundJob SummaryWe are looking for an experiencedData Engineerwith 6+ years of hands-on experience in building and managing scalable data engineering solutions. The ideal candidate should have strong expertise inSpark, Scala, Airflow, Hive, Kubernetes, Iceberg, and Azure Databricks .The candidate should also have a good understanding of modern data platforms, cloud technologies, CI/CD practices, and the ability to leverageAI across the Software Development Lifecycle (SDLC) and Data Engineeringto drive innovation and business value.Key ResponsibilitiesDesign, develop, and maintain scalable and reliable data engineering pipelines.Build data processing solutions usingApache Spark and Scala .Develop and manage workflows usingApache Airflow .Work withHive, Iceberg, Kubernetes, and Dockerin modern data platforms.Develop and maintain CI/CD pipelines usingGitHub Actions .Design and implement data solutions usingAzure Databricks .Work withADLS, Azure Data Factory (ADF), Delta Lake, Databricks Jobs and Pipelines .UtilizeLakeflow Connect, Unity Catalog, and Databricks Compute (Classic & Serverless) .Implement data governance, security, and access controls using Unity Catalog.Optimize data pipelines and processing workloads for performance and scalability.Collaborate with data scientists, architects, product teams,



and other engineering teams.Apply AI capabilities and tools across the SDLC and Data Engineering lifecycle to improve productivity, automation, and business outcomes.Follow engineering best practices around version control, testing, deployment, monitoring, and documentation.Required SkillsMust-Have – Priority 1Strong hands-on experience withApache SparkScalaApache AirflowHiveKubernetesApache IcebergGood knowledge ofDockerGood experience withGitHub Actions / CI-CDMust-Have – Priority 2Strong experience withAzure DatabricksADLSDatabricks Jobs & PipelinesAzure Data Factory (ADF)Delta LakeLakeflow ConnectUnity CatalogDatabricks Compute –Classic & ServerlessMust-Have – Priority 3Experience usingAI tools/capabilities within SDLC and Data EngineeringAbility to identify opportunities to use AI for automation, development, optimization, and innovationStrong problem-solving and analytical skillsAdditional Requirements6+ years of relevant experience in Data Engineering.Strong understanding of data engineering concepts and distributed data processing.Excellent communication and collaboration skills.Candidates must be based in or willing to relocate toBengaluru .Candidates should be comfortable working from the officeWillingness to attend2 technical interview rounds .Preferred Candidate ProfileCandidates with robust hands-on experience acrossSpark/Scala/Airflowand theAzure Databricks ecosystemwill be given priority. Experience in modern data lakehouse technologies, containerization, CI/CD, and practical application of AI in engineering environments will be an added advantage.

📌 Senior Data Engineer (Mumbai)
🏢 Quess IT Staffing
📍 Mumbai