Job Title: Senior Databricks Engineer

Experience: 8+ Years

Location: Hyderabad

Employment Type: Full time

Job Summary:

We are looking for a Senior Databricks Engineer with robust experience in Data Engineering, Big Data, Cloud Analytics, and enterprise data platforms. The candidate should have hands-on expertise in Databricks, Apache Spark, PySpark, SQL, Delta Lake, and cloud platforms (Azure/AWS).

Key Skills Required:
Databricks, PySpark, Apache Spark, SQL, Delta Lake
Python, Azure Data Factory (ADF), Azure Synapse
AWS S3, Glue, Lambda
Unity Catalog, MLflow, Databricks Workflows & Job Clusters
Lakehouse Architecture, Medallion Architecture
Data Modeling, ETL/ELT Pipelines, Performance Optimization
CI/CD, GitHub/GitLab, DevOps Practices
Data Governance, Data Quality, Power BI/Tableau

Responsibilities:
Design and develop scalable data engineering solutions using Databricks, Spark, and Delta Lake.
Lead end-to-end data projects from requirement gathering to deployment and production support.




Work closely with clients, architects, and business stakeholders to deliver solutions.
Design and optimize Lakehouse architectures and high-performance ETL pipelines.
Implement data governance, security, monitoring, and performance optimization.
Mentor and guide data engineering teams through technical leadership and code reviews.

Required Experience:
8+ years of experience in Data Engineering and Big Data technologies.
5+ years of hands-on experience with Databricks, Spark, PySpark, and SQL.
Experience with Azure/AWS cloud data platforms and enterprise-scale data solutions.
Robust understanding of Spark optimization, Delta Lake, data architecture, and CI/CD practices.
Excellent communication and stakeholder management skills.

Education:

Bachelors/Master’s degree in Computer Science, Engineering, IT, or related field.

📌 Senior Databricks Engineer/architect Hyderabad
🏢 Databeat
📍 Hyderabad