Required Skills & Experience

Must have 6 to 10 yrs of IT experience and at least 6 years of hands-on experience in Databricks.
Design and develop scalable data pipelines using Azure Databricks, Python, PySpark, and Delta Lake.
Have a positive understanding of RDBMS and proficiency in writing complex SQL.
Implement ETL/ELT workflows for structured, semi-structured, and unstructured data.
Optimise performance of data processing and ensure data quality standards.
Work with Azure Data Lake, Unity Catalogue, and integrate with CI/CD pipelines.
Experience with orchestration tools like Airflow or Azure Data Factory is a plus.
Have working experience on a migration project.

Preferred Skills

• Experience with orchestration tools such as Apache Airflow or Azure Data Factory.
• Knowledge of CI/CD pipelines and automated data deployments.




• Experience working with big data technologies and cloud data platforms.
• Strong analytical and problem-solving skills.
• Experience working in Agile or DevOps environments.

Relevant Experience Preferred

• Hands-on experience developing data pipelines using Azure Databricks and PySpark .
• Experience implementing ETL/ELT solutions for enterprise data platforms.
• Experience optimising data processing performance and data workflows.
• Experience working with Azure Data Lake and cloud-based data architectures.
• Experience working on data migration or modernisation projects.
• Experience integrating data pipelines with CI/CD workflows.

📌 Data Engineer (Hyderabad)
🏢 Kumaran Systems
📍 Hyderabad