08 Sep
|
Employ
|
Hyderabad
Job Title: Data Engineer – Databricks
nLocation: Bangalore/ Pune/Hyderabad
n
nJob Summary:
nWe are looking for a Data Engineer with strong experience in Databricks, Airflow, Python, and SQL to build and maintain scalable data pipelines and data processing solutions. The ideal candidate will have expertise in ETL/ELT development, workflow orchestration, data modeling, and performance optimization.
n
nKey Responsibilities:
n• Develop and optimize data pipelines using Databricks, Python, and SQL.
n• Design and manage workflow orchestration using Apache Airflow.
n• Build scalable ETL/ELT processes for data ingestion and transformation.
n• Monitor, troubleshoot, and improve data pipeline performance.
n• Implement data quality checks and validation frameworks.
n• Collaborate with cross-functional teams to deliver data-driven solutions.
n
nRequired Skills:
n• Robust hands-on experience with Databricks and PySpark.
n• Expertise in Apache Airflow DAG development and orchestration.
n• Proficiency in Python and advanced SQL.
n• Experience with data warehousing and cloud-based data platforms.
n• Knowledge of performance tuning, data modeling, and ETL best practices.
nPreferred Skills:
n• Experience with AWS, Azure, or GCP.
n• Familiarity with Delta Lake, CI/CD, and Agile methodologies.
n
nExperience:
n6-10 Years experience
n
nInterested candidates please apply using this link- https://app.employlabs.ai/apply/nrtwSkXHo9
📌 Data Engineer (Hyderabad)
🏢 Employ
📍 Hyderabad