10 Sep
|
Employ
|
Hyderabad
Job Description
Job Title: Data Engineer – Databricks
n
Location: Bangalore/ Pune/Hyderabad
n
n
Job Summary:
n
We are looking for a Data Engineer with solid experience in Databricks, Airflow, Python, and SQL to build and maintain scalable data pipelines and data processing solutions. The ideal candidate will have expertise in ETL/ELT development, workflow orchestration, data modeling, and performance optimization.
n
n
Key Responsibilities:
n
• Develop and optimize data pipelines using Databricks, Python, and SQL.
n
• Design and manage workflow orchestration using Apache Airflow.
n
• Build scalable ETL/ELT processes for data ingestion and transformation.
n
• Monitor, troubleshoot, and improve data pipeline performance.
n
• Implement data quality checks and validation frameworks.
n
• Collaborate with cross-functional teams to deliver data-driven solutions.
n
n
Required Skills:
n
• Strong hands-on experience with Databricks and PySpark.
n
• Expertise in Apache Airflow DAG development and orchestration.
n
• Proficiency in Python and advanced SQL.
n
• Experience with data warehousing and cloud-based data platforms.
n
• Knowledge of performance tuning, data modeling, and ETL best practices.
n
Preferred Skills:
n
• Experience with AWS, Azure, or GCP.
n
• Familiarity with Delta Lake, CI/CD, and Agile methodologies.
n
n
Experience:
n
6-10 Years experience
n
n
Interested candidates please apply using this link- https://app.employlabs.ai/apply/nrtwSkXHo9
📌 Data Engineer (Hyderabad)
🏢 Employ
📍 Hyderabad