15 Sep
|
Employ
|
Hyderabad
Job DescriptionJob Title: Data Engineer – Databricks
nLocation: Bangalore/ Pune/Hyderabad
nJob Summary:
nWe are looking for a Data Engineer with solid experience in Databricks, Airflow, Python, and SQL to build and maintain scalable data pipelines and data processing solutions. The ideal candidate will have expertise in ETL/ELT development, workflow orchestration, data modeling, and performance optimization.
nKey Responsibilities:
n
n
Develop and optimize data pipelines using Databricks, Python, and SQL.n
Design and manage workflow orchestration using Apache Airflow.n
Build scalable ETL/ELT processes for data ingestion and transformation.n
Monitor, troubleshoot, and improve data pipeline performance.n
Implement data quality checks and validation frameworks.n
Collaborate with cross-functional teams to deliver data-driven solutions.n
nRequired Skills:
n
n
Solid hands-on experience with Databricks and PySpark.n
Expertise in Apache Airflow DAG development and orchestration.n
Proficiency in Python and advanced SQL.n
Experience with data warehousing and cloud-based data platforms.n
Knowledge of performance tuning, data modeling, and ETL best practices.n
nPreferred Skills:
n
n
Experience with AWS, Azure, or GCP.n
Familiarity with Delta Lake, CI/CD, and Agile methodologies.n
nExperience:
n6-10 Years experience
nInterested candidates please apply using this link-
📌 Data Engineer Hyderabad
🏢 Employ
📍 Hyderabad