16 Sep
|
Aspire, Jordan
|
India
16 Sep
Aspire, Jordan
India
Job Description
Data Engineer – Databricks
n
Job Overview
n
We are looking for an experienced Data Engineer with strong expertise in Databricks to design, develop, and optimize scalable data pipelines and modern data platforms.
n
The ideal candidate will have hands-on experience with big data technologies, cloud platforms, and ETL/ELT processes , with a strong focus on building reliable, high-quality data solutions that support analytics and business intelligence initiatives.
n
The Data Engineer will collaborate closely with Data Analysts, Data Scientists, Software Engineers, and business stakeholders to understand requirements and deliver scalable, productive, and well-governed data solutions.
n
Key Responsibilities
n
n
- Design, develop, and maintain scalable data pipelines using Databricks .
n
- Build and optimize ETL/ELT workflows for structured and unstructured data.
n
- Develop and manage data ingestion processes from multiple data sources.
n
- Process and analyze large-scale datasets using Apache Spark and PySpark .
n
- Design and maintain data models to support analytics and reporting.
n
- Optimize data pipeline performance and ensure data accuracy and quality.
n
- Collaborate with business and technical stakeholders to understand and translate data requirements.
n
- Implement data governance, security, and engineering best practices.
n
- Monitor, troubleshoot, and enhance existing data pipelines and data workflows.
n
- Document technical designs, processes, and data engineering standards.
n
- Contribute to the continuous improvement of data architecture and engineering practices.
n
n
n
Required Qualifications & Skills
n
n
- Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field .
n
- 5–7 years of experience in Data Engineering or a similar role.
n
- Strong hands-on experience with Databricks .
n
- Strong proficiency in Apache Spark and PySpark .
n
- Strong SQL skills and experience working with relational databases.
n
- Hands-on experience developing ETL/ELT data pipelines .
n
- Experience with at least one major cloud platform: Azure, AWS, or GCP .
n
- Solid understanding of data warehousing concepts and dimensional modeling .
n
- Experience with version control systems such as Git .
n
- Strong analytical, troubleshooting, and problem-solving skills.
n
- Excellent communication and collaboration skills.
n
n
Preferred Skills
n
n
- Experience with Delta Lake and Lakehouse architecture .
n
- Familiarity with AWS Glue or equivalent cloud data services.
n
- Experience with orchestration tools such as Apache Airflow .
n
- Knowledge of CI/CD practices for data engineering.
n
- Experience implementing data quality, governance, and monitoring solutions.
n
- Databricks or cloud platform certifications are a plus.
n
n
n
Experience Requirements
n
n
- 5–7 years of relevant Data Engineering experience.
n
- 2–3+ years of hands-on Databricks experience preferred .
n
- Proven experience building and optimizing production-grade data pipelines.
n
n
📌 Senior Data Engineer - Databricks (India)
🏢 Aspire, Jordan
📍 India