We are looking for an experienced Data Engineer with strong hands-on expertise in Databricks and up-to-date data engineering platforms. The candidate will be responsible for designing, developing and maintaining scalable data pipelines, implementing ETL/ELT processes and optimising data platforms for efficient data processing.
Responsibilities
- Design, develop and maintain scalable data pipelines using Databricks.
- Develop data processing solutions using Python, PySpark and SQL.
- Build and optimise ETL/ELT pipelines for data ingestion and transformation.
- Work with Delta Lake and Lakehouse architecture.
- Develop and manage data workflows using Databricks Workflows.
- Perform data modelling, data transformation and data integration.
- Ensure data quality, consistency, security and governance.
- Monitor, troubleshoot and optimise data pipelines.
- Collaborate with data architects, analysts and cross-functional engineering teams.
- Implement CI/CD practices for data engineering workflows.
Required Qualifications and Skills
- 5+ years of overall experience in Data Engineering.
- Strong hands-on experience with Databricks.
- Proficiency in Python, PySpark and SQL.
- Strong understanding of Apache Spark and distributed data processing.
- Experience with Delta Lake and Lakehouse architecture.
- Hands-on experience in developing ETL/ELT pipelines.
- Knowledge of data warehousing and data modelling concepts.
- Experience with cloud platforms such as Azure, AWS or GCP.
- Understanding of data governance and data quality practices.
Preferred Skills
- Experience with Databricks Unity Catalog.
- Knowledge of Delta Live Tables (DLT).
- Experience with Azure Data Factory, Apache Airflow or similar orchestration tools.
- Familiarity with Git, CI/CD and DevOps practices.
- Experience with real-time data processing and streaming technologies.
Interview Process
- Online interview.
- Technical evaluation followed by further discussion.
Application Requirements Interested candidates are requested to apply with their updated resumes and mention their current CTC, expected CTC and notice period.
Pay: From ₹1,000,000.00 per year
Work Location: In person
📌 Data Engineer: Data Platforms (Databricks) (Bengaluru)
🏢 SB Infowaves
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.