We are looking for a skilled Databricks Data Engineer with solid expertise in Databricks, Python, and PySpark to build and maintain scalable data pipelines, data lakes, and cloud-based analytics solutions. The ideal candidate should have experience in big data processing, ETL/ELT development, data warehousing, and cloud-native data platforms.
Roles & Responsibilities-
- Design, develop, and optimize data pipelines using Databricks and PySpark.
- Build scalable ETL/ELT solutions for structured and unstructured data.
- Develop data transformation workflows using Python and Spark.
- Work with large datasets in Data Lakes and Data Warehouses.
- Optimize Databricks jobs and Spark performance.
- Implement Delta Lake architecture and data governance practices.
- Integrate data from multiple sources and enterprise applications.
- Develop and maintain CI/CD pipelines for data engineering projects.
- Collaborate with Data Scientists, Analysts, and Business stakeholders.
Mandatory Skills - Databricks | Python | PySpark | SQL | Spark SQL | Delta Lake | ETL/ELT | Data Warehousing | Azure Data Factory | GitHub | CI/CD | Azure DevOps | Data Modeling.