- Design, develop, and maintain scalable data engineering solutions using Azure Databricks.
- Build and optimize ETL/ELT pipelines using PySpark and Spark SQL.
- Develop data ingestion frameworks from multiple data sources including databases, APIs, flat files, and streaming platforms.
- Implement Delta Lake architecture for reliable and high-performance data processing.
- Integrate Azure Databricks with Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake Storage.
- Develop batch and real-time data processing solutions.
- Perform data modeling, transformation, and cleansing activities.
- Optimize Databricks workloads for performance, scalability, and cost efficiency.
- Implement CI/CD pipelines and DevOps best practices for data engineering projects.
- Collaborate with business stakeholders, data architects, and analytics teams to understand requirements.
- Troubleshoot production issues and ensure data quality and reliability.
- Create technical documentation and knowledge transfer materials.
📌 Azure Data Bricks Jr Developer (Gurugram)
🏢 Tata Consultancy Services
📍 Gurugram
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.