Must Have:
- Design, develop, and maintain scalable ETL/ELT pipelines using Azure Databricks.
- Build and optimize data processing solutions using PySpark, Spark SQL, and Delta Lake.
- Develop data ingestion frameworks from multiple sources including APIs, databases, flat files, and streaming platforms.
- Implement and manage data workflows using Azure Data Factory (ADF).
- Design and maintain data lakes and data warehouses on Azure.
- Optimize Spark jobs for performance, scalability, and cost efficiency.
- Collaborate with business stakeholders, architects, and analytics teams to understand data requirements.
- Implement data quality, governance, monitoring, and security standards.
- Develop CI/CD pipelines using Azure DevOps or GitHub Actions.
- Troubleshoot production issues and provide performance tuning recommendations.
- Mentor junior data engineers and participate in code reviews.
📌 Data Engineer (Gurugram)
🏢 Tata Consultancy Services
📍 Gurugram
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.