- Design, develop, and maintain scalable ETL/ELT data pipelines using PySpark.
- Process and transform large datasets from various structured and unstructured sources.
- Build robust data workflows and optimize Spark jobs for performance and scalability.
- Develop and maintain data models, data lakes, and data warehouse solutions.
- Collaborate with Data Scientists, Analysts, and Business Teams to understand data requirements.
- Ensure data quality, integrity, security, and governance standards are maintained.
- Troubleshoot and resolve performance bottlenecks in Spark applications.
- Monitor data pipelines and automate operational processes.
- Implement CI/CD practices for data engineering workflows.
- Create and maintain technical documentation for data pipelines and processes.
📌 Pyspark Data Engineer (Pune)
🏢 Tata Consultancy Services
📍 Pune
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.