Job Description
- n
- Design, develop, and maintain scalable ETL/ELT data pipelines using PySpark.n
- Process and transform large datasets from various structured and unstructured sources.n
- Build robust data workflows and optimize Spark jobs for performance and scalability.n
- Develop and maintain data models, data lakes, and data warehouse solutions.n
- Collaborate with Data Scientists, Analysts, and Business Teams to understand data requirements.n
- Ensure data quality, integrity, security, and governance standards are maintained.n
- Troubleshoot and resolve performance bottlenecks in Spark applications.n
- Monitor data pipelines and automate operational processes.n
- Implement CI/CD practices for data engineering workflows.n
- Create and maintain technical documentation for data pipelines and processes.n
n
📌 Pyspark Data Engineer (Pune)
🏢 Tata Consultancy Services
📍 Pune
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.