07 Sep
|
Tata Consultancy Services
|
Pune
07 Sep
Tata Consultancy Services
Pune
Job Description
Job Title: Data Engineer | Python | Azure | PySpark | Databricks | PostgreSQL/MongoDB
nLocation: Pune, Bengaluru, NCR, Kolkata
nExperience: 6 to 12 Years
n
nJob Summary
nWe are seeking a skilled Data Engineer with expertise in Python, Azure, PySpark, and Databricks to design, develop, and maintain scalable data processing solutions. The ideal candidate will be responsible for building data transformation pipelines, handling large datasets, implementing complex calculation engines, and collaborating with engineering teams to deliver high-quality data solutions.
n
nKey Responsibilities
n
- n
- Design, develop, and maintain data transformation pipelines using Azure services such as Azure Functions and related cloud technologies.n
- Build and optimize scalable data processing solutions using PySpark and Databricks.n
- Design and implement complex data calculation engines and business logic frameworks.n
- Develop efficient data ingestion, transformation, and aggregation processes for large datasets.n
- Manage and optimize databases such as PostgreSQL and MongoDB.n
- Ensure data quality, integrity, performance, and reliability across data platforms.n
- Collaborate with Software Engineers and cross-functional teams to translate business requirements into technical solutions.n
- Participate in code reviews, architecture discussions, technical design sessions, and sprint planning.n
- Contribute to automation, testing, deployment, and monitoring processes.n
- Troubleshoot and resolve data pipeline and application performance issues.n
- Create and maintain technical documentation.n
n
nRequired Skills & Qualifications
nTechnical Skills
n
- n
- Strong programming experience in Python.n
- Hands-on experience with Azure Cloud Services.n
- Expertise in PySpark and Databricks.n
- Experience designing and maintaining ETL/ELT pipelines.n
- Solid knowledge of SQL and database concepts.n
- Experience with PostgreSQL and/or MongoDB.n
-
📌 SDR - Data Engineer (Pune)
🏢 Tata Consultancy Services
📍 Pune