We are looking for an experienced Python Data Engineer with strong expertise in Python, PySpark, SQL, ETL/ELT, and Cloud Data Platforms. The ideal candidate will design, build, and optimize scalable data pipelines, support modern data architectures, and deliver enterprise-grade data solutions across cloud environments.

The role requires strong hands-on data engineering experience, excellent problem-solving skills, and the ability to work closely with business and technology stakeholders in a customer-facing environment.

Key Responsibilities

- Design, develop, and optimize scalable data pipelines using Python and PySpark.
- Build ETL/ELT frameworks for ingesting, transforming, and processing large datasets.
- Develop data ingestion solutions from multiple structured and semi-structured data sources.
- Implement data transformation, cleansing, validation, and quality checks.
- Work with cloud-based data platforms to build up-to-date data engineering solutions.
- Collaborate with technology, architecture, product, and design teams to deliver scalable data solutions.
- Design and maintain data models supporting analytics and reporting requirements.
- Optimize data pipeline performance, scalability, and reliability.
- Ensure data quality and governance standards are maintained.
- Support Data Warehousing and enterprise analytics initiatives.
- Participate in Agile ceremonies and contribute to continuous improvement initiatives.




- Work closely with customers and stakeholders to understand business requirements and translate them into technical solutions.

Required Skills

- Strong hands-on experience with Python for data processing and transformation.
- Expertise in PySpark and distributed data processing frameworks.
- Strong SQL skills, including:

- Complex joins

- Aggregations

- Query optimization

- Data transformation
- Experience building ETL/ELT pipelines and data ingestion frameworks.
- Hands-on experience with cloud platforms:

- Azure

- AWS

- GCP

- Strong understanding of

- Data Warehousing

- Dimensional Modeling

- Data Modeling Concepts
- Experience handling structured and semi-structured data.

Preferred Skills

- Azure Data Factory (ADF).
- Databricks.
- Azure Synapse Analytics.
- Kafka.
- Azure Event Hubs.
- CI/CD implementation for Data Engineering workflows.
- Agile methodologies and JIRA.
- BFSI, Insurance, or Investment domain experience.
- LOMA certification or similar industry certifications.

Desired Candidate Profile

- Strong analytical and problem-solving skills.
- Excellent communication and stakeholder management abilities.
- Strong ownership mindset and accountability.
- Ability to work effectively in customer-facing environments.
- Experience working in Agile and cross-functional teams.
- Passion for building scalable and reliable data platforms.

📌 Python Data Engineer (Blr/Chn/Hyd/Kochi/Kol/Pune) (Bengaluru)
🏢 Tata Consultancy Services
📍 Bengaluru