Position: Python Developer

Location: Indore
Interview Mode: Virtual

Job Description

We are seeking a highly skilled Python Developer with solid expertise in PySpark, AWS, and Data Engineering to design, develop, and optimize scalable data processing solutions. The ideal candidate should have hands-on experience in building ETL/ELT pipelines, working with cloud-based data platforms, and delivering high-performance data solutions in distributed environments.

Key Responsibilities
Design and implement robust ETL/ELT pipelines using PySpark for large-scale data processing in distributed settings.
Utilize AWS services such as AWS Glue, EMR, Redshift, and S3 for data storage, transformation, and warehousing.
Optimize and fine-tune PySpark jobs and SQL queries to improve data processing performance and reduce operational costs.
Design data models and implement data quality checks to ensure data consistency, integrity, and accuracy.
Collaborate with Data Architects, Data Scientists, and Business Analysts to deliver scalable and productive data solutions.




Participate in code reviews and follow industry best practices for development and deployment.
Implement streaming data solutions using Kafka and automate workflows using orchestration tools such as Apache Airflow.

Required Skills
Strong proficiency in Python and SQL, including window functions and query optimization.
Expertise in PySpark and Apache Spark architecture for distributed data processing.
Hands-on experience with AWS cloud services, specifically AWS Glue, EMR, Redshift, and Amazon S3.
Understanding of modern data architectures, including Snowflake or Databricks.
Minimum 6+ years of relevant experience in Data Engineering roles.

Preferred Skills
Knowledge of NoSQL databases such as DynamoDB.
Familiarity with DevOps practices, CI/CD pipelines, and Git version control.
Hands-on experience with Kafka and streaming data processing.
AWS or Data Engineering certifications will be an added advantage.

📌 Python Developer Indore
🏢 Tata Consultancy Services
📍 Indore