Role: Pyspark Data Engineer

EXP: 6-15 Years

Location: Pune

Must-Have

- Good work experience on Big Data Platforms like Hadoop, PySpark, Scala, Hive, Impala, SQL, Python

Good-to-Have

- Good Python, Pyspark, Big Data experience
- Spark UI/Optimization/debugging techniques
- Good python scripting skills
- Intermediate SQL exposure Subquery, Joins, CTE’s
- Database technologies
- AWS EMR, S3, IAM, Lambda, SNS, SQS

Responsibility of / Expectations from the Role

- Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL
- Experience working on Data Engineering projects
- Valuable Understanding of SQL
- Good understanding of Unix and HDFS commands
- Communication
- Experience working on Data Analytics and Pyspark
- Good Spark, Pyspark, Big Data experience
- Spark UI/Optimization/debugging techniques
- Good python scripting skills
- Intermediate SQL exposure – Subquery, Joins, CTE’s
- Database technologies
- AWS EMR, S3, IAM, Lambda, SNS, SQS

📌 Pyspark Data Engineer (Pune)
🏢 Tata Consultancy Services
📍 Pune