24 Sep
|
Tata Consultancy Services
|
Pune
24 Sep
Tata Consultancy Services
Pune
Role: AWS Spark Scala Data Engineer
Desired Experience Range: 5-8 years
Location: Chennai, Bangalore, Pune,
Roles Responsibilities:-
- Robust Expertise in AWS Data Engineering or park, Scala, AWS(S3,EMR,Glue,Redshift,Athena,Lambda),SQL,Python
- Hands-on expertise in Spark and Scala
- Extensive experience with AWS Cloud Services (S3, EMR, Glue, Redshift, Athena etc)
- Solid understanding of Distributed computing
- Proficiency in SQL
- Experience in Data Pipeline Orchestration tools (Airflow, Step Functions etc)
- Familiarity with CI/CD pipelines
- Experience with Streaming Data Pipelines
- Relevant AWS Certifications
- Design Develop and maintain Scalable Data Pipelines using Apache Spark (Scala)
- Build and Optimize ETL/ELT workflows on AWS
- Work with large scale structured and unstructured Datasets
- Develop Data Solutions using AWS services such as S3, EMR, Glue, Redshift, Athena,Lambda
- Ensure Data Security, Governance and Compliance Best Practices
📌 AWS Spark Scala Data Engineer (Pune)
🏢 Tata Consultancy Services
📍 Pune