Key ResponsibilitiesETL & Pipeline Development: Design and optimize scalable ETL batch pipelines in AWS for high performance and reliability.Orchestration: Manage data workflows using tools like AWS Glue, MWAA, or Step Functions.Data Processing: Develop large-scale processing jobs using PySpark while ensuring data quality and integrity.Infrastructure as Code (IaC): Automate and manage AWS infrastructure using Terraform.Containerization: Deploy and manage applications using Amazon EKS and Docker.Required Skills & QualificationsAWS Services: Hands-on expertise with Glue, S3, IAM, KMS, SNS, Athena, Lambda, SQS, CloudWatch, and EC2.Programming: Proficiency in PySpark for complex data transformations.Migration: Proven experience moving data from on-premises systems to AWS.DevOps Tools: Skilled in Terraform for IaC and Docker/Containers for application packaging.
📌 Aws Data Engineer (Pyspark)_indore,Pune,Hyderabad,,_6 To 9 Yrs (Maharashtra)
🏢 Tata Consultancy Services
📍 Maharashtra
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.