Roles and Responsibilities :
- Design, develop, test, deploy and maintain large-scale data pipelines using AWS services such as S3, Lambda, Step Functions.
- Collaborate with cross-functional teams to gather requirements for data processing needs and design solutions that meet business needs.
- Develop ETL processes using PySpark on AWS Glue to extract insights from various sources of structured and unstructured data.
- Ensure high availability, scalability, security and performance of the data pipeline by monitoring its metrics.
Job Requirements :
- 8-12 years of experience in Data Engineering with expertise in AWS ecosystem (S3, Lambda).
- Solid understanding of big data technologies like Hadoop/Hive/Pyspark.
- Experience working with Kinesis Firehose for real-time streaming data ingestion.
📌 AWS Data Engineer (Pune)
🏢 Virtusa
📍 Pune