Roles and Responsibilities :
- Design, develop, test, deploy and maintain large-scale data pipelines using AWS services such as S3, Lambda, Step Functions etc.
- Collaborate with cross-functional teams to gather requirements and design ETL processes for big data transformations.
- Develop complex data models and algorithms to process large datasets using PySpark on DataBricks platform.
- Troubleshoot issues related to data quality, performance optimization and scalability of the deployed systems.
Job Requirements :
- 4-5 years of experience in Data Engineering with expertise in Big Data technologies like Hadoop ecosystem (HDFS), Spark (PySpark) etc.
- Robust understanding of cloud-based platforms like AWS including S3, Lambda functions & Step Functions.
- Proficiency in developing complex data models and algorithms for processing large datasets using Python programming language.
📌 Data Engineer (Pune)
🏢 T-Systems ICT India
📍 Pune
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.