Roles and Responsibilities :

- Design, develop, test, deploy and maintain large-scale data pipelines using AWS services such as S3, Lambda, Step Functions etc.
- Collaborate with cross-functional teams to gather requirements and design solutions for complex data processing needs.
- Develop scalable and productive ETL processes using PySpark, SQL and Kafka to extract insights from various sources.
- Ensure high availability of the system by implementing monitoring tools and performing regular maintenance tasks.

Job Requirements :

- Streaming Data Pipelines
- AWS (S3, Lambda)
- Glue
- Kafka
- PySpark
- Spark job tuning
- Databases, SQL query tuning, and Bloom Filters
- DSA

- 5-10 years of experience in Data Engineering with expertise in building large-scale data pipelines on cloud platforms like AWS.
- Strong proficiency in Python programming language along with experience working with libraries like NumPy, Pandas etc.
- Experience with big data technologies such as Spark (PySpark) and Kafka for handling high-volume datasets.

📌 Senior Data Engineer (Maharashtra)
🏢 Robosoft Technologies
📍 Maharashtra