Roles and Responsibilities :

- Design, develop, test, and deploy large-scale data pipelines using AWS services such as Glue to extract insights from various sources.
- Collaborate with cross-functional teams to identify business requirements and design scalable solutions for data processing and analysis.
- Develop automated testing frameworks using Python to ensure high-quality delivery of data products.
- Implement continuous integration/continuous deployment (CI/CD) pipelines to efficiently deliver new features.
- Work on big data technologies such as Hadoop ecosystem components including Spark.
- Ensure data quality and integrity by implementing robust testing and validation procedures.

Job Requirements :

- Strong understanding of CI/CD concepts and implementation using Python programming language.
- Experience working on big data technologies such as Hadoop ecosystem components including Spark.
- Proficiency in AWS services like Glue is mandatory.
- A solid educational background is preferred.
- Minimum 5 years of experience in data engineering or a related field.
- Familiarity with fintech or finops industry is an added advantage.

📌 Senior Data Engineer (Gujarat)
🏢 Prama innovations
📍 Gujarat