Roles and Responsibilities :
Design, develop, test, and deploy large-scale data pipelines using AWS services such as Glue to extract insights from various sources.
Collaborate with cross-functional teams to identify business requirements and design scalable solutions for data processing and analysis.
Develop automated testing frameworks using Python to ensure high-quality delivery of data products.
Implement continuous integration/continuous deployment (CI/CD) pipelines to efficiently deliver recent features.
Work on big data technologies such as Hadoop ecosystem components including Spark.
Ensure data quality and integrity by implementing robust testing and validation procedures.

Job Requirements :
Robust understanding of CI/CD concepts and implementation using Python programming language.
Experience working on big data technologies such as Hadoop ecosystem components including Spark.
Proficiency in AWS services like Glue is mandatory.
A solid educational background is preferred.
Minimum 5 years of experience in data engineering or a related field.
Familiarity with fintech or finops industry is an added advantage.

📌 Senior Data Engineer Gujarat
🏢 Prama innovations
📍 Gujarat