We are looking for an experienced Senior Data Engineer with 10-15 years of hands-on expertise in designing, building, and optimizing large-scale data platforms and pipelines on AWS. The selected candidate will play a key role in a strategic cloud migration initiative, supporting the transition from CDP to Minerva on AWS Cloud.
This role requires a highly skilled individual contributor who can work independently with minimal supervision and drive complex data engineering initiatives from design through implementation.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL/ELT frameworks on AWS.
- Lead and support migration activities from CDP to Minerva on Amazon Cloud.
- Build and optimize robust data models to support analytics and reporting requirements.
- Develop high-performance data processing solutions using PySpark and SQL.
- Design, develop, and maintain API-based data ingestion frameworks for integrating data from internal and external source systems.
- Implement and optimize batch and near real-time data ingestion mechanisms.
- Ensure data quality, reliability, scalability, and performance across the data ecosystem.
- Collaborate with cross-functional stakeholders to understand business requirements and translate them into technical solutions.
- Troubleshoot and resolve complex data engineering and integration challenges.
Required Skills
- Strong experience with AWS Cloud Services
- Advanced proficiency in PySpark and SQL
- Strong expertise in Data Modeling
- Hands-on experience with ETL/ELT Development
- Proven experience in designing and managing Data Pipelines
- Experience working with API-based data ingestion and integration, including REST APIs and handling structured/semi-structured data formats such as JSON
- Strong understanding of data ingestion patterns, API authentication mechanisms, rate limiting, error handling, and data integration best practices
- Experience working on large-scale cloud migration and data modernization initiatives
- Ability to work independently with minimal handholding and drive delivery ownership
Preferred Qualifications
- Experience in cloud-based data migration projects.
- Exposure to modern data architecture and platform modernization initiatives.
- Understanding of data governance, monitoring, and operational best practices.
Candidate Profile
- 10-15 years of relevant Data Engineering experience.
- Robust problem-solving and analytical skills.
- Proven track record of delivering complex cloud and data engineering projects.
- Self-driven professional capable of functioning as an independent contributor in a fast-paced environment.
Important Notes
- Location is strictly Bengaluru. Profiles from other locations will not be considered.
- Hybrid work model with mandatory office presence twice a week.
- Independent contributor mindset is essential.
Key Skills
AWS | PySpark | SQL | Data Modeling | ETL/ELT | Data Pipelines | API Ingestion | Data Integration | Cloud Migration | Architecture discussions and data modeling
📌 Sr Data Engineer (Bengaluru)
🏢 TRIGENT SOFTWARE PRIVATE
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.