13 Aug
|
Quantum Strides
|
Chennai
13 Aug
Quantum Strides
Chennai
About the Role:
We are seeking a Data Engineer with strong AWS expertise to design, develop, and implement data pipelines and integrations for ingesting and processing data from various IWMS platforms into AWS RDS. This role requires expertise in building scalable, secure, and resilient data ingestion solutions using AWS-native services, along with the ability to create custom integration adapters using web services and serverless functions.
The ideal candidate will enforce industry best practices for data auditing, error handling, security (including Row-Level Security), and operational monitoring to ensure future production stability and data integrity.
Key Responsibilities:
- Design and build data pipelines to extract, transform, and load (ETL) data from IWMS systems (e.g., TRIRIGA, ARCHIBUS, Planon) into AWS RDS
- Develop integration adapters using Web Services and custom functions leveraging Java or Python, as needed
- Utilize AWS services such as Lambda, Glue, Step Functions, S3, and others for data processing and orchestration
- Develop frameworks for batch and near real-time data ingestion, integrating with external and internal systems
- Implement industry best practices for data ingestion, auditing, error handling, Row-Level Security (RLS), and operational logging
- Ensure data accuracy, consistency, security, and traceability across all data pipelines and processes
- Collaborate with business analysts, product teams, and technical stakeholders to define data mapping, transformation logic, and integration specifications
- Proactively troubleshoot, optimize, and tune data workflows for performance, scalability, and reliability
- Enforce data security, compliance, and governance standards within all integration and data pipeline solutions
Required Skills & Qualifications:
- 3-7 years of experience as an AWS Data Engineer
- Solid hands-on experience with AWS services like Glue, Lambda, RDS, Step Functions, and S3
- Proficiency in developing integration s
📌 AWS Data and Integration Engineer (Chennai)
🏢 Quantum Strides
📍 Chennai