About Team:
RX Global aims to create unforgettable experiences for attendees and exhibitors through organizing events. Innovation, creativity, and collaboration drive the company to offer exceptional services to clients.
About the role:
This role focuses on building and maintaining scalable data pipelines and platforms using AWS, Python/SQL, and big data tools. It involves managing large datasets, optimizing ETL/ELT workflows, ensuring robust security and governance, and supporting real-time and batch data integration. The position requires hands-on experience with AWS services, DevOps practices, and Agile collaboration, along with strong problem‑solving skills and the ability to translate business needs into reliable data solutions.
Responsibilities:
Data Pipeline Development
- Design and build ETL/ELT pipelines to ingest, transform, and load data.
- Use AWS services like Glue, Lambda and Step Functions.
- Schedule and monitor workflows using Step Functions or AWS Glue Workflows.
- Create CI/CD Pipelines based on CloudFormation, Terraform, or CDK.
Data Storage and Management
- Manage structured and unstructured data using services like:
- Amazon S3
- Amazon Glue Catalogue
- Amazon DynamoDB
- Amazon RDS or Aurora
- Amazon Redshift
- Ensure data partitioning, indexing, and lifecycle management.
Data Integration
- Integrate data from multiple sources (APIs, on-prem databases, third-party tools).
- Use AWS Glue, Kinesis, or Kafka for real-time or batch data streaming.
Performance Optimization
- Tune ETL jobs and query performance on Athena or Databricks.
- Optimize storage formats (e.g., Parquet, ORC) for cost and speed.
Security & Compliance
- Implement data encryption, IAM roles, and access policies.
- Ensure compliance with data governance and privacy policies (GDPR).
- Use AWS Lake Formation and IAM for access control and auditing.
Monitoring & Maintenance
- Monitor pipeline health and performance using CloudWatch, CloudTrail, and custom dashboards.
- Set up a
📌 Data Engineer III (Chennai)
🏢 Relx
📍 Chennai