About Team:
RX Global aims to create unforgettable experiences for attendees and exhibitors through organizing events. Innovation, creativity, and collaboration drive the company to offer exceptional services to clients.
About the role:
This role focuses on building and maintaining scalable data pipelines and platforms using AWS, Python/SQL, and big data tools. It involves managing large datasets, optimizing ETL/ELT workflows, ensuring strong security and governance, and supporting real-time and batch data integration. The position requires hands-on experience with AWS services, DevOps practices, and Agile collaboration, along with solid problem‑solving skills and the ability to translate business needs into reliable data solutions.
Responsibilities:
Data Pipeline Development
Design and build ETL/ELT pipelines to ingest, transform, and load data.
Use AWS services like Glue, Lambda and Step Functions.
Schedule and monitor workflows using Step Functions or AWS Glue Workflows.
Create CI/CD Pipelines based on CloudFormation, Terraform, or CDK.
Data Storage and Management
Manage structured and unstructured data using services like:
Amazon S3
Amazon Glue Catalogue
Amazon DynamoDB
Amazon RDS or Aurora
Amazon Redshift
Ensure data partitioning, indexing, and lifecycle management.
Data Integration
Integrate data from multiple sources (APIs, on-prem databases, third-party tools).
Use AWS Glue, Kinesis, or Kafka for real-time or batch data streaming.
Performance Optimization
Tune ETL jobs and query performance on Athena or Databricks.
Optimize storage formats (e.g., Parquet, ORC) for cost and speed.
Security & Compliance
Implement data encryption, IAM roles, and access policies.
Ensure compliance with data governance and privacy policies (GDPR).
Use AWS Lake Formation and IAM for access control and auditing.
Monitoring & Maintenance
Monitor pipeline health and performance using CloudWatch, CloudTrail, and custom dashboards.
Set up alerts and logging for failures and anomalies.
📌 Data Engineer III (Chennai)
🏢 Relx
📍 Chennai