16 Aug
|
viraaj hr solutions
|
Thiruvananthapuram
16 Aug
viraaj hr solutions
Thiruvananthapuram
About the Opportunity
A fast-scaling enterprise technology firm specializing in cloud-native data infrastructure and analytics solutions, we empower clients across BFSI, retail, and healthcare sectors to unlock business value through real-time data pipelines, governed data lakes, and scalable AWS architectures. Our engineers design and deploy robust, secure, and cost-optimized data ecosystems that drive AI/ML initiatives, executive dashboards, and operational analytics — all built on AWS cloud services and modern data stack tooling. Role & Responsibilities
- Design, build, and maintain scalable ETL/ELT pipelines on AWS using Glue, Lambda, Step Functions, and Data Pipeline.
- Architect and manage data lakes on S3 with partitioning, metadata management via Glue Data Catalog, and access controls via IAM and Lake Formation.
- Automate data ingestion from diverse sources (APIs, RDS, Kafka, SaaS) into Redshift, Aurora, or DynamoDB with transformation logic in PySpark or SQL.
- Optimize query performance and reduce costs across Redshift, Athena, and EMR by tuning schemas, partitioning,
and leveraging materialized views.
- Implement CI/CD for data pipelines using AWS CodePipeline, CloudFormation, or Terraform; enforce data quality with Great Expectations or Deequ.
- Collaborate with analysts and ML engineers to deliver curated datasets and support feature engineering for predictive models.
Skills & Qualifications
- Must-Have
- AWS Glue
- AWS Lambda
- AWS Redshift
- AWS S3
- AWS IAM
- PySpark
- SQL
- Apache Airflow or AWS Step Functions
- Preferred
- AWS Lake Formation
- AWS Athena
- Terraform or CloudFormation
Benefits & Culture Highlights
- Work on high-impact cloud data projects with Fortune 500 clients across multiple verticals.
- In office collaboration in a modern tech hub with access to AWS training and certification reimbursements.
- Fast-track career progression with structured upskilling paths in modern data engineering stacks.
📌 AWS Data Engineer (Thiruvananthapuram)
🏢 viraaj hr solutions
📍 Thiruvananthapuram