We are seeking a skilled Data Engineer with strong expertise in AWS Glue and Apache Kafka to design, develop, and maintain scalable data pipelines and real-time data processing solutions. The ideal candidate should have experience building cloud-native data platforms on AWS and working with large-scale data integration and streaming architectures.
Key Responsibilities:
- Design, develop, and support ETL/ELT pipelines using AWS Glue.
- Build and maintain real-time data streaming solutions using Apache Kafka/MSK.
- Develop scalable data processing frameworks using Python, PySpark, and Spark.
- Integrate data from multiple sources into AWS-based data lakes and warehouses.
- Optimize data ingestion, transformation, and processing workflows.
- Collaborate with business and engineering teams to understand data requirements.
- Ensure data quality, reliability, and performance across data platforms.
- Monitor and troubleshoot production data pipelines.
Mandatory Skills:
- AWS Glue
- Apache Kafka / Amazon MSK
- Python
- PySpark / Apache Spark
- AWS Cloud Services (S3, IAM, CloudWatch)
- ETL/Data Engineering Concepts
- SQL
Preferred Skills:
- AWS Lambda
- Amazon Redshift
- Airflow
- Snowflake
- Glue Data Catalog
- CI/CD Pipelines
- Docker/Kubernetes
Qualifications:
- Bachelor's degree in Computer Science, Information Technology, or related field.
- 9+ years of experience in Data Engineering.
- Hands-on experience with AWS cloud services and big data technologies.
- Solid understanding of data warehousing and data lake concepts.
Note : We are looking for the candidates who can come for F2F Interview on Thursday
📌 Aws Data Engineer (Chennai)
🏢 Hexaware Technologies
📍 Chennai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.