23 Oct
|
Hexaware Technologies
|
India
23 Oct
Hexaware Technologies
India
Job Summary:
We are seeking a skilled Data Engineer with robust expertise in AWS Glue and Apache Kafka to design, develop, and maintain scalable data pipelines and real-time data processing solutions. The ideal candidate should have experience building cloud-native data platforms on AWS and working with large-scale data integration and streaming architectures.
Key Responsibilities:
Design, develop, and support ETL/ELT pipelines using AWS Glue.
Build and maintain real-time data streaming solutions using Apache Kafka/MSK.
Develop scalable data processing frameworks using Python, PySpark, and Spark.
Integrate data from multiple sources into AWS-based data lakes and warehouses.
Optimize data ingestion, transformation, and processing workflows.
Collaborate with business and engineering teams to understand data requirements.
Ensure data quality, reliability, and performance across data platforms.
Monitor and troubleshoot production data pipelines.
Mandatory Skills:
AWS Glue
Apache Kafka / Amazon MSK
Python
PySpark / Apache Spark
AWS Cloud Services (S3, IAM, CloudWatch)
ETL/Data Engineering Concepts
SQL
Preferred Skills:
AWS Lambda
Amazon Redshift
Airflow
Snowflake
Glue Data Catalog
CI/CD Pipelines
Docker/Kubernetes
Qualifications:
Bachelor's degree in Computer Science, Information Technology, or related field.
9+ years of experience in Data Engineering.
Hands-on experience with AWS cloud services and big data technologies.
Solid understanding of data warehousing and data lake concepts.
Note : We are looking for the candidates who can come for F2F Interview on Thursday
📌 Aws Data Engineer Chennai (India)
🏢 Hexaware Technologies
📍 India