16 Sep
|
YMinds.AI
|
Karnataka
16 Sep
YMinds.AI
Karnataka
Job DescriptionOur client is seeking an experienced AWS Data Engineer with 4+ years of hands-on Data Engineering experience. The ideal candidate should have strong expertise in Python, PySpark, SQL, and AWS services, with experience building scalable data pipelines and cloud-based data solutions.
NThis role focuses on dataingestion, transformation, storage, and analytics, with an emphasis on data quality, reliability, performance, and cost optimization.
NKey Responsibilities
n
- N
- Design, develop, and maintain scalable data pipelines using Python and PySpark. N
- Build and optimize ETL/ELT workflows for data ingestion, transformation, and processing. N
- Write and optimize complex SQL queries for data transformation, validation, and analytics. N
- Build and manage cloud-based data solutions using AWS Glue, S3, Redshift, Athena, and Lambda, with SNS, SQS, CloudWatch, EventBridge, and API Gateway supporting integration, automation, and monitoring. N
- Ensure data quality andtroubleshoot pipelines to improve reliability, performance, and cost efficiency. N
- Collaborate with cross-functional teams to translate business requirements into scalable data solutions. N
nRequired Skills
N
- n
- 4+ years of hands-on experience in Data Engineering. N
- Strong understanding ofdata ingestion, transformation, ETL/ELT, data quality, data modeling, and pipeline optimization. N
- Robust hands-on experience with Python and PySpark for data processing. N
- Strong practical knowledge of SQL, including complex queries and query optimization. N
- Strong hands-on experience with AWS Glue, S3, Redshift, Athena, and Lambda, along with working knowledge of SNS, SQS, CloudWatch, EventBridge, and API Gateway. N
- Strong problem-solving,communication, and collaboration skills. N
nNice-to-Have Skills
N
- n
- Experience with Amazon Kinesis or Apache Kafka for streaming data pipelines. N
- Exposure to Amazon MWAAor Apache Airflow for workflow orchestration. N
- Fami
📌 Aws Data Engineer (Karnataka)
🏢 YMinds.AI
📍 Karnataka