17 Sep
|
YMinds.AI
|
Karnataka
17 Sep
YMinds.AI
Karnataka
Job DescriptionOur client is seeking an experienced AWS Data Engineer with 4+ years of hands-on Data Engineering experience. The ideal candidate should have strong expertise in Python, PySpark, SQL, and AWS services, with experience building scalable data pipelines and cloud-based data solutions.
NThis role focuses on dataingestion, transformation, storage, and analytics, with an emphasis on data quality, reliability, performance, and cost optimization.
NKey Responsibilities
n
N
Design, develop, and maintain scalable data pipelines using Python and PySpark. N
Build and optimize ETL/ELT workflows for data ingestion, transformation, and processing. N
Write and optimize complex SQL queries for data transformation, validation, and analytics. N
Build and manage cloud-based data solutions using AWS Glue, S3, Redshift, Athena, and Lambda, with SNS, SQS, CloudWatch, EventBridge, and API Gateway supporting integration, automation, and monitoring. N
Ensure data quality andtroubleshoot pipelines to improve reliability, performance, and cost efficiency. N
Collaborate with cross-functional teams to translate business requirements into scalable data solutions. N
nRequired Skills
N
n
4+ years of hands-on experience in Data Engineering. N
Strong understanding ofdata ingestion, transformation, ETL/ELT, data quality, data modeling, and pipeline optimization. N
Robust hands-on experience with Python and PySpark for data processing. N
Strong practical knowledge of SQL, including complex queries and query optimization. N
Robust hands-on experience with AWS Glue, S3, Redshift, Athena, and Lambda, along with working knowledge of SNS, SQS, CloudWatch, EventBridge, and API Gateway. N
Solid problem-solving,communication, and collaboration skills. N
nNice-to-Have Skills
N
n
Experience with Amazon Kinesis or Apache Kafka for streaming data pipelines. N
Exposure to Amazon MWAAor Apache Airflow for workflow orchestration. N
Fami
📌 Aws Data Engineer Karnataka
🏢 YMinds.AI
📍 Karnataka