15 Sep
|
YMinds.AI
|
Bengaluru
15 Sep
YMinds.AI
Bengaluru
Our client is seeking an experienced AWS Data Engineer with 4+ years of hands-on Data Engineering experience. The ideal candidate should have strong expertise in Python, PySpark, SQL, and AWS services, with experience building scalable data pipelines and cloud-based data solutions.
nThis role focuses on data ingestion, transformation, storage, and analytics, with an emphasis on data quality, reliability, performance, and cost optimization.
n
nKey Responsibilities
n
n
- Design, develop, and maintain scalable data pipelines using Python and PySpark.
n
- Build and optimize ETL/ELT workflows for data ingestion, transformation, and processing.
n
- Write and optimize complex SQL queries for data transformation, validation, and analytics.
n
- Build and manage cloud-based data solutions using AWS Glue, S3, Redshift, Athena, and Lambda, with SNS, SQS, CloudWatch, EventBridge, and API Gateway supporting integration, automation, and monitoring.
n
- Ensure data quality and troubleshoot pipelines to improve reliability, performance, and cost efficiency.
n
- Collaborate with cross-functional teams to translate business requirements into scalable data solutions.
n
n
nRequired Skills
n
n
- 4+ years of hands-on experience in Data Engineering.
n
- Strong understanding of data ingestion, transformation, ETL/ELT, data quality, data modeling, and pipeline optimization.
n
- Strong hands-on experience with Python and PySpark for data processing.
n
- Strong practical knowledge of SQL, including complex queries and query optimization.
n
- Strong hands-on experience with AWS Glue, S3, Redshift, Athena, and Lambda, along with working knowledge of SNS, SQS, CloudWatch, EventBridge, and API Gateway.
n
- Strong problem-solving, communication, and collaboration skills.
n
n
nNice-to-Have Skills
n
n
- Experience with Amazon Kinesis or Apache Kafka for streaming data pipelines.
n
- Exposure to Amazon MWAA or Apache Airflow for workflow orchestration.
n
- Familiarity with AWS IAM, Lake Formation, and data governance practices.
n
- Experience with CI/CD and infrastructure as code using Terraform or AWS CloudFormation.
n
- Experience with large-scale data processing, performance tuning, and AWS cost optimization.
n
n
nAbout YMinds.AI
nYMinds.AI is a technology and talent solutions company focused on connecting businesses with high-quality technology professionals. We help organizations build solid engineering teams by identifying, evaluating, and delivering skilled talent across emerging and established technology domains.
n
nKeywords
nAWS Data Engineer, Python, PySpark, SQL, Glue, S3, Redshift, Athena, Lambda, SNS, SQS, CloudWatch, EventBridge, API Gateway, ETL/ELT
n
nHashtags
n#AWSDataEngineer #AWS #Python #PySpark #SQL #AWSGlue #DataEngineering #Hiring #YMindsAI
📌 AWS Data Engineer (4+ Years) | Remote | Immediate to 15 Days Joiners Only (Bengaluru)
🏢 YMinds.AI
📍 Bengaluru