16 Sep
|
YMinds.AI
|
Karnataka
16 Sep
YMinds.AI
Karnataka
Job DescriptionOur client is seeking an experienced AWS Data Engineer with 4+ years of hands-on Data Engineering experience. The ideal candidate should have solid expertise in Python, PySpark, SQL, and AWS services, with experience building scalable data pipelines and cloud-based data solutions.
NThis role focuses on dataingestion, transformation, storage, and analytics, with an emphasis on data quality, reliability, performance, and cost optimization.
NKey Responsibilities
n
N
- Design, develop, and maintain scalable data pipelines using Python and PySpark.
N
- Build and optimize ETL/ELT workflows for data ingestion, transformation, and processing.
N
- Write and optimize complex SQL queries for data transformation, validation, and analytics.
N
- Build and manage cloud-based data solutions using AWS Glue, S3, Redshift, Athena, and Lambda, with SNS, SQS, CloudWatch, EventBridge, and API Gateway supporting integration, automation, and monitoring.
N
- Ensure data quality andtroubleshoot pipelines to improve reliability, performance, and cost efficiency.
N
- Collaborate with cross-functional teams to translate business requirements into scalable data solutions.
N
nRequired Skills
N
n
- 4+ years of hands-on experience in Data Engineering.
N
- Strong understanding ofdata ingestion, transformation, ETL/ELT, data quality, data modeling, and pipeline optimization.
N
- Solid hands-on experience with Python and PySpark for data processing.
N
- Strong practical knowledge of SQL, including complex queries and query optimization.
N
- Strong hands-on experience with AWS Glue, S3, Redshift, Athena, and Lambda, along with working knowledge of SNS, SQS, CloudWatch, EventBridge, and API Gateway.
N
- Strong problem-solving,communication, and collaboration skills.
N
nNice-to-Have Skills
N
n
- Experience with Amazon Kinesis or Apache Kafka for streaming data pipelines.
N
- Exposure to Amazon MWAAor Apache Airflow for workflow orchestration.
N
- Familiarity with AWS IAM, Lake Formation, and data governance practices.
N
- Experience with CI/CD and infrastructure as code using Terraform or AWS CloudFormation.
N
- Experience with large-scale data processing, performance tuning, and AWS cost optimization.
N
nAbout YMinds. AI
NYMinds. AI is a technology and talent solutions company focused on connecting businesses with high-quality technology professionals. We help organizations build strong engineering teams by identifying, evaluating, and delivering skilled talent across emerging and established technology domains.
NKeywords
nAWS DataEngineer, Python, PySpark, SQL, Glue, S3, Redshift, Athena, Lambda, SNS, SQS, CloudWatch, EventBridge, API Gateway, ETL/ELT
NHashtags
n#AWSDataEngineer #AWS #Python #PySpark #SQL #AWSGlue #DataEngineering #Hiring #YMindsAI
📌 Aws Data Engineer (4+ Years) | Remote | Immediate To 15 Days Joiners Only (Karnataka)
🏢 YMinds.AI
📍 Karnataka