27 Sep
|
Talent Corner HR Services
|
Pune
27 Sep
Talent Corner HR Services
Pune
AWS Data Engineer
Location: Pune
Experience: 5+ Years
Work Mode: Hybrid / In office
Employment Type: Full-Time
Job Overview
We are looking for an experienced AWS Data Engineer with strong hands-on expertise in Python, PySpark, AWS Data Services, and modern data technologies. The ideal candidate should have experience building scalable data pipelines, working with large datasets, cloud-native services, databases, and event-driven architectures.
Key Responsibilities
- Develop, maintain, and optimize scalable data pipelines using Python and PySpark.
- Work with Pandas, PyArrow, Parquet, and other data processing libraries.
- Design and implement data workflows using AWS cloud services.
- Work with modern data platforms and databases including Apache Iceberg, ClickHouse, Amazon Redshift, and DynamoDB.
- Build event-driven and serverless workflows using:
- AWS Lambda
- AWS Step Functions
- Amazon EventBridge
- Amazon SQS
- Amazon SNS
- Work with AWS EMR, AWS Glue, Amazon Athena, and Amazon S3 for data processing and analytics.
- Handle large-scale data processing and improve pipeline performance, reliability, and scalability.
- Explore and integrate Amazon Bedrock for AI/GenAI-based data solutions.
- Use AI-assisted coding tools to improve development productivity, code quality, and engineering efficiency.
- Troubleshoot data pipeline issues and participate in performance optimization.
- Collaborate with cross-functional teams to understand data requirements and deliver robust solutions.
Required Skills
- 5+ years of experience in Data Engineering or a related role.
- Strong hands-on experience with Python and PySpark.
- Good knowledge of Pandas, PyArrow, and Parquet.
- Experience with Iceberg, ClickHouse, Redshift, and DynamoDB.
- Hands-on experience with AWS Lambda, Step Functions, EventBridge, SQS, SNS, EMR, Glue, Athena, and S3.
- Basic to hands-on understanding of Amazon Bedrock and GenAI technologies.
- Experience using AI-assisted coding tools.
- Strong understanding of data processing and pipeline optimization.
- Good problem-solving, analytical, and communication skills.
Preferred Candidate Profile Candidates with strong hands-on experience in AWS Data Engineering, Python/PySpark development, cloud-native data pipelines, and modern AWS data services will be preferred.
Key Skills / Keywords
AWS Data Engineer | Python | PySpark | AWS | Pandas | PyArrow | Parquet | Apache Iceberg | ClickHouse | Redshift | DynamoDB | Lambda | Step Functions | EventBridge | SQS | SNS | EMR | Glue | Athena | S3 | Amazon Bedrock | GenAI | Data Pipelines | Data Engineering | AI-Assisted Coding
📌 Aws Data Engineer (Pune)
🏢 Talent Corner HR Services
📍 Pune