04 Aug
|
ValueMomentum
|
Hyderabad
04 Aug
ValueMomentum
Hyderabad
Job Title:Data Engineer
Primary Skill: AWS, DynamoDB, Aurora PostgreSQL, AWS Sagemaker, Spark, Scala/Python,Medallion Architecture
Location: Hyderabad/ Pune/ Coimbatore
Experience: 3 -9 years of experience
Mode of working - 5 Daya work from office
We are looking for an experienced AWS Data Engineer with robust hands‑on expertise in building scalable, reliable data pipelines in a Lakehouse/Medallion architecture. The ideal candidate will have deep knowledge of Spark/PySpark, Terraform, and modern data engineering patterns.
Key Responsibilities
- Build and operate data pipelines using PySpark/Spark , SQL, and AWS services.
- Implement Medallion (Bronze/Silver/Gold) architecture with proper separation of concerns.
- Design incremental processing, SCD Type 2, CDC/merge, and late-arriving/out‑of‑sequence data handling.
- Ensure pipelines are idempotent, resilient, and re‑processable .
- Manage AWS data infrastructure using Terraform .
- Apply strong data quality, deduplication, schema validation, and operational best practices.
Required Skills
- Terraform for AWS infrastructure provisioning
- PySpark/Spark , Python, Advanced SQL
- Lakehouse/Medallion Architecture (Bronze/Silver/Gold)
- Type 2 Dimensions , CDC/Merge processing
- Incremental & historical processing, deduplication, late-arriving data handling
- Idempotency and resilient pipeline patterns
- AWS data services (S3, Glue, EMR, Lambda, Step Functions, etc.)
- Data modeling fundamentals & data quality mindset
Candidates Must Be Able to Explain
- Updates/deletes from relational sources
- Deterministic deduplication
- Late-arriving/out-of-sequence data handling
- Idempotent pipeline design
- Merge keys, ordering columns, event time vs ingest time, soft deletes, reprocessing windows
If you are interested in the above role, kindly fill in the details below and share your updated resume here.
Full Name
Overall Experience
Relevant Experience
Notice Period
Current CTC (Cost to Company):
Expected CTC
Are you open to working 5 days a week from the office? (Yes/No):
Preferred Location (if applicable)
Are you currently employed? (Yes/No):
Reason for Looking for a Chang
📌 AWS Data Engineer Lead (Hyderabad)
🏢 ValueMomentum
📍 Hyderabad