As a Senior Data Engineer, you will be responsible for designing, developing, and optimizing scalable cloud-native data platforms on AWS. You will build high-performance batch and analytical data pipelines using DBT (Cloud + Core), AWS Glue, SMUS, Redshift, Python, MWAA, APIs, and other AWS services while ensuring reliability, scalability, and operational excellence.

The role requires strong expertise in data engineering, SQL optimization, distributed data processing, and cloud-native architectures.

Must Have Primary Skills

Data Engineering

- 3+ years of hands-on experience building large-scale AWS Data Engineering solutions.
- Strong experience designing scalable batch and streaming data pipelines on AWS.
- Experience implementing monitoring, logging, alerting, and observability for production data pipelines.
- Strong understanding of data quality, troubleshooting, debugging, and production support.

DBT & Data Warehousing

- Strong hands-on experience with DBT (Cloud + Core) (Highly Recommended).
- Hands-on expertise with Amazon Redshift for Data Warehousing and Analytics.

Programming & Querying

- Strong expertise in:
- SQL (Analytical Queries, Window Functions, Stored Procedures)
- Python
- Spark / PySpark
- Strong experience in Spark/PySpark performance tuning and optimization.

Lakehouse & Apache Iceberg

- Hands-on experience designing and implementing Lakehouse solutions using Apache Iceberg.




- Experience optimizing Apache Iceberg and Amazon Aurora PostgreSQL for performance and scalability.
- Strong understanding of:
- Data Modeling
- Partitioning
- File Formats
- Lakehouse / Data Lake Architectures

AWS Cloud Services

Hands-on experience with AWS services including:

- AWS Glue
- Amazon MWAA
- Amazon EMR
- Amazon Redshift
- Amazon S3
- Amazon Athena
- AWS Glue Catalog
- Amazon Aurora PostgreSQL
- AWS Lambda
- Amazon EC2
- Amazon DynamoDB
- Amazon API Gateway
- Amazon CloudWatch
- Amazon SQS
- Amazon SNS
- Amazon EventBridge
- AWS Secrets Manager
- AWS IAM

Development Practices

- Experience with CI/CD.
- Robust knowledge of Git.
- Familiarity with Data Engineering best practices.

Soft Skills

- Strong communication skills.
- Excellent problem-solving ability.
- Stakeholder management experience.

Preferred Certification

- AWS Data Engineer Associate or equivalent AWS Certification.

Good to Have Skills

- AWS Step Functions
- Terraform / Infrastructure as Code (IaC)
- Kafka
- Hive
- HDFS
- Other Big Data technologies
- Experience using GenAI-assisted development tools such as:
- GitHub Copilot
- Cursor
- Kiro
- Similar AI coding assistants
- ClickHouse Database
- Telecom / Mobile Network domain knowledge
- AtScale design and development
- Docker
- Kubernetes

Skills:- Data Transformation Tool (DBT), Amazon Web Services (AWS), PySpark, iceberg and SQL

📌 Senior Data Engineer (DBT AWS) (Mumbai)
🏢 Quantiphi
📍 Mumbai