Job Description
Job Title: Lead Data Engineer - AWS (Redshift)
Experience: 8-10 years of overall IT experience, with a minimum of 4-5 years focused on AWS data services, including robust hands-on experience with Amazon Redshift.
Location: Gurugram or Hyderabad
About The Role
We are seeking a highly skilled and experienced Lead Data Engineer to join our data and analytics team. The ideal candidate will have deep technical expertise in AWS data services - with Amazon Redshift as a core competency - and will be responsible for designing, developing, and implementing robust, scalable, and insightful data-intensive solutions on the AWS Cloud.
This role requires a strong foundation in data engineering, advanced SQL skills, and extensive experience across the AWS analytics ecosystem, including Amazon Redshift, AWS Glue, Amazon EMR, Apache Spark, Apache Kafka (Amazon MSK), and Apache Iceberg. You will play a crucial role in building and evolving an AWS-native cloud data platform.
Key Responsibilities
Lead the design, development,
and optimisation of large-scale data warehousing solutions on Amazon Redshift, including schema design, distribution/sort key strategy, workload management (WLM), Redshift Spectrum, and query performance tuning.
Architect and build end-to-end batch and streaming data pipelines using AWS Glue, Amazon EMR, Apache Spark, Amazon MSK/Kafka, and Amazon Kinesis.
Design and implement lakehouse architectures on Amazon S3 using open table formats such as Apache Iceberg, integrated with Redshift and Athena.
Orchestrate complex data workflows using AWS Step Functions and Amazon MWAA (Managed Workflows for Apache Airflow).
Oversee and contribute to the development, deployment, and lifecycle management of data applications on AWS, ensuring reliability, scalability, and cost efficiency.
Establish data quality, data governance, security, and access-control standards (Lake Formation, IAM, encryption at rest/in transit).
Mentor and provide technical leadersh
📌 Lead Data Engineer (Chennai)
🏢 Minfy
📍 Chennai