07 Aug
|
Incedo
|
Gurugram
Job Description
AWS Lead Developer / AWS Lead Data Engineer
Experience Required: 10+ Years in Software Development (5+ Years specialized in AWS; 7+ Years in Data Engineering)
About Incedo
Incedo is a global AI and data transformation specialist empowering companies to realize sustainable business impact from their digital investments by delivering ROI from AI@Scale. As a long-term partner for strategy to execution, we operate at the intersection of business and technology. Our integrated services and platforms are built on the foundation of AI & Data, digital engineering, and operations transformation, bringing deep domain expertise and full stack capabilities together. With over 4,000 people across the US, Canada, Latin America, and India, and a large, diverse portfolio of Fortune 500 enterprises and quick-growing clients worldwide, we work across banking & payments, wealth management, telecom, hi-tech, and life sciences.
Website: https://www.incedoinc.com/
Role Overview
We are looking for an experienced AWS Lead Data Engineer to lead the design, development, and optimization of enterprise-scale data platforms on AWS. The ideal candidate will have robust expertise in building cloud-native data pipelines, modern data lake architectures, and scalable ETL/ELT solutions while providing technical leadership to engineering teams. This role requires hands-on experience with AWS data services, Python, SQL, infrastructure automation, and modern data engineering best practices.
Key Responsibilities
- Data Engineering: Design, develop, and optimize scalable batch and real-time ETL/ELT pipelines using AWS-native services and modern data engineering frameworks.
- AWS Data Platform: Build and maintain enterprise data lakes, lakehouse architectures,
and cloud-native analytics platforms on AWS.
- Pipeline Development: Develop reliable, reusable, and high-performance data ingestion, transformation, and orchestration pipelines.
- Data Processing: Build distributed data processing solutions using AWS Glue, PySpark, and SQL to process large-scale datasets efficiently.
- Cloud Development: Develop cloud-native applications and data services using AWS Lambda, Step Functions, EventBridge, and API Gateway.
- Infrastructure Automation: Automate cloud infrastructure deployment using Terraform, AWS CloudFormation, or AWS CDK, and support CI/CD implementation.
- Performance Optimization: Optimize SQL queries, ETL jobs, storage strategies, and cloud resources for performance, scalability, and cost efficiency.
- Data Quality & Governance: Implement data quality checks, metadata management, monitoring, and governance across enterprise data platforms.
- Technical Leadership: Lead technical design discussions, perform code reviews, mentor engineering teams, and promote engineering best practices.
- Collaboration: Work closely with architects, business stakeholders, data analysts, and DevOps teams to deliver scalable data solutions.
Technical Requirements
- Core AWS Services: Compute (EC2, Lambda, ECS/EKS, Glue), Storage (S3, EFS), and Database (RDS, DynamoDB, Aurora).
- Serverless: Extensive experience building event-driven architectures using AWS Lambda, Step Functions, and EventBridge.
- Analytics & Data: Athena.
- Security: IAM, KMS, Secrets Manager, CloudTrail, CloudWatch.
Experience
10+ Years in Software Development, with 7+ Years in Data Engineering.
Nice to Have
- DBT
- Snowflake
Preferred Qualifications
- AWS Certified Solutions Architect Professional
- Background in Healthcare
📌 Aws Data Engineer (Gurugram)
🏢 Incedo
📍 Gurugram