Technical Lead
Bengaluru, Karnataka
Job Summary
We are seeking a highly skilled AWS Data Developer with strong expertise in Python, PySpark, and AWS data services to design and build scalable data processing solutions. The ideal candidate will be responsible for developing robust ETL pipelines, optimizing data workflows, and leveraging AWS services to support business.
Key Responsibilities
- Design and implement scalable data pipelines using AWS services
- Develop ETL workflows using AWS Glue, PySpark, and Python
- Build serverless data processing solutions using AWS Lambda
- Orchestrate workflows using AWS Step Functions
- Manage and optimize data storage in AWS S3
- Work with relational databases like AWS RDS (MySQL)
- Ensure data quality, validation, and governance
- Optimize performance and cost of data pipelines
- Debug and troubleshoot data-related issues
- Collaborate with cross-functional teams (Data Analysts, Architects, DevOps)
Required Skills & Experience
- 5+ years of experience in data engineering / AWS development
- Robust proficiency in Python
- Hands-on experience with PySpark for large-scale data processing
- Expertise in AWS services:
- - AWS Glue (ETL jobs)
- AWS Lambda
- AWS Step Functions
- AWS Athena
- AWS S3
- AWS RDS (MySQL)
- Strong knowledge of SQL and data querying
- Familiarity with IAM roles and AWS security best practices
Preferred Skills
- AWS Certification (e.g., AWS Certified Data Engineer / Developer)
- Experience with CI/CD pipelines and DevOps tools
- Familiarity with Docker / Kubernetes
Key Responsibilities
We are seeking a highly skilled AWS Data Developer with strong expertise in Python, PySpark,
and AWS data services to design and build scalable data processing solutions. The ideal candidate will be responsible for developing robust ETL pipelines, optimizing data workflows, and leveraging AWS services to support business.
Key Responsibilities
- Design and implement scalable data pipelines using AWS services
- Develop ETL workflows using AWS Glue, PySpark, and Python
- Build serverless data processing solutions using AWS Lambda
- Orchestrate workflows using AWS Step Functions
- Manage and optimize data storage in AWS S3
- Work with relational databases like AWS RDS (MySQL)
- Ensure data quality, validation, and governance
- Optimize performance and cost of data pipelines
- Debug and troubleshoot data-related issues
- Collaborate with cross-functional teams (Data Analysts, Architects, DevOps)
Required Skills & Experience
- 5+ years of experience in data engineering / AWS development
- Strong proficiency in Python
- Hands-on experience with PySpark for large-scale data processing
- Expertise in AWS services:
- - AWS Glue (ETL jobs)
- AWS Lambda
- AWS Step Functions
- AWS Athena
- AWS S3
- AWS RDS (MySQL)
- Strong knowledge of SQL and data querying
- Familiarity with IAM roles and AWS security best practices
Preferred Skills
- AWS Certification (e.g., AWS Certified Data Engineer / Developer)
- Experience with CI/CD pipelines and DevOps tools
- Familiarity with Docker / Kubernetes
Skill Requirements
We are seeking a highly skilled AWS Data Developer with strong expertise in Python, PySpark, and AWS data services to design and build scalable data processing solutions. The ideal candidate will be responsible for developing robust ETL pipelines, optimizing data workflows, and leveraging AWS services to support business.
Key Responsibilities
- Design and implement scalable data pipelines using AWS services
- Develop ETL workflows using AWS Glue, PySpark, and Python
- Build serverless data processing solutions using AWS Lambda
- Orchestrate workflows using AWS Step Functions
- Manage and optimize data storage in AWS S3
- Work with relational databases like AWS RDS (MySQL)
- Ensure data quality, validation, and governance
- Optimize performance and cost of data pipelines
- Debug and troubleshoot data-related issues
- Collaborate with cross-functional teams (Data Analysts, Architects, DevOps)
Required Skills & Experience
- 5+ years of experience in data engineering / AWS development
- Strong proficiency in Python
- Hands-on experience with PySpark for large-scale data processing
- Expertise in AWS services:
- - AWS Glue (ETL jobs)
- AWS Lambda
- AWS Step Functions
- AWS Athena
- AWS S3
- AWS RDS (MySQL)
- Strong knowledge of SQL and data querying
- Familiarity with IAM roles and AWS security best practices
Preferred Skills
- AWS Certification (e.g., AWS Certified Data Engineer / Developer)
- Experience with CI/CD pipelines and DevOps tools
- Familiarity with Docker / Kubernetes
Other Requirements
none
📌 Technical Lead (India)
🏢 HCLTech
📍 India