20 Aug
|
Hire3 Labs
|
Bangalore Rural
20 Aug
Hire3 Labs
Bangalore Rural
Senior Data Engineer (AWS, Python/Java)
Bengaluru
Onsite 5 days
25 LPA to 42 LPA
Must have skills: AWS, AWS Services, Python, Java, S3, Glue, Lambda, SQL, redshift, Docker
Roles & Responsibilities
This role offers an exciting opportunity to work on diverse projects, collaborating with cross functional teams to design, build, and optimize data pipelines and infrastructure.
Responsibilities:
- Design, develop, and maintain scalable data pipelines and ETL processes leveraging AWS services such as S3,
- Glue, EMR, Lambda, and Redshift.
- Collaborate with data scientists and analysts to understand data requirements and implement solutions that support analytics and machine learning initiatives.
- Optimize data storage and retrieval mechanisms to ensure performance, reliability, and cost-effectiveness.
- Implement data governance and security best practices to ensure compliance and data integrity.
- Troubleshoot and debug data pipeline issues, providing timely resolution and proactive monitoring.
- Stay abreast of emerging technologies and industry trends, recommending cutting-edge solutions to enhance data engineering capabilities.
Ideal Candidate 1Strong Data Engineer (AWS) Profile
2Mandatory (Experience 1) – Must have minimum 6+ years of experience in Data Engineering, with strong experience designing, developing, and maintaining scalable data pipelines and ETL processes.
3Mandatory (Experience 2) – Must have 3+ years of hands-on experience with AWS data engineering services, particularly S3, AWS Glue, EMR, Lambda, and Redshift.
4Mandatory (Experience 3) – Must have strong programming experience in Python, Java, or Scala,
with hands-on development of data processing and pipeline solutions.
5Mandatory (Experience 4) – Must have strong expertise in SQL, data warehousing, and database technologies, including experience with both SQL and NoSQL databases.
6Mandatory (Experience 5) – Must have hands-on experience working with Big Data technologies and distributed data processing, including designing and optimizing large-scale data pipelines.
7Mandatory (Experience 6) – Must have experience with data pipeline troubleshooting, monitoring, data quality, governance, and security best practices.
8Mandatory (Education) – B.Tech / B.E./ M.Tech
9Mandatory (Notice Period) – Immediate joiners or candidates who can join within 2 weeks.
10Preferred (Experience 1)– Experience with Apache Airflow, Docker, and Kubernetes for pipeline orchestration and containerized data engineering workloads.
Interview Process
R1
R2
R3
HR Discussion
Pay: ₹2,500,000.00 - ₹4,200,000.00 per year
Ability to commute/relocate
- Bengaluru, Karnataka (Bengaluru, Bengaluru Rural District): Reliably commute or planning to relocate before starting work (Required)
Application Question(s):
- Notice period
Experience:
- Senior Data Engineer (AWS, Python/Java): 4 years (Required)
- AWS: 4 years (Required)
- AWS Services: 4 years (Required)
- Python: 4 years (Required)
- S3: 4 years (Required)
- Bluebeam: 4 years (Required)
- Lambda: 4 years (Required)
- SQL: 4 years (Required)
- Redshift: 4 years (Required)
- Docker: 4 years (Required)
Location:
- Bengaluru, Karnataka (Bengaluru, Bengaluru Rural District) (Required)
Work Location: In person
📌 Senior Data Engineer (AWS, Python/Java) (Bangalore Rural)
🏢 Hire3 Labs
📍 Bangalore Rural