06 Sep
|
Arminus
|
Hyderabad
- Experience: 4–6 years (Mid-level)
- Location: Hyderabad (Onsite on Wednesdays and Thursdays)
- Required Skills: Python, hands-on AWS (EC2, Lambda, and mandatory EMR), and EMR performance and cost optimization.
- Budget: We can go a little higher on the budget for this role.
Interview Process:
- L1: Technical Engineer (Virtual)
- L2: SME (Virtual)
- L3: Engineering Manager (In-person)
Overview
Location: Hybrid · Hyderabad
Employment Type: full time
Experience: 5 - 6 years
Compensation: INR 1,153,440 - 1,441,800
Experience Required
• Extracted: 5+ years of hands-on experience developing enterprise-scale applications, data platforms, or distributed systems. 5+ years of experience developing, and operating Big Data platforms and cloud-based infrastructure services, preferably using AWS EMR and the Hadoop ecosystem.
Overview
The role focuses on building scalable data engineering and backend services for large-scale batch Big Data applications. You will develop and maintain data transformation pipelines using Spark/SQL/Hive and build cloud-native solutions on AWS.
The position also involves workflow orchestration with Apache Airflow, production troubleshooting, and collaboration in an Agile/Scrum workplace.
Key Responsibilities
• Develop API-driven systems to govern, manage, and monitor large-scale batch Big Data applications
• Build scalable backend services and data engineering solutions supporting data processing and operational workflows
• Develop and maintain data transformation processes using Spark, SQL, Hive, Python, Scala, and related technologies
• Build cloud-native data and backend solutions using AWS services (S3, EC2, EMR, Lambda, DynamoDB, API Gateway)
• Build and enhance workflow orchestration using Apache Airflow (advanced DAG design, dependency management, scheduling, monitoring, failure handling)
• Define technical scope/objectives and implementation approaches via requirements gathering, technical research, and process definition
📌 Mid-level Data Engineer (Hyderabad)
🏢 Arminus
📍 Hyderabad