Senior Big Data Engineer - 4684

IT

Overview

Location: onsite · Hyderabad

Employment Type: full time

Experience: 11+ years

Compensation: INR 1,730,160 - 2,162,700

Notice Period: 15

Job Title

Senior Big Data Engineer

Experience Required

- Extracted:
- "11+ years of hands-on experience with design and development of enterprise-scale applications and systems"
- "8+ year of expertise in Big Data technologies in AWS EMR and Hadoop ecosystem (Spark, Scala,

PySpark, Airflow, Kafka, Delta Tables, Iceberg, HBase, Hive, HDFS, MapReduce etc.)"

- Parsed Range: 11-null years
- Inference (only if used): Not used

Overview

Senior Big Data Engineer role focused on designing and developing enterprise-scale big data systems that govern and manage batch (bigdata) and online (microservices) jobs. The position involves ingesting and processing data from multiple source types into a Big Data ecosystem, including real-time feed processing and data transformation optimization. Work is performed with cross-functional teams in an Agile/Scrum environment.

Key Responsibilities

- Design and develop a system to govern and manage batch (bigdata) and online (microservices) jobs
- Define technical scope and objectives through research and participation in requirements-gathering and definition of processes
- Ingest and process data from various sources in raw, structured, semi-structured, and unstructured format into Big Data ecosystem
- Realtime data feed processing using Big Data ecosystem
- Design, review, implement and optimize data transformation processes in Big Data ecosystem
- Test and prototype new data integration tools, techniques and methodologies
- Participate in overall test planning for the application integrations, functional areas and projects




- Work with cross functional teams in an Agile/Scrum environment to ensure a quality product is delivered

Required Qualifications

- 11+ years of hands-on experience with design and development of enterprise-scale applications and systems
- 8+ year of expertise in Big Data technologies in AWS EMR and Hadoop ecosystem (Spark, Scala,

PySpark, Airflow, Kafka, Delta Tables, Iceberg, HBase, Hive, HDFS, MapReduce etc.)

- Experience with designing, building, management, and operation of the infrastructure as a service layer

(cloud-based platforms) that supports the different platform services

- Experience with Scala
- Experience with Python
- Experience with AWS cloud ecosystem
- Strong understanding of data analytics and data visualization
- Working knowledge of Linux operating system, Bash and other scripting
- Technically focused Bachelor's degree in Computer Science, Engineering, Math, etc.
- Excellent analytical and problem solving skills
- Excellent one-on-one communication and presentation skills, specifically able to convey technical information in a clear and unambiguous manner

Technical Skills

- AWS EMR
- Hadoop ecosystem
- Spark
- Scala
- PySpark
- Airflow
- Kafka
- Delta Tables
- Iceberg
- HBase
- Hive
- HDFS
- MapReduce
- Python
- AWS
- Linux
- Bash
- Data analytics
- Data visualization
- Microservices

Nice-to-have

- MongoDB
- AI Machine Learning

- - Keras
- Tensorflow
- Splunk
- Dynatrace

Tools/Platforms

- AWS EMR
- AWS
- Hadoop
- Spark
- Airflow
- Kafka
- Splunk
- Dynatrace
- Linux
- MongoDB

Job Briefing

- Senior / Lead Big Data Engineer - Truly senior-level — not mid-level
- Spark / PySpark (primary)
- Python + Scala (Should be able to work across both Python + Scala)
- Robust big data fundamentals (not just keyword matching)
- AWS

Preferred Qualifications

- Master Degree is a plus

Role Logistics

- Location Type: Hyderabad
- Employment Type: Full-time

📌 Senior Big Data Engineer (4684)_Hyderabad_11+ yrs (Telangana)
🏢 Arminus
📍 Telangana