Job Description
Senior Big Data Engineer (AWS | PySpark | EMR)
n? Location: Bangalore (Hybrid/Onsite)
n? Experience: 10 to 16Years
n? Relevant Experience: Minimum 8 Years in Data Engineering / Big Data
nJob Description
nWe are looking for a highly skilled Senior Big Data Engineer with strong hands-on experience in AWS, PySpark/Scala, Apache Spark, EMR, and enterprise-scale data processing.
nCandidates should have proven experience building and optimizing large-scale distributed data platforms and must be comfortable working with complex ETL ecosystems handling massive data volumes.
nMandatory Skills
nAWS (Must Have)
n
- n
- Robust hands-on experience with AWS ecosystemn
- Expert knowledge of:n
- AWS EMRn
- S3n
- Gluen
- Redshiftn
- Athenan
- Lambdan
- Step Functionsn
- CloudWatchn
- Experience designing and managing large-scale AWS data platformsn

nBig Data Technologies (Must Have)
n
- n
- Apache Sparkn
- PySpark and/or Scalan
- Hadoop Ecosystemn
- Hiven
- HDFSn
- Spark SQLn
- Distributed Data Processingn

nData Engineering (Must Have)
n
- n




- Design and development of scalable ETL/ELT pipelinesn
- Batch and large-scale data processingn
- Data Lake and Data Warehouse solutionsn
- Performance tuning of Spark applicationsn
- Data quality and validation frameworksn

nOrchestration (Must Have)
n
- n
- Apache Airflown
- AWS Step Functionsn
- Workflow orchestrationn
- DAG design and optimizationn
- Job scheduling and dependency managementn
- State management for enterprise data pipelinesn

nRequired Experience
n
- n
- 8+ years of Data Engineering / Big Data experiencen
- Strong experience handling TB/PB-scale datasetsn
- Experience working with large Spark clustersn
- Expertise in Spark optimization techniques:n
- Partitioningn
- Cachingn
- Broadcast joinsn
- Shuffle optimizationn
- Memory tuningn
- Cluster tuningn
- Experience solving distributed computing challengesn

nPreferred Skills
n
- n
- Kafkan
- S

📌 Senior Big Data Engineer (Bengaluru)
🏢 ITC Infotech
📍 Bengaluru