13 Aug
|
Web Spiders
|
Kolkata
13 Aug
Web Spiders
Kolkata
Web Spiders is looking for a Senior AWS EMR Engineer with strong hands-on experience in AWS EMR, Apache Spark, Hadoop, and large-scale distributed data processing. The ideal candidate will have experience building, managing, optimizing, and troubleshooting production-grade data processing workloads on AWS, with a solid understanding of EMR clusters, Spark workloads, data pipelines, performance optimization, scalability, reliability, and cost efficiency.
Location
Kolkata (Rajarhat–Newtown)
Type
Full Time
Department
Technology
Web Spiders is looking for a Senior AWS EMR Engineer with strong hands-on experience in AWS EMR, Apache Spark, Hadoop, and large-scale distributed data processing.
The ideal candidate will have experience building, managing, optimizing, and troubleshooting production-grade data processing workloads on AWS, with a strong understanding of EMR clusters, Spark workloads, data pipelines, performance optimization, scalability, reliability, and cost efficiency.
If AWS EMR + Spark/Hadoop is your core expertise, we'd love to hear from you.
5+ Years Experience | Kolkata – Work from Office
Core Stack: AWS EMR • Apache Spark • Hadoop • S3 • Glue • Airflow/MWAA • Step Functions
* Immediate joiners preferred.*
Working Hours: Ability to work in the US Eastern Time Zone. Depending on project requirements, this may be adjusted to a half-day IST + half-day US EST schedule.
What You'll Do:
Design, develop, deploy, and optimize large-scale data processing workloads using AWS EMR and Apache Spark.
Build and maintain distributed data processing solutions using Spark/Hadoop.
Develop and optimize Spark jobs for performance, scalability, reliability, and cost efficiency.
Work with PySpark/Scala for distributed data processing and transformation.
Configure and manage EMR clusters based on workload and processing requirements.
Optimize Spark applications, including resource utilization, partitioning, joins, caching, and execution performance.
Troubleshoot EMR, Sp
📌 Senior AWS EMR Engineer (Kolkata)
🏢 Web Spiders
📍 Kolkata