30 Aug
|
Synthlane Technologies
|
Hyderabad
30 Aug
Synthlane Technologies
Hyderabad
Role Overview
We are looking for an experienced Java Spark AWS Data Engineer with strong hands-on expertise in Java, Apache Spark, AWS, SQL, and large-scale data processing.
The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and distributed data-processing applications on AWS. The role requires strong software engineering fundamentals along with practical experience in Spark performance optimization, cloud-native data services, ETL/ELT pipelines, and production support.
Candidates must have 8+ years of overall experience, with solid hands-on expertise in Java, Apache Spark, AWS, and large-scale data engineering solutions.
Key Responsibilities
- Design and develop scalable data-processing applications using Java and Apache Spark.
- Build and maintain production-grade ETL/ELT data pipelines on AWS.
- Develop distributed batch and real-time data-processing solutions.
- Process large volumes of structured, semi-structured, and unstructured data.
- Build Spark applications using Java, Spark SQL, and DataFrame APIs.
- Optimize Spark jobs for performance, memory utilization, partitioning, and scalability.
- Design and manage data ingestion and transformation workflows using AWS services.
- Work with AWS services such as Amazon S3, EMR, Glue, Lambda, Athena, Redshift, RDS, and CloudWatch.
- Develop and integrate REST APIs and backend services using Java where required.
- Implement data validation, reconciliation, quality checks, and error-handling mechanisms.
- Design scalable data models and data warehouse solutions.
- Troubleshoot Spark jobs, data pipeline failures, and production performance issues.
- Implement monitoring, logging, and alerting for data-processing workloads.
- Participate in system design, architecture discussions, and code reviews.
- Write unit, integration, and data-pipeline tests.
- Support CI/CD pipelines and automated deployments.
- Collaborate with Data Engineers, Architects, DevOps/SRE
📌 Senior Data Engineer (Hyderabad)
🏢 Synthlane Technologies
📍 Hyderabad