27 Aug
|
Synthlane Technologies Private
|
Hyderabad
27 Aug
Synthlane Technologies Private
Hyderabad
Role Overview
We are looking for an experienced Java Spark AWS Data Engineer with solid hands-on expertise in Java, Apache Spark, AWS, SQL, and large-scale data processing.
The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and distributed data-processing applications on AWS. The role requires strong software engineering fundamentals along with practical experience in Spark performance optimization, cloud-native data services, ETL/ELT pipelines, and production support.
Candidates must have 8+ years of overall experience, with strong hands-on expertise in Java, Apache Spark, AWS, and large-scale data engineering solutions.
Key Responsibilities
Design and develop scalable data-processing applications using Java and Apache Spark.
Build and maintain production-grade ETL/ELT data pipelines on AWS.
Develop distributed batch and real-time data-processing solutions.
Process large volumes of structured, semi-structured, and unstructured data.
Build Spark applications using Java, Spark SQL, and DataFrame APIs.
Optimize Spark jobs for performance, memory utilization, partitioning, and scalability.
Design and manage data ingestion and transformation workflows using AWS services.
Work with AWS services such as Amazon S3, EMR, Glue, Lambda, Athena, Redshift, RDS, and CloudWatch.
Develop and integrate REST APIs and backend services using Java where required.
Implement data validation, reconciliation, quality checks, and error-handling mechanisms.
Design scalable data models and data warehouse solutions.
Troubleshoot Spark jobs, data pipeline failures, and production performance issues.
Implement monitoring, logging, and alerting for data-processing workloads.
Participate in system design, architecture discussions, and code reviews.
Write unit, integration, and data-pipeline tests.
Support CI/CD pipelines and automated deployments.
Collaborate with Data Engineers, Architects, DevOps/SRE teams, and business stakeholders.
Per
📌 Senior Data Engineer (Hyderabad)
🏢 Synthlane Technologies Private
📍 Hyderabad