Role & responsibilities

AWS Data Engineer (Spark & Scala)

Location: Chennai/ Hyderabad / Bangalore

Experience: 5-8 Years

Job Type: Full-Time

Preferred candidate profile

Job Summary

We are seeking an experienced AWS Data Engineer with strong expertise in Apache Spark and Scala to design, develop, and optimize large-scale data processing pipelines. The ideal candidate will have hands-on experience with AWS cloud services, big data technologies, and data engineering best practices.

Key Responsibilities

Design, develop, and maintain scalable data pipelines using Spark and Scala.

Build and optimize ETL/ELT processes for processing large datasets.

Develop cloud-native data solutions using AWS services.

Work with stakeholders to gather data requirements and implement solutions.

Monitor, troubleshoot, and improve data pipeline performance.

Ensure data quality, governance, and security standards are followed.

Collaborate with data scientists, analysts, and application teams.

Required Skills

4+ years of experience in Data Engineering.





Strong hands-on experience in Scala programming.

Expertise in Apache Spark (Spark SQL, DataFrames, Spark Streaming).

Experience with AWS services:

S3

EMR

Glue

Lambda

Redshift

Athena

EC2

Valuable understanding of data warehousing concepts.

Experience with SQL and database technologies.

Knowledge of CI/CD, Git, and Agile methodologies.

Preferred Skills

Experience with Kafka or other streaming platforms.

Knowledge of PySpark.

Experience with Airflow or workflow orchestration tools.

AWS Certification is a plus.

Educational Qualification

Bachelor's or Master's degree in Computer Science, Information Technology, or related field.

Keywords

AWS, Spark, Scala, Big Data, Data Engineering, ETL, EMR, Glue, S3, Redshift, Athena, Kafka, Data Pipeline, Cloud Computing.

Interested candidates can share their resume to [email ID] with the subject line: "AWS Data Engineer - Spark & Scala".

Provide your feedback on BizChat

📌 AWS Data Enigneer (Spark and Scala) (Hyderabad)
🏢 Tata Consultancy Services
📍 Hyderabad