Greetings from TCS!!!

TCS presents an excellent opportunity for AWS Senior Data Engineers

Role- AWS Senior Data Engineers

Desired Experience Range- 8-12 Years

Location- Chennai, Bangalore, Kolkata, Pune

-

We are looking for an experienced AWS Senior Data Engineer with robust expertise in designing and building scalable cloud-based data platforms on AWS. The ideal candidate should have hands-on experience with AWS Lambda, Managed Airflow (MWAA), AWS S3, AWS Glue, Amazon Redshift, Amazon EMR, Snowflake, and Python. The role involves developing high-performance ETL/ELT pipelines, implementing data lake solutions, optimizing big data workloads, and enabling analytics across enterprise platforms.

Roles & Responsibilities-

- Design and implement distributed data processing on AWS EMR using PySpark for batch/stream workloads.
- Build robust, scalable ETL/ELT pipelines integrating diverse data sources (files, RDBMS, APIs, streaming).
- Optimize Spark jobs (partitioning, caching, broadcast joins), and tune EMR clusters (instance types, autoscaling, bootstrap actions).




- Implement data lake patterns on S3 with appropriate file formats (Parquet/ORC), schema evolution, and table management.
- Orchestrate workflows using AWS Step Functions, Airflow, or EMR managed workflow, and automate CI/CD.
- Ensure cost governance (spot instances, right-sizing, scaling policies) and observability (CloudWatch, Spark metrics).
- Enforce security & compliance (IAM, KMS, encryption at rest/in transit, VPC, SGs, Glue Catalog access controls).
- Collaborate with analytics teams to expose curated datasets to Redshift, Athena, Glue, or downstream BI tools.
- Troubleshoot performance bottlenecks and production issues; implement resiliency patterns and SLAs.
- Document architecture, standards, runbooks; mentor junior engineers.

Mandatory Skills

- AWS Lambda
- Managed Airflow (MWAA)
- AWS S3
- AWS Glue
- Amazon Redshift
- Amazon EMR
- Snowflake
- Python
- PySpark
- SQL
- ETL / ELT Development
- Data Lake Architecture
- AWS Step Functions
- CI/CD Pipelines

📌 AWS Senior Data Engineers (Bengaluru)
🏢 Tata Consultancy Services
📍 Bengaluru