04 Aug
|
Tata Consultancy Services
|
Tamil Nadu
04 Aug
Tata Consultancy Services
Tamil Nadu
Dear Professionals
Greetings from Tata consultancy Services,
Job Title : AWS Data Engineer
Experiernce: 5-15 Years
Location: Chennai
Mode of Work : Work from Office
Mode of Interview: Face To Face
If you are Interested in the above opportunity kindly share your updated resume to
[email protected] immediately with the details below (Mandatory)
Name:
Contact No.
Email id:
Skillset:
Total exp:
Relevant Exp:
Fulltime highest qualification (Year of completion with percentage scored):
Current organization details (Payroll company):
Current CTC:
Expected CTC:
Notice period:
Current location:
Preffered Location
Any gaps between your education or career (If yes pls specify the duration):
Will you be able to join within 30/45 days? (Yes/NO)
Key Responsibilities
- We are looking for a skilled AWS Data Engineer with robust expertise in PySpark, big data technologies, and cloud-based data engineering solutions. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines on AWS to support analytics and business intelligence initiatives.
Key Responsibilities
- Design, develop, and optimize scalable ETL/ELT data pipelines using PySpark.
- Build and maintain data lakes and data warehouses on AWS.
- Process large-scale structured and unstructured datasets efficiently.
- Develop batch and real-time data ingestion frameworks.
- Implement data quality, validation, and monitoring processes.
- Work with cross-functional teams to understand business requirements and data needs.
- Optimize Spark jobs for performance and cost efficiency.
- Ensure security, governance, and compliance of data platforms.
- Troubleshoot production issues and provide ongoing support.
Required Skills
Core Data Engineering
- 5+ years of experience in Data Engineering.
- Strong hands-on experience with:
- PySpark
- Apache Spark
- Python
- SQL
- ETL/ELT Development
- Data Modeling
AWS Services
- Amazon S3
- AWS Glue
- AWS EMR
- AWS Lambda
- flows
Databases
- PostgreSQL
- MySQL
- DevOps & Version Control
- Git/GitHub
- CI/CD Pipelines
- Docker (preferred)
Preferred Skills
- Experience with Real-Time Streaming using Spark Streaming or Kafka.
- Knowledge of Lakehouse architectures.
- Experience with Delta Lake, Iceberg, or Hudi.
- Knowledge of Terraform or CloudFormation.
- Exposure to Databricks is a plus.
- AWS Certification (Data Engineer Associate/Solutions Architect) is preferred.
📌 Aws Data Engineer (Tamil Nadu)
🏢 Tata Consultancy Services
📍 Tamil Nadu