15 Nov
|
Ritwik IT Services
|
Bengaluru
15 Nov
Ritwik IT Services
Bengaluru
Hiring: AWS Data Engineer
Experience: Minimum 7+ Years
Work Mode: Hybrid (23 days per week from Chimera Office)
Shift Timing: 2:00 PM – 11:00 PM IST
Role Overview
We are looking for experienced AWS Data Engineers with strong expertise in data engineering, distributed processing and performance optimisation. The ideal candidate should have hands-on experience building scalable ETL/ELT pipelines, optimising large-scale data workloads and delivering reliable data solutions on AWS.
This role requires an independent technical contributor who can work directly with clients and stakeholders, provide technical consulting, mentor engineers and drive engineering excellence.
Key Responsibilities
- Design, develop and maintain scalable ETL/ELT pipelines on AWS-based data platforms.
- Build reusable engineering components using Python, SQL and PySpark.
- Implement automated testing, monitoring, exception handling and recovery mechanisms.
- Troubleshoot production issues, perform root-cause analysis and implement preventive measures.
- Apply data modelling, metadata management, security and governance practices.
- Maintain technical documentation, operational runbooks and knowledge-transfer materials.
- Collaborate with platform engineering, operations, data owners and business stakeholders.
- Identify and resolve performance bottlenecks across data ingestion, transformation, storage and query execution.
- Optimise complex SQL queries and Spark/PySpark workloads.
- Analyse execution plans, resource utilisation, data skew, shuffle operations and memory behaviour.
- Improve partitioning, file sizing, compression, join strategies and incremental processing.
- Tune AWS Glue, Amazon Redshift, Amazon Athena and other relevant processing environments.
- Conduct workload benchmarking, concurrency testing and capacity analysis.
- Establish performance baselines and validate improvements through repeatable testing.
- Document measurable improvements in runtime, throughput, resource consumption and cloud costs without compromising data quality.
Mandatory Technical Skills
- Strong hands-on experience in AWS Data Engineering.
- Expertise in AWS services such as:
- Amazon S3
- AWS Glue
- Amazon Redshift
- Amazon Athena
- AWS Lambda
- Advanced SQL skills and strong proficiency in Python and PySpark.
- Experience with Apache Spark and distributed data processing.
- Experience with orchestration tools such as Apache Airflow.
- Strong understanding of data lakes, lakehouse architectures, data warehouses and dimensional modelling.
- Experience with Git, CI/CD pipelines, automated testing and production support.
- Ability to translate business requirements into scalable and maintainable technical solutions.
Specialist Requirements – Performance Optimisation
- Deep expertise in SQL query tuning and distributed processing optimisation.
- Strong understanding of Spark execution, partitioning, caching, joins and resource configuration.
- Experience troubleshooting large-scale AWS data workloads.
- Knowledge of storage layouts, columnar file formats and efficient data-access patterns.
- Ability to balance performance, reliability, scalability and cloud expenditure.
Good-to-Have Skills
- Real-time and streaming data experience with Apache Kafka and/or Amazon Kinesis.
- Exposure to Generative AI concepts and tools, including:
- Amazon Bedrock
- LLM concepts
- Embeddings
- Vector databases
- Experience with Excel/CSV ingestion, template-driven ingestion and schema evolution handling.
Soft Skills
- Excellent communication, comprehension and articulation skills.
- Strong persuasion, negotiation and stakeholder-management abilities.
- Ability to inspire and mentor technical teams.
- Capable of working independently as a technical consultant for clients and engagements.
- Solid individual contributor mindset with ownership and accountability.
- Ability to mentor engineers on coding best practices and problem-solving techniques.
What We Offer
- Opportunities to participate in organisation-wide innovation and continuous improvement initiatives.
- Exposure to multiple products and projects across various ISVs.
- Fortnightly organisational sessions to understand business and functional directions.
- Opportunities to interact with leadership and colleagues across the organisation.
- Employee engagement activities, celebrations and team-building initiatives.
- Chimera Talks – a platform to share opinions and ideas beyond day-to-day work.
- Annual year-end bonuses.
- Hybrid working flexibility.
Important Note Candidates must be comfortable with the 2:00 PM – 11:00 PM IST shift and working from the Chimera Office 2–3 days per week.
The final interview round will be conducted face-to-face at the Chimera Office.
📌 Senior AWS Data Engineer (Bengaluru)
🏢 Ritwik IT Services
📍 Bengaluru