Hi,

Role: Data Engineer
Location: Chennai(work from office)
Experience: 4-7 years

Role Summary:
Data Engineer to build and maintain scalable data pipelines on AWS using PySpark, SQL, and Python, supporting analytics use cases in the insurance domain.

Key Responsibilities:
• Build and maintain ETL/ELT pipelines (PySpark, SQL, Python)
• Develop batch & near real-time ingestion pipelines
• Implement incremental loads (CDC)
• Work with AWS: S3, Glue, EMR, Redshift, Athena
• Develop Airflow DAGs for orchestration
• Support CI/CD pipelines (CodeCommit/Bitbucket)
• Ensure data quality, validation, and monitoring
• Optimize Spark jobs and SQL queries
• Follow data governance and security practices




• Collaborate with business and analytics teams

Required Skills:
• Hands-on: PySpark/Spark, Python, SQL (intermediateadvanced)
• AWS (working knowledge):
S3, Glue, EMR, Redshift, Athena
Lambda, EC2, RDS/DynamoDB
• Experience with Airflow & data pipelines
• Understanding of Parquet/ORC, partitioning
• Strong problem-solving skills

Nice to Have:
• Exposure to Delta Lake / Iceberg / Hudi
• Basics of Kafka/Kinesis streaming
• Knowledge of data modeling
• Insurance domain exposure
• Secure career progression

📌 Data Engineer (Tamil Nadu)
🏢 Aelius Consultants Delhi
📍 Tamil Nadu