Senior Data Engineer
Experience: 9+ years overall IT experience (minimum 5 years in required tech skills)
Location: Pan India (Virtusa locations)
Budget: 2.4 Lakhs per month
Domain Experience: Healthcare experience required (solid understanding of healthcare Finance systems)
Technical Skills:
Solid experience in Python Scripting and PySpark for data processing
Proficiency in SQL for big data processing
Proven experience in data processing for data lakes in Iceberg format, with a solid understanding of the architecture
Experience with AWS Glue jobs
Experience with the AWS cloud platform and its data services (S3, Redshift, Lambda, EMR, Airflow, Postgres, SNS, Event Bridge)
Expertise in BASH/Shell scripting
Responsibilities:
Lead the development of large-scale data pipelines and architectures.
Design, construct, and test data architectures aligned with business requirements.
Provide technical leadership, collaborate with business units, and ensure the technical quality of solutions.
Align data architecture to the Healthfirst solution architecture.