Lumiq - Senior Data Engineer - Spark/Python (India)

Lumiq - Senior Data Engineer - Spark/Python (India)

22 Aug
|
Lumiq
|
India

22 Aug

Lumiq

India

:

We are seeking a Senior Data Engineer to design, build, and maintain enterprise-grade Data Warehouses and Lakehouses on AWS. You will be responsible for architecting scalable batch and real-time streaming data pipelines, optimizing big data processing workloads, and ensuring high data reliability across the organization.

Key Responsibilities :

- Design, develop, and optimize robust data pipelines using Spark, Python, and SQL.
- Build and maintain real-time streaming architectures utilizing Apache Kafka.
- Orchestrate complex workflows using Apache Airflow.
- Architect and optimize cloud-native data warehouse and lakehouse solutions on AWS.
- Collaborate with cross-functional teams to deliver high-performance, enterprise-ready data platforms.

Required Experience & Skills :

- Big Data & Processing : Advanced proficiency in Apache Spark, Python, and SQL.
- Streaming : Hands-on experience with Apache Kafka and real-time streaming architectures.
- Cloud Platform : Robust expertise in the AWS Ecosystem (S3, Redshift, Glue, EMR, IAM).
- Orchestration : Proven experience building and managing DAGs in Apache Airflow.
- Data Architecture : Track record of building scalable Enterprise Data Warehouses and Lakehouse architectures.

Good to Have :





- Experience with EMR on EKS and Kubernetes container orchestration.
- Familiarity with AWS Lake Formation for governance and security management.
- Relevant AWS Certifications (e.g., AWS Certified Data Engineer - Associate/Specialty, AWS Certified Solutions Architect).

About LUMIQ :

LUMIQ | Where Data Alchemy Meets FSI Expertise.

LUMIQ is the #1 Data and Analytics company in the Financial Services and Insurance (FSI) space.

Some of the largest FSIs - insurers, banks, AMCs, and NBFCs - trust our products and expertise to solve their data challenges. Currently, 40 enterprises with $10 B in deposits/AUM, who collectively represent about 1B customers across the globe - work with LUMIQ to accelerate data-driven transformation.

LUMIQ builds next-gen data technology products that help FSI enterprises organize, manage, and productize data effectively. With deep expertise across data engineering, data science, AI ML, and Cloud - LUMIQ's approach has often challenged the existing status quo - with many firsts. For ex : - Our teams built the first regulated data lake in India & Asia (2018).

📌 Lumiq - Senior Data Engineer - Spark/Python (India)
🏢 Lumiq
📍 India

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: lumiq - senior data engineer - spark/python (india) / india

Subscribe to this job alert:

Get the latest job offers by email for: lumiq - senior data engineer - spark/python (india) / india