02 Oct
|
Affinity Global
|
Mumbai
02 Oct
Affinity Global
Mumbai
About Affinity
Affinity is pioneering recent frontiers in AdTech: developing solutions that push past today’s limits and open up new opportunities. We are a global AdTech company helping publishers discover better ways to monetize and enabling advertisers to reach the right audiences through new touchpoints. Operating across 10+ markets in Asia, the US, and Europe with a team of over 500 experts, we are building privacy-first ad infrastructure that opens up opportunities beyond the walled gardens.
Team Lead, Data Engineer
Work Location: Mumbai (Malad)
Experience: 10+ Years
About Role:
We are looking for a Sr. Data Engineer to join the Core Architecture team and take ownership of the data platform end-to-end — from schema design and data ingestion to processing, storage and serving.
The role will work across large-scale data systems involving Apache Spark, ClickHouse/MPP data stores, streaming pipelines, table formats and self-managed infrastructure. The ideal candidate should have strong hands-on experience building and tuning production data platforms where performance,
reliability and cost efficiency are critical.
This is a hands-on technical leadership role requiring someone who can make architecture and engineering decisions, troubleshoot complex data-platform performance issues, operate infrastructure at scale and mentor engineers.
Roles & Responsibility:
· Own the end-to-end data platform architecture covering schema design, ingestion, processing, storage and data serving.
· Design and develop highly scalable batch and streaming data pipelines using Apache Spark.
· Build, tune and optimise Spark jobs for performance, throughput, resource utilisation and reliability.
· Design and optimise ClickHouse or equivalent MPP/columnar data platforms for high-volume analytical workloads.
· Own table design, partitioning, sorting/indexing strategies, materialized views and query optimisation.
· Troubleshoot and optimise database performance including query plans, partitio
📌 Team Lead, Data Engineer (Mumbai)
🏢 Affinity Global
📍 Mumbai