01 Oct
|
Affinity Global
|
India
01 Oct
Affinity Global
India
About Affinity Affinity is pioneering new frontiers in AdTech: developing solutions that push past today’s limits and open up current opportunities. We are a global AdTech company helping publishers discover better ways to monetize and enabling advertisers to reach the right audiences through new touchpoints. Operating across 10 markets in Asia, the US, and Europe with a team of over 500 experts, we are building privacy-first ad infrastructure that opens up opportunities beyond the walled gardens. Team Lead, Data Engineer Work Location: Mumbai (Malad) Experience: 10 Years About Role: We are looking for a Sr. Data Engineer to join the Core Architecture team and take ownership of the data platform end-to-end — from schema design and data ingestion to processing, storage and serving. The role will work across large-scale data systems involving Apache Spark, ClickHouse/MPP data stores, streaming pipelines, table formats and self-managed infrastructure. The ideal candidate should have strong hands-on experience building and tuning production data platforms where performance,
reliability and cost efficiency are critical. This is a hands-on technical leadership role requiring someone who can make architecture and engineering decisions, troubleshoot complex data-platform performance issues, operate infrastructure at scale and mentor engineers. Roles & Responsibility: · Own the end-to-end data platform architecture covering schema design, ingestion, processing, storage and data serving. · Design and develop highly scalable batch and streaming data pipelines using Apache Spark. · Build, tune and optimise Spark jobs for performance, throughput, resource utilisation and reliability. · Design and optimise ClickHouse or equivalent MPP/columnar data platforms for high-volume analytical workloads. · Own table design, partitioning, sorting/indexing strategies, materialized views and query optimisation. · Troubleshoot and optimise database performance including query plans, partition pru
📌 Team Lead, Data Engineer (India)
🏢 Affinity Global
📍 India