About HG
HG Insights is the pioneer of Revenue Growth Intelligence. For more than a decade, we have delivered comprehensive, AI- driven datasets on B2B buyers, technology adoption, IT spend, and buyer intent, sourced from billions of data points.
Today, we are a trusted partner to Fortune 500 technology companies, hyperscalers, and innovative B2B vendors seeking exact go-to-market analytics and decision-making. Through an evolving suite of AI agents that incorporate first-party data and buyer signals, HG Insights enables AI-powered GTM automation across sales, marketing, RevOps, and data analytics teams, modernizing GTM execution from strategy through activation.

About the Role

You will be based in Pune, working with engineers at our Pune, US & Brazil locations.

What you'll do
- Own the architecture of the data platform end to end, and make the calls on build vs. buy, batch vs. incremental, and where each workload belongs.
- Build the quality layer that catches silent failure: contracts at every handoff, freshness and completeness monitoring,



and pipelines that quarantine bad data rather than publish it.
- Improve entity matching and attribution — and make match decisions explainable to the customers who depend on them.
- Make our release cycle boring. Recurring deliveries should not depend on people watching them.
- Treat compute cost as a first-class engineering metric across Spark, orchestration, and the serving tier.

What we are looking for
- 15+ years building production grade data engineering systems, with a minimum of 5 years in a staff or principal scope.
- Deep Spark and Databricks expertise at multi-terabyte scale, including the operational side of lakehouse table formats — merges, compaction, small files, schema evolution.
- Strong SQL and dimensional modelling, and the judgment to know when to break the rules.
- Experience with performant and scalable OLTP setups (MySQL/Postgres).
- Airflow orchestration (DAGs, operators, sensors) and integration w

📌 Principal Data Engineer (Pune)
🏢 HG Insights
📍 Pune