About HG HG Insights is the pioneer of Revenue Growth Intelligence. For more than a decade, we have delivered comprehensive, AI- driven datasets on B2B buyers, technology adoption, IT spend, and buyer intent, sourced from billions of data points.
Today, we are a trusted partner to Fortune 500 technology companies, hyperscalers, and innovative B2B vendors seeking precise go-to-market analytics and decision-making. Through an evolving suite of AI agents that incorporate first-party data and buyer signals, HG Insights enables AI-powered GTM automation across sales, marketing, RevOps, and data analytics teams, modernizing GTM execution from strategy through activation.
This is a senior individual contributor role on the team that builds and runs HG's data platform: everything between a raw vendor file landing in our lake and a finished dataset arriving in a customer's hands. It includes the transformation stack that turns messy external signals into product-grade company attributes, the matching systems that decide which company a piece of evidence belongs to and the internal applications our analysts use to curate and correct the result.
Own the architecture of the data platform end to end, and make the calls on build vs. Build the quality layer that catches silent failure:



contracts at every handoff, freshness and completeness monitoring, and pipelines that quarantine bad data rather than publish it.
Treat compute cost as a first-class engineering metric across Spark, orchestration, and the serving tier.
15+ years building production grade data engineering systems, with a minimum of 5 years in a staff or principal scope.
~ Robust SQL and dimensional modelling, and the judgment to know when to break the rules.
~ Experience with performant and scalable OLTP setups (MySQL/Postgres).
~ Proven experience in AWS ecosystems (EC2, S3, EMR).
~ Python/Scala/Java, with real software discipline: testing, CI/CD, code review, infrastructure as code is a plus.
~ Experience in Docker - Kubernetes, Terraform is a plus.
~ Experience in integrating AI first implementations in traditional data engineering setups will greatly help in shaping our future designs.
~ Experience with machine learning pipelines (Spark MLlib, Databricks ML) for predictive analytics.
~ Knowledge of data governance frameworks and compliance standards (GDPR, CCPA).

B2B firmographic, technographic or intent data; warehouse-to-lakehouse migration experience.

📌 Principal Data Engineer - Aws (Pune)
🏢 HG Insights
📍 Pune