We are seeking an experienced Principal Data Engineer to help build the next generation of our identity graph and data platform. This role is focused on designing, developing, and optimizing large-scale data pipelines and systems that ingest, process, and unify complex datasets from diverse sources (web, mobile, AdTech, government, and proprietary data). This is a highly hands-on, technical role for someone who can quickly understand existing systems, operate independently, and deliver high-quality solutions at scale. The ideal candidate is deeply analytical, detail-oriented, and experienced with building performant data pipelines and systems handling billions of records.
n

Key Responsibilities:
Design, build, and optimize scalable data pipelines and ETL/ELT workflows for large, complex datasets.
Design and implement foundational data architecture supporting identity resolution and ID graph systems.
Develop and enhance systems supporting identity resolution and ID graph construction (data ingestion, normalization, matching, and deduplication).




Process and unify multi-source datasets (cookies, device IDs, behavioral data, third-party and proprietary data).
Write effective, testable, and maintainable code using Python and SQL for large-scale data processing.
Optimize data models, queries, and storage strategies for performance, scalability, and cost efficiency.
Build and maintain data validation, monitoring, and alerting systems to ensure data quality and reliability.
Troubleshoot, debug, and improve existing data pipelines and infrastructure.
Own and drive complex data problems end-to-end, from initial design through production deployment.
Make and influence key technical decisions related to data architecture, scalability, and system design.
Collaborate with data, platform, DevOps, and product teams to deliver scalable, production-ready solutions.
Translate business and product requirements into practical, performant data solutions.
Document data pipelines, system

📌 Principal Data Engineer (Hyderabad)
🏢 Dun & Bradstreet
📍 Hyderabad