20 Aug
|
Dun & Bradstreet
|
Hyderabad
20 Aug
Dun & Bradstreet
Hyderabad
Shape the Future with Dun & Bradstreet
- We are seeking an experienced Senior Data Engineer to help build the next generation of our identity graph and data platform. This role is focused on designing, developing, and optimizing large-scale data pipelines and systems that ingest, process, and unify complex datasets from diverse sources (web, mobile, AdTech, government, and proprietary data).
Key Responsibilities:
- Design, build, and optimize scalable data pipelines and ETL/ELT workflows for large, complex datasets.
- Design and implement foundational data architecture supporting identity resolution and ID graph systems.
- Develop and enhance systems supporting identity resolution and ID graph construction (data ingestion, normalization, matching, and deduplication).
- Process and unify multi-source datasets (cookies, device IDs, behavioral data, third-party and proprietary data).
- Write efficient, testable, and maintainable code using Python and SQL for large-scale data processing.
- Optimize data models, queries, and storage strategies for performance, scalability,
and cost efficiency.
- Build and maintain data validation, monitoring, and alerting systems to ensure data quality and reliability.
- Troubleshoot, debug, and improve existing data pipelines and infrastructure.
- Take ownership of complex data problems end-to-end, from initial design through production deployment.
- Contribute to key technical decisions related to data architecture, scalability, and system design.
- Collaborate with data, platform, DevOps, and product teams to deliver scalable, production-ready solutions.
- Translate business and product requirements into practical, performant data solutions.
- Document data pipelines, systems, and workflows clearly.
- Continuously improve system performance, data quality, and pipeline resilience.
- Contribute to building current capabilities that improve how customers understand and leverage data insights.
Key Requirements:
- 5-8+ years of hands-on expe
📌 Senior Gcp Data Engineer (Hyderabad)
🏢 Dun & Bradstreet
📍 Hyderabad