Senior Principal Data Engineer

This role has been designed as Hybrid with an expectation that you will work on average 2 days per week from an HPE office.

About the Role

We are looking for a highly skilled Senior Principal Data Engineer with strong architectural expertise to design and evolve our next-generation data platform. You will help to define the technical vision, build scalable and reliable data systems, and guide the long-term architecture that powers analytics, operational decision-making, and data-driven products across the organization.

This role is both strategic and hands-on . You will evaluate modern data technologies, define engineering best practices, and lead the implementation of robust, high-performance data solutions including the design, build, and lifecycle management of data pipelines that support batch, streaming, and near-real-time workloads.

What You ll Do

Architecture Strategy

- Own the architecture direction of our data platform, ensuring scalability, performance, reliability, cost efficiency, and security.
- Define standards and best practices for data modeling, transformation, orchestration, governance, and lifecycle management.
- Evaluate and integrate modern data technologies and frameworks that align with our long-term platform strategy.
- Collaborate with engineering and product leadership to shape the technical roadmap.

Engineering Delivery

- Design, build, and manage scalable, resilient data pipelines for batch, streaming, and event-driven workloads.
- Develop clean, high-quality data models and schemas to support analytics, BI, operational systems, and ML workflows.
- Implement data quality, lineage, observability, and automated testing frameworks.
- Build ingestion patterns for APIs, event streams, files, and third-party data sources.
- Optimize compute, storage, and transformation layers for performance and cost efficiency.

Leadership Collaboration





- Serve as the senior technical leader and mentor within the data engineering team.
- Lead architecture reviews, design discussions, and cross-team engineering initiatives.
- Work closely with analysts, data scientists, software engineers, and product owners to define and deliver data solutions.
- Communicate architectural decisions and trade-offs to technical and non-technical stakeholders.

What you need to bring:

- 12+ years of experience in Data Engineering, with demonstrated architectural ownership.
- Expert-level experience with Snowflake ( Or Simmilar DWH tools) , including performance optimization, data modeling, security, and ecosystem components.
- Expert proficiency in SQL and strong Python skills for pipeline development and automation.
- Experience with contemporary orchestration and workflow tools (Spark, DBT, Airflow, Dagster, Prefect, or equivalent).
- Strong understanding of ELT/ETL patterns, distributed processing, and data lifecycle management.
- Expertise with streaming/event technologies (Kafka, Kinesis, Pub/Sub, etc.).
- Experience with machine learning pipelines, feature stores, or MLOps.
- Experience implementing data quality, observability, and lineage solutions.
- Solid understanding of cloud infrastructure (AWS, GCP, or Azure).
- Strong background in DataOps practices: CI/CD, testing, version control, automation.
- Background designing systems for high scale, security, or regulated environments
- Proven leadership in driving architectural direction and mentoring engineering teams.

Nice to Have

- Experience with data governance or metadata management tools.
- Experience with compliance and data certification processes
- Experience with Terraform, CloudFormation, or other IaC tools.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 Senior Principal Data Engineer (Karnataka)
🏢 Hewlett Packard Enterprise
📍 Karnataka