Senior Data Platform Engineer
As a Senior Data Platform Engineer, you will drive the architectural execution of the Data platform. You will take ownership of the system's scalability and consistency, ensuring the Operational Data Store functions as a reliable, highly available operational source for all global Master Data. You will act as a technical leader, mentoring the engineering team and collaborating with cross-functional integration teams to ensure seamless data flow.
Expanded Responsibilities
- Platform Architecture & Management: Architect and maintain mission-critical data lake and warehouse environments on Google Cloud Platform (GCP), utilizing services such as BigQuery, Pub/Sub, and Cloud Storage.
- Infrastructure & Deployment: Design, deploy, and manage robust, scalable infrastructure using Terraform to ensure environmental consistency across all deployment stages.
- Data Pipeline Engineering: Engineer high-performance, distributed data pipelines for real-time and batch streaming using technologies like Dataflow and Kafka. Lead workflow orchestration by designing,
deploying, and monitoring complex Directed Acyclic Graphs (DAGs) in Apache Airflow (Cloud Composer).
- Software Development: Develop custom backend tooling, internal APIs, and microservices in Golang and Python to enhance platform capabilities.
- Data Governance & Modelling: Manage the end-to-end data warehouse lifecycle, employing dbt (Data Build Tool) for clean, documented, and tested data models.
- DevOps & Reliability: Drive DevOps and Site Reliability Engineering (SRE) practices, owning CI/CD pipelines and utilizing Docker for seamless, highly reliable deployments. Optimize and architect diverse database engines (SQL and NoSQL), focusing on performance tuning, schema design, and security.
- Database Management: Architect and optimize various database engines (SQL and NoSQL), focusing on performance tuning, schema design, and security.
Technical Profile Additions
- Programming - Advanced
📌 Data Platform engineer (Pune)
🏢 TVH
📍 Pune