The Principal Data Platform Engineer is a member of the Data & Analytics (D&A;) Platform and Architecture team responsible for the design, development, testing, maintenance, and support of CSC's Enterprise Data Platform.
Working on a dedicated scrum team, the Principal Data Platform Engineer will provide technical and architectural design, as well as development and analytical support for CSC's D&A; platform.
The Principal Data Platform Engineer must have demonstrable big data experience with cloud computing in order to help the D&A; team deliver high-quality, first-class reporting to customers. A skillset that includes data architecture and system design is a must.
Your Responsibilities :
- Driving technical vision and architecture for the enterprise data platform, collaborating closely with HQ architects and engineering leads.
- Lead the design, development, and maintenance of scalable data platforms using Databricks, Data Lake, Data Factory, and Data Warehouse.
- Defining and implementing integration patterns across ingestion, transformation, and consumption layers.
- Architect and implement advanced CI/CD pipelines using GitHub and Terraform.
- Identifying performance bottlenecks and leading query and pipeline optimization.
Required :
- 8 years of experience in data engineering or data platform roles, with at least 5 years designing and building big data systems in a cloud workplace (Azure preferred).
- Deep expertise in Python, automated testing, Github actions related to infrastructure development.
- Hands-on experience with Databricks, including Delta Lake, Unity Catalog, and medallion architecture patterns.
- Experience with Azure Data Factory or comparable orchestration tooling.
- In-depth knowledge of Azure Key Vault and security best practices.
- Experience with Unity Catalog and managing multiple workspaces.
- Experience with CI/CD design and infrastructure-as-code practices (Terraform or equivalent).
Preferred :
- Experience with enterprise data governance tools (Collibra or equivalent).
- Exposure to enterprise scheduling/orchestration platforms (e.g., Tidal).
- Familiarity with Power BI or comparable BI platforms at the platform/infrastructure layer.
📌 Wipro - Databricks Architect (India)
🏢 Wipro
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.