21 Nov
|
Wipro
|
Hyderabad
Role & responsibilities
About the Role
Highly skilled Senior Databricks Platform Engineer to help build and scale a next-generation data platform supporting analytics, AI, governance, and self-service data consumption. The role focuses on engineering reusable platform capabilities, enabling enterprise-scale governance, improving observability, and driving operational excellence across the Databricks ecosystem.
Key Responsibilities
Design and develop scalable data pipelines using Databricks, PySpark, SQL, and Delta Lake.
Build CDC, batch, and streaming ingestion frameworks for enterprise-scale workloads.
Implement and manage Medallion Architecture (Bronze, Silver, Gold).
Develop governance solutions using Unity Catalog, including row-level security, data masking, and fine-grained access controls.
Build and maintain Data Quality, Monitoring, and Observability frameworks.
Implement CI/CD pipelines using Databricks Asset Bundles (DABS), Git, and Infrastructure as Code.
Optimize Databricks clusters, SQL Warehouses, and workloads for performance and cost efficiency.
Enable self-service analytics through semantic layers, metric views, governed datasets, and certified data products.
Partner with platform, security, analytics, and business teams to drive adoption of Databricks capabilities.
Participate in architecture discussions, platform modernization initiatives, and stakeholder workshops.
Required Skills
Databricks & Lakehouse
Databricks Lakehouse Platform
Delta Lake
Unity Catalog
Databricks Workflows
Auto Loader
Structured Streaming
Databricks SQL
Data Engineering
PySpark
Advanced SQL
Data Modeling
ETL/ELT Frameworks
CDC Architectures
Real-Time Data Processing
Governance & Quality
Row-Level Security
Data Masking
Data Lineage
Data Quality Frameworks
Cloud & DevOps
AWS/ GCP / Azure
Git , CI/CD
Terraform (nice to have)
Preferred Skills (These are not a must, nice to have)
Scala
dbt
Kafka
Airflow
GenAI / AI Agents
Enterprise Observability Solutions
📌 Senior Databricks Platform Engineer Hyderabad
🏢 Wipro
📍 Hyderabad