Please share the resume to
[email protected]
Key Responsibilities
- Design and develop scalable data pipelines using Databricks, PySpark, SQL, and Delta Lake.
- Build CDC, batch, and streaming ingestion frameworks for enterprise-scale workloads.
- Implement and manage Medallion Architecture (Bronze, Silver, Gold).
- Develop governance solutions using Unity Catalog, including row-level security, data masking, and fine-grained access controls.
- Build and maintain Data Quality, Monitoring, and Observability frameworks.
- Implement CI/CD pipelines using Databricks Asset Bundles (DABS), Git, and Infrastructure as Code.
- Optimize Databricks clusters, SQL Warehouses, and workloads for performance and cost efficiency.
- Enable self-service analytics through semantic layers, metric views, governed datasets, and certified data products.
- Partner with platform, security,
analytics, and business teams to drive adoption of Databricks capabilities.
- Participate in architecture discussions, platform modernization initiatives, and stakeholder workshops.
Required Skills
Databricks & Lakehouse
- Databricks Lakehouse Platform
- Delta Lake
- Unity Catalog
- Databricks Workflows
- Auto Loader
- Structured Streaming
- Databricks SQL
Data Engineering
- PySpark
- Advanced SQL
- Data Modeling
- ETL/ELT Frameworks
- CDC Architectures
- Real-Time Data Processing
Governance & Quality
- Row-Level Security
- Data Masking
- Data Lineage
- Data Quality Frameworks
Cloud & DevOps
- AWS/ GCP / Azure
- Git , CI/CD
- Terraform (nice to have)
📌 Senior Databricks Platform Engineer (Hyderabad)
🏢 Wipro
📍 Hyderabad