Databricks Architect (Noida)

Databricks Architect (Noida)

16 Nov
|
Genpact
|
Noida

16 Nov

Genpact

Noida

Data Architect - Azure Databricks

Focus: Azure Databricks Architecture, ETL Design, Migration from AWS Databricks

About the Role

We are migrating from our data platform on AWS to Azure. As the Data Architect for Azure Databricks, you will create & own the architecture, design, and technical solutions of all ETL workloads running migrating from AWS to Azure Databricks.

This is a hands-on architecture role. You will design scalable Spark pipelines, define governance with Unity Catalog, and execute the migration from AWS Databricks to Azure Databricks.

Key Responsibilities:

- Migration Strategy: Define and execute the migration from AWS Databricks to Azure Databricks, including refactoring & re-architecting notebooks, jobs, and Delta tables.
- Databricks Architecture: Design Lakehouse architecture using Delta Lake, Unity Catalog, and Databricks Workflows. Define best practices for cluster configuration, autoscaling, and cost optimization.
- ETL Design: Architect complex ETL pipelines using PySpark, Spark SQL, and Delta Live Tables (DLT). Ensure data quality, error handling, and performance.
- Governance & Security: Implement Unity Catalog for fine-grained access control, lineage, and auditing. Ensure compliance with enterprise security standards.
- Integration with MS Fabric:



Define how Databricks Delta tables will be exposed to MS Fabric (via OneLake shortcuts, Delta sharing, or data writes to Fabric Lakehouse).
- Technical Leadership: Mentor data engineers, conduct code reviews, and act as the Databricks technical authority.

Required Skills & Experience

- Databricks Expertise: 10+ years in Big Data engineering with 5+ years specifically in Azure Databricks. Expert knowledge of Spark internals, Delta Lake, and Unity Catalog.
- Migration Experience: Proven track record of migrating Databricks workloads from AWS to Azure.
- ETL: Deep experience building ETL with PySpark, Spark SQL, and Delta Live Tables.
- Azure Data Services Experience: Hands-on on Azure Data Factory, Azure Databricks, ADLS, Azure Event Hubs, IoT Hubs, or Azure Stream Analytics
- Cloud Infrastructure: Solid understanding of Azure networking (VNETs, Private Endpoints), IAM, and cost management.
- Programming: hands-on in Python, PySpark, and SQL.
- Implement enterprise-grade security including Role-Based Access Control (RBAC), row/column-level security, Azure Key Vault integration, and data encryption (at rest and in transit).

Preferred Certification - Databricks Certified Data Engineer Professional or Architect certification

📌 Databricks Architect (Noida)
🏢 Genpact
📍 Noida

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: databricks architect (noida) / noida