Lead I - Data Engineering (Databricks (workspace administration, Delta Lake, Photon) (Bengaluru)

Lead I - Data Engineering (Databricks (workspace administration, Delta Lake, Photon) (Bengaluru)

16 Aug
|
UST
|
Bengaluru

16 Aug

UST

Bengaluru

Role Description

Data Platform Engineer Merger & Migration Responsibilities Hands-on Migration: Execute the moving of data assets, schemas, tables, and notebooks from the source tenant to the target workplace.

Pipeline Updates: Update and test data pipelines, changing storage paths, API endpoints, and connection strings to match the new unified architecture.

Workspace Setup: Use Terraform and platform APIs to spin up new, unified workspaces, clusters, and warehouses according to the new company standards.

Permissions Mapping: Recreate and map user groups, access permissions, and roles from the old systems into the new centralized governance model. Monitoring & Validation: Run data validation tests and monitor migration logs to ensure zero data loss or downtime during cutovers.

Technical Requirements Cloud Foundations: Solid hands-on experience using AWS (S3, IAM, EC2, Lambda) in a multi-account setup.





Platform Experience: Practical administration experience with Databricks (clusters, notebooks, jobs) OR Snowflake (warehouses, roles, storage integration).

Automation Tools: Comfortable using Terraform for provisioning infrastructure and Git/CI/CD for deployment pipelines.

Core Coding: Proficient in Python and SQL for writing tests, scripting automation tasks, and verifying data structures.

Experience and Qualifications 2-4 years of experience working in Data Engineering, Platform Operations, or Cloud Operations. Strong troubleshooting skills and the ability to work collaboratively to solve migration roadblocks.

Skills

Snowflake, AWS, AWS IAM, RBAC, SQL, Data Validation, Production Support, CI/CD

📌 Lead I - Data Engineering (Databricks (workspace administration, Delta Lake, Photon) (Bengaluru)
🏢 UST
📍 Bengaluru

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: lead i - data engineering (databricks (workspace administration, delta lake, photon) (bengaluru) / bengaluru

Subscribe to this job alert:

Get the latest job offers by email for: lead i - data engineering (databricks (workspace administration, delta lake, photon) (bengaluru) / bengaluru