09 Aug
|
Datronix Solutions
|
India
09 Aug
Datronix Solutions
India
We are seeking a Senior Databricks Data Engineer for a 12-month project with a financial services client , focused on migrating an on-prem Hadoop environment to Databricks . This is a hands-on Data Engineering role.
Start: Mid-September
Duration: 12 months
Remote: Must work U.S. Eastern Time business hours (4 pm -1 am IST) - non-negotiable
Responsibilities
- Migrate data, pipelines, and workloads from Hadoop/Hive/HDFS to Databricks .
- Build and migrate pipelines using Spark/PySpark, Python, SQL, and Delta Lake .
- Refactor Hadoop workloads as needed for Databricks.
- Perform data validation, performance tuning, and troubleshooting.
- Implement Databricks governance and engineering best practices.
Required Skills
- 6+ years of Data Engineering experience with strong hands-on Databricks experience (6+ years).
- Strong Spark/PySpark, Python, SQL, Delta Lake, Hadoop, Hive, and HDFS .
- Experience with Hadoop-to-Databricks/cloud migrations .
- Experience with newer Databricks capabilities such as Unity Catalog, Lakeflow Declarative Pipelines, Lakeflow Jobs/Workflows, Auto Loader, Liquid Clustering, Serverless Compute, and Databricks SQL .
- Robust communication skills and ability to work U.S. Eastern Time hours.
- Databricks certifications (list which ones)
Nice to Have
- Financial services/banking experience.
📌 Senior Databricks Data Engineer (India)
🏢 Datronix Solutions
📍 India