06 Sep
|
Sparix Global
|
India
06 Sep
Sparix Global
India
Job Description – Databricks Data Engineer (L3)
Position: Databricks Data Engineer (L3)
Location: Kolkata (Work from Office / Hybrid as per business requirement)
Experience: 5–8 Years
Qualification: BE / B.Tech (Mandatory)
Notice Period: Immediate Joiners Preferred
Interview Process:
-
Round 1: Virtual Technical Interview
-
Final Round: Face-to-Face Interview (11th July)
Job Summary
We are seeking an experienced Databricks Data Engineer with strong expertise in building scalable data pipelines, data warehousing, and cloud-based data platforms. The ideal candidate should have hands-on experience with Databricks, Apache Spark, SQL, and contemporary data engineering practices. Candidates from reputed product companies, consulting firms, or large enterprise organizations will be preferred.
Key Responsibilities
-
Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark.
-
Build and optimize ETL/ELT processes for large-scale structured and unstructured datasets.
-
Develop data transformation workflows using PySpark and SQL.
-
Work closely with business stakeholders, data scientists, and analytics teams to deliver high-quality data solutions.
-
Implement data quality, governance, and security best practices.
-
Optimize Databricks jobs for performance, scalability, and cost efficiency.
-
Integrate data from multiple sources including databases, APIs, cloud storage, and enterprise applications.
-
Monitor, troubleshoot, and support production data pipelines.
-
Participate in architecture discussions and contribute to data platform modernization initiatives.
Required Skills
Mandatory Skills
-
Databricks
-
Apache Spark
-
PySpark
-
SQL
-
Data Engineering
-
ETL / ELT Development
-
Data Warehousing Concepts
-
Python
Preferred Skills
-
Azure Databricks / AWS Databricks
-
Delta Lake
-
Azure Data Factory (ADF)
-
Azure Data Lake Storage (ADLS)
-
AWS S3
-
Airflow
-
Kafka
-
CI/CD Pipelines
-
Git
Desired Candidate Profile
📌 Azure Databricks Data Engineer (India)
🏢 Sparix Global
📍 India