12 Nov
|
Pradha Solutions
|
Bengaluru
12 Nov
Pradha Solutions
Bengaluru
Experience: 4+ Years
Job Type: Full-Time
Location: Bangalore
Work Mode: Hybrid
Company: Pradha Solutions Pvt Ltd
Job Description
We are looking for an experienced Databricks Developer with robust expertise in data engineering, cloud technologies, and big data processing. The ideal candidate should have hands-on experience developing, optimising, and maintaining scalable data pipelines using Databricks and Apache Spark.
Key Responsibilities
Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark.
Build and optimise ETL/ELT workflows for large-scale data processing.
Work with PySpark, Python, and SQL for data transformation and processing.
Develop and manage Databricks notebooks, jobs, and workflows.
Implement data integration solutions using Azure Data Factory or other cloud-based services.
Work with Delta Lake, Delta Live Tables, and Lakehouse architecture.
Ensure data quality, reliability, performance, and security.
Collaborate with cross-functional teams to understand business requirements and deliver data solutions.
Required Skills
4+ years of experience in Data Engineering / Databricks Development.
Solid hands-on experience with Databricks, Apache Spark, and PySpark.
Proficiency in Python and SQL.
Experience with ETL/ELT development and data pipeline optimisation.
Knowledge of Delta Lake and Lakehouse architecture.
Experience working with cloud platforms (Azure / AWS / GCP).
Understanding of data warehousing concepts and distributed computing.
Good problem-solving, analytical, and communication skills.
Positive to Have
Experience with Azure Data Factory, Azure Data Lake Storage, or AWS services.
Knowledge of CI/CD pipelines and Git.
Experience with Unity Catalog and data governance.
Relevant Databricks certifications.
📌 Databricks Developer Bengaluru
🏢 Pradha Solutions
📍 Bengaluru