30 Oct
|
LogicHive®
|
Bengaluru
30 Oct
LogicHive®
Bengaluru
Job Title: Data Engineer – Databricks
Experience: 7+ Years
Location: Bangalore/ Pune/Chennai/Mysore
Employment Type: Full time
Job Description
LogicHive is currently recruiting an experienced Data Engineer with Databricks expertise.
We are looking for a hands-on Data Engineer with strong experience in building scalable data pipelines, processing large datasets, and developing reliable data integration solutions using Databricks and Apache Spark.
Key Responsibilities
Design, develop, and maintain scalable ETL/ELT data pipelines using Databricks.
Develop data processing solutions using PySpark, Python, and SQL.
Implement data ingestion and transformation workflows from multiple sources.
Work with Delta Lake and lakehouse architecture to manage structured and semi-structured data.
Build and maintain batch and streaming data processing pipelines.
Implement data quality checks, validation, and error-handling mechanisms.
Optimize Spark jobs, queries, and pipeline performance.
Collaborate with data architects, analysts, and BI developers.
Monitor pipeline execution and troubleshoot data processing issues.
Required Skills
7+ years of experience in data engineering.
Robust hands-on experience with Databricks and Apache Spark.
Proficiency in PySpark, Python, and SQL.
Experience with Delta Lake and data lake/lakehouse architecture.
Solid understanding of ETL/ELT processes and data integration.
Experience with cloud platforms such as Azure, AWS, or GCP.
Knowledge of data modelling, data quality, and performance optimization.
Experience with workflow orchestration and production pipeline support.
Preferred Qualifications
Experience with Databricks Workflows, Unity Catalog, and Delta Live Tables/Lakeflow.
Experience with Azure Data Factory, AWS Glue, or similar tools.
Knowledge of CI/CD, Git, and automated data pipeline deployment.
Experience with streaming technologies such as Kafka.
📌 Data Engineer – Databricks 7 Yoe Bengaluru
🏢 LogicHive®
📍 Bengaluru