Role: Data Engineer

Primary Skills: Databricks, SQL

Secondary Skills: Databricks, PySpark

Experience Required: 6+ Years

Relevant Experience: 6+ Years

Job Summary

We are looking for an experienced Data Engineer with solid expertise in Databricks, SQL, and data engineering concepts to design, develop, and maintain scalable data pipelines and data processing solutions. The ideal candidate should have hands-on experience with large-scale data processing, ETL/ELT development, data transformation, and cloud-based data platforms.

Key Responsibilities
Design, develop, and maintain scalable data pipelines using Databricks and PySpark.
Write complex SQL queries, optimize query performance, and perform data transformations.
Develop and maintain ETL/ELT workflows for processing large volumes of structured and semi-structured data.
Work with Delta Lake, Spark SQL, and Databricks notebooks.
Implement data quality checks, validation rules, and error-handling mechanisms.
Optimize Spark jobs and SQL queries to improve performance and reduce processing costs.
Collaborate with business analysts, data architects, and other engineering teams to understand data requirements.
Troubleshoot data pipeline failures and resolve production issues.
Follow best practices for data governance, security,



monitoring, and documentation.
Participate in code reviews, deployment activities, and Agile development processes.

Required Skills
6+ years of experience in data engineering or a related field.
Robust hands-on experience with Databricks.
Excellent SQL skills, including complex joins, CTEs, window functions, aggregations, and query optimization.
Experience with PySpark and Apache Spark for distributed data processing.
Positive understanding of ETL/ELT concepts and data warehousing.
Experience working with Delta Lake and incremental data processing.
Knowledge of data modeling, performance tuning, and pipeline optimization.
Experience with Git, CI/CD, and production support.

Preferred Skills
Experience with cloud platforms such as Azure, AWS, or GCP.
Knowledge of Azure Data Factory, AWS Glue, or similar orchestration tools.
Familiarity with Databricks Workflows, Unity Catalog, and Lakehouse architecture.
Experience with data governance, access controls, and data quality frameworks.
Understanding of Agile/Scrum methodologies.

Education

Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.

📌 Data Engineer Sql, Data Brick, Data Warehouse 6 Year+ Noida /pune / Bangalore Only Immediate Joiner
🏢 Innova ESI
📍 Pune