Key Responsibilities
Design, develop, and maintain scalable data processing applications using Python, PySpark, and Spark.
Develop and optimize data pipelines and workflows on Databricks.
Collaborate with data engineers, data scientists, business stakeholders, and other technical teams to understand requirements and deliver high-quality solutions.
Ensure data integrity, quality, performance, and reliability across data processing pipelines.
Write clean, maintainable, scalable, and efficient code following established coding standards and best practices.
Perform data analysis and implement appropriate data validation and quality checks.
Monitor, troubleshoot, and optimize performance issues across data workflows and pipelines.
Work with relational databases and develop effective SQL queries for data extraction and transformation.
Participate in code reviews, testing, deployment, and continuous improvement of data engineering solutions.




Use Git/version control and follow established software development and deployment practices.

Required Skills & Qualifications
Bachelors or Master’s degree in Computer Science, Engineering, Information Technology, or a related field.
Proven experience as a Databricks Developer, Data Engineer, or similar role.
Robust hands-on expertise in Apache Spark and PySpark.
Robust programming skills in Python; experience with Scala is an advantage.
Strong proficiency in SQL and hands-on experience with relational databases.
Practical experience developing and optimizing data pipelines and data processing applications.
Familiarity with Git and version control systems.
Solid understanding of data engineering concepts, data transformation, and data validation.
Excellent analytical and problem-solving skills.
Robust communication and collaboration skills, with the ability to work effectively with cross-functional teams.

📌 Data Engineer Bengaluru
🏢 Minivel Services
📍 Bengaluru