Experience: 7 - 10 Yrs

Location: Bangalore, Hyderabad & Pune

Work Mode: Hybrid - 8 days in a month

Mandatory Skills: Databricks, Python, PySpark, SQL, ETL, Scala / Kafka, Devops, CI/CD and Azure Cloud.

Responsibilities:
Lead the design, development, and implementation of data engineering solutions utilizing Databricks.
Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and transform business needs into technical solutions.
Oversee the integration of various data sources and systems, ensuring data quality, consistency, and accessibility.
Implement DevOps practices for continuous integration and deployment, optimizing the data engineering pipeline.
Mentor and guide junior data engineers, promoting best practices in data management and engineering methodologies.
Monitor and troubleshoot data infrastructure for performance optimization and reliability.




Stay current with industry trends and emerging technologies to drive innovation within the data engineering team.
Ensure adherence to security and compliance standards across all data projects.

Qualifications:
Bachelor's degree in computer science, Engineering, or a related field; master's degree preferred.
Minimum of 7 years of experience in data engineering, with extensive experience in Databricks and cloud platforms.
Solid knowledge of data pipeline architectures and ETL/ELT processes.
Proven experience with DevOps tools and practices, including CI/CD methodologies.
Proficiency in programming languages such as Python or Scala.
Experience with big data technologies, such as Spark, Kafka, or similar frameworks.
Excellent problem-solving skills and ability to work in a rapid-paced setting.
Exceptional communication and leadership skills, with the ability to collaborate effectively with diverse teams.

📌 Senior Azure Data Engineer Bengaluru
🏢 VIDPRO CONSULTANCY SERVICES
📍 Bengaluru