Company:IT Services Organization

Key Skills: Azure Databricks, Databricks, Azure, Python, Spark

Roles and Responsibilities:

- Design and develop scalable batch and streaming data processing solutions using Spark and Python.
- Build, maintain, and enhance data pipelines and transformation workflows in Databricks and Azure Databricks.
- Develop data engineering solutions for high-volume datasets while ensuring data quality, reliability, and maintainability.
- Integrate data from multiple sources and implement robust ingestion, transformation, and validation workflows.
- Investigate pipeline issues, improve processing efficiency, and support production data workloads across Azure environments.

Skills Required:

- 6 - 9 years of relevant experience in big data engineering and cloud data platforms.




- Strong hands-on experience with Apache Spark and Python for data engineering and distributed data processing.
- Practical experience developing solutions on Microsoft Azure and Azure Databricks.
- Experience working with Databricks for data pipelines, transformations, and large-scale processing.
- Ability to design reliable data workflows and support scalable production data platforms.

Valuable to Have:
- Additional hands-on experience with Apache Spark-based data engineering solutions.

Education: Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.

📌 Big Data Engineer (Gurugram)
🏢 MyCareernet
📍 Gurugram