Company Name: VARITE India Private Limited
About The Client:
An Indian multinational information technology (IT) consulting company headquartered in Noida, The company has offices in 52 countries and over 225,944 employees. The Client is a global IT services and consulting company that offers a wide range of services and products across various industries like IT Infrastructure Services, Cybersecurity Services, Cloud Services, Big Data and Analytics, Internet of Things (IoT) Solutions, Semiconductor Services and Enterprise Software Products.
About The Job:
- We are seeking a highly skilled Senior Data Engineer with expertise in Databricks, PySpark, Python, and Big Data technologies.
- The ideal candidate will have hands-on experience building scalable data platforms, developing high-performance data pipelines, and implementing up-to-date data architectures using Databricks Lakehouse. The role requires strong knowledge of Medallion Architecture, Unity Catalog, and enterprise data governance practices.
Essential Job Functions:
- Design, develop,
and maintain scalable data pipelines and ETL/ELT solutions.
- Build and optimize batch and streaming data processing solutions using PySpark and Databricks.
- Implement and manage Medallion Architecture (Bronze, Silver, Gold layers) for data transformation and consumption.
- Configure and manage Unity Catalog for centralized governance, access control, and data lineage.
- Develop robust data engineering solutions using Python and Spark frameworks.
- Optimize Databricks workloads for performance, scalability, and cost efficiency.
- Collaborate with data architects, analysts, data scientists, and business stakeholders to deliver high-quality data solutions.
- Ensure data quality, security, governance, and compliance across enterprise data platforms.
- Support Data Lake, Lakehouse, and Data Warehouse initiatives.
- Troubleshoot and resolve complex data engineering and performance issues.
Qualifications:
- Exp: 9-12 years
Requir
📌 Senior Data Engineer (India)
🏢 VARITE
📍 India