Company Name: VARITE India Private Limited
About The Client
An Indian multinational information technology (IT) consulting company headquartered in Noida, The company has offices in 52 countries and over 225,944 employees. The Client is a global IT services and consulting company that offers a wide range of services and products across various industries like IT Infrastructure Services, Cybersecurity Services, Cloud Services, Big Data and Analytics, Internet of Things (IoT) Solutions, Semiconductor Services and Enterprise Software Products.
About The Job:
- We are seeking a highly skilled Senior Data Engineer with expertise in Databricks, PySpark, Python, and Big Data technologies.
- The ideal candidate will have hands-on experience building scalable data platforms, developing high-performance data pipelines, and implementing modern data architectures using Databricks Lakehouse. The role requires strong knowledge of Medallion Architecture, Unity Catalog, and enterprise data governance practices.
Essential Job Functions:
- Design, develop, and maintain scalable data pipelines and ETL/ELT solutions.
- Build and optimize batch and streaming data processing solutions using PySpark and Databricks.
- Implement and manage Medallion Architecture (Bronze, Silver, Gold layers) for data transformation and consumption.
- Configure and manage Unity Catalog for centralized governance, access control, and data lineage.
- Develop robust data engineering solutions using Python and Spark frameworks.
- Optimize Databricks workloads for performance, scalability, and cost efficiency.
- Collaborate with data architects,
analysts, data scientists, and business stakeholders to deliver high-quality data solutions.
- Ensure data quality, security, governance, and compliance across enterprise data platforms.
- Support Data Lake, Lakehouse, and Data Warehouse initiatives.
- Troubleshoot and resolve complex data engineering and performance issues.
Qualifications
- Exp: 9-12 years
Required Skills &
Qualifications
- Strong hands-on experience with Databricks and Databricks Lakehouse Platform.
- Expert-level proficiency in Python programming.
- Deep expertise in PySpark and distributed data processing.
- Strong understanding of Big Data concepts and modern data architectures.
- Good understanding and practical implementation experience of Medallion Architecture (Bronze, Silver, Gold layers).
- Experience working with Unity Catalog for data governance, security, access management, and lineage tracking.
- Strong knowledge of Apache Spark performance tuning and optimization.
- Experience in designing and building scalable ETL/ELT pipelines.
- Hands-on experience with Delta Lake and Lakehouse architecture.
- Experience with cloud platforms such as Azure, AWS, or GCP.
- Strong analytical, problem-solving,
and communication skills.
How to Apply: Interested candidates are encouraged to respond/submit their updated resumes, and for additional job opportunities, please visit Jobs In India – VARITE.
Unlock Rewards: Refer Candidates and Earn.
If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the referred candidate completes a three-month assignment with VARITE.
Experience Level Bonus Referral:
0-2 years
INR 5,000
2-6 years
INR 7,500
6+ years
INR 10,000
About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.
Equal Opportunity Employer:
VARITE is an equal prospect employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.
📌 Senior Data Engineer (Databricks, PySpark & Python) (India)
🏢 VARITE
📍 India