04 Aug
|
Tata Consultancy Services
|
Pune
04 Aug
Tata Consultancy Services
Pune
Walk-in interview for Databricks Developer on 8th August 2026 Experience: 6-15 Years
Location: TCS-Sahyadri Park,Plot No. 2 & 3 ,Phase 3,Hinjewadi Rajiv Gandhi Infotech Park,Pune Key Responsibilities : Design & Develop Data Pipelines: Architect, develop, and maintain scalable data processing pipelines on Databricks, using Spark (PySpark/Scala) to ingest, transform, and aggregate large volumes of data from various sources.
Optimize Performance: Profile and optimize Spark jobs and Databricks clusters for efficient resource usage, low latency, and reliability, including implementing best practices like partitioning, caching, and optimized data formats (Parquet, Delta Lake).
Implement ETL Workflows: Create robust ETL/ELT workflows to ensure data quality and integrity, handling both batch processing and real-time streaming data using structured streaming and scheduling jobs via Databricks or external orchestrators.
Integrate & Collaborate: Work closely with data architects, data scientists, and business analysts to integrate data engineering solutions with analytics and machine learning models. Provide clean, curated data sets and support recent data requirements.
Ensure Security & Governance: Implement and uphold data security and governance standards within pipelines, including data encryption, access controls, and compliance with company policies and regulatory requirements.
Documentation & Mentorship: Document pipeline designs, transformation logic, and operational procedures. Mentor junior data engineers on best practices in big data development and maintain coding standards across projects.
📌 Databricks Developer (Pune)
🏢 Tata Consultancy Services
📍 Pune