10 Sep
|
Tata Consultancy Services
|
Bengaluru
10 Sep
Tata Consultancy Services
Bengaluru
TCS Hiring for Azure Databricks
Experience Range: - 06 To 10 Years (Mandatory)
(Note: Candidates below 6 years of IT experience shall not be considered)
Job Locations : Anywhere in India
Must-Have Skills:
- Strong hands-on experience with Azure Databricks - Expertise in Apache Spark (PySpark) and Spark SQL - Strong programming skills in Python and SQL - Experience with Delta Lake including ACID transactions and schema evolution - Hands-on experience in ETL/ELT pipeline development - Solid understanding of Lakehouse Architecture - Experience building and maintaining Medallion Architecture (Bronze, Silver, Gold) data layers - Experience with batch and streaming data processing - Experience with Azure Data Factory (ADF) and Azure Data Engineering ecosystem - Strong understanding of Data Modeling and Analytics data structures - Experience with Unity Catalog or Data Governance frameworks - Experience in performance tuning, query optimization, partitioning, and caching - Data Engineering experience - Azure Databricks experience
Good-to-Have Skills:
- Git, Azure DevOps, GitHub Actions - CI/CD implementation and deployment automation - Terraform (Infrastructure as Code) - Docker and Kubernetes - Airflow - Kafka or Azure Event Hub - Power BI or Tableau - Databricks Workflows and Job Orchestration - Cluster Management and Optimization - Experience with Delta Table features such as MERGE, UPSERT, and Time Travel - BFSI domain experience
Key Responsibilities
- Design, develop, and optimize scalable batch and streaming data pipelines using Azure Databricks. - Develop data processing frameworks using PySpark and Spark SQL. - Implement Delta Lake-based storage solutions to ensure high reliability and data consistency. - Build and maintain Bronze, Silver, and Gold data layers within a Lakehouse architecture. - Ingest data from APIs,
databases, Azure storage, and streaming platforms. - Develop scalable data models supporting analytics and reporting requirements. - Implement data quality, validation, and reconciliation processes. - Monitor and optimize Spark workloads for performance and cost efficiency. - Establish and support data governance practices through Unity Catalog and related solutions. - Orchestrate and integrate data workflows using Azure Data Factory, Airflow, and Databricks Workflows. - Collaborate with business and technical stakeholders to gather requirements and deliver enterprise-grade data solutions.
Minimum Qualification
15 years of Full Time Education
Interested candidates kindly share your updated resume to
[email protected] along with filling the following details to maximize your chances of getting calls from TCS. The details are as follows:
Section 1: Basic Details
- Candidate Name: - Email ID: - Phone Number: - Current Location (City): - Preferred Location (City):
Section 2: Educational Details
- Highest Regular Full‐Time Qualification - (Diploma / Graduation / Post Graduation / Others) - 10th Completion Year - 12th / Intermediate Completion Year - Graduation Completion Year - Post‐Graduation Completion Year (if applicable)
Section 3: Work Experience
- Current Company Name - Total Experience (in years) - Number of Companies Worked - Employment Timeline - (Example: Company A – 2021 to Present, Company B – 2019 to 2021)
Section 4: Compensation Details
- Current CTC (in LPA) - Expected CTC (in LPA) - Notice Period - (Immediate / 15 Days / 30 Days / 60+ Days)
Section 5: Documentation & Compliance (Yes / No):
- Valid ID Proof Available (Aadhar & Pan Card): (Yes/No) - Educational Documents Available: (Yes/No) - Employment Documents Available: (Yes/No) - UAN Number Available: (Yes/No)
📌 Azure Databricks (Pan India) (Bengaluru)
🏢 Tata Consultancy Services
📍 Bengaluru