Job DescriptionTCS Hiring for Azure Databricks
NExperience Range: - 06 To 10 Years (Mandatory)
N(Note: Candidates below 6 years of IT experience shall not be considered)
NJob Locations: Anywhere in India
NJOB DESCRIPTION
nMust-Have Skills:
N
n
Robust hands-on experience with Azure Databricks N
Expertise in Apache Spark (PySpark) and Spark SQL N
Robust programming skills in Python and SQL N
Experience with Delta Lake including ACID transactions and schema evolution N
Hands-on experience in ETL/ELT pipeline development N
Solid understanding ofLakehouse Architecture N
Experience building andmaintaining Medallion Architecture (Bronze, Silver, Gold) data layers N
Experience with batch and streaming data processing N
Experience with Azure Data Factory (ADF) and Azure Data Engineering ecosystem N
Strong understanding ofData Modeling and Analytics data structures N
Experience with Unity Catalog or Data Governance frameworks N
Experience in performance tuning, query optimization, partitioning, and caching N
Data Engineering experience N
Azure Databricks experience N
nGood-to-Have Skills:
N
n
Git, Azure DevOps, GitHub Actions N
CI/CD implementation and deployment automation N
Terraform (Infrastructure as Code) N
Docker and Kubernetes N
Airflown
Kafka or Azure Event Hub N
Power BI or Tableau N
Databricks Workflows and Job Orchestration N
Cluster Management and Optimization N
Experience with Delta Table features such as MERGE, UPSERT, and Time Travel N
BFSI domain experience N
nKey Responsibilities:
N
n
Design, develop, and optimize scalable batch and streaming data pipelines using Azure Databricks. N
Develop data processingframeworks using PySpark and Spark SQL. N
Implement Delta Lake-based storage solutions to ensure high reliability and data consistency. N
Build and maintain Bronze, Silver, and Gold data layers within a Lakehouse architecture. N
Ingest data f