Job DescriptionTCS Hiring for Azure Databricks
NExperience Range: - 06 To 10 Years (Mandatory)
N(Note: Candidates below 6 years of IT experience shall not be considered)
NJob Locations: Anywhere in India
NJOB DESCRIPTION
nMust-Have Skills:
N
- n
- Strong hands-on experience with Azure Databricks N
- Expertise in Apache Spark (PySpark) and Spark SQL N
- Robust programming skills in Python and SQL N
- Experience with Delta Lake including ACID transactions and schema evolution N
- Hands-on experience in ETL/ELT pipeline development N
- Strong understanding ofLakehouse Architecture N
- Experience building andmaintaining Medallion Architecture (Bronze, Silver, Gold) data layers N
- Experience with batch and streaming data processing N
- Experience with Azure Data Factory (ADF) and Azure Data Engineering ecosystem N
- Strong understanding ofData Modeling and Analytics data structures N
- Experience with Unity Catalog or Data Governance frameworks N
- Experience in performance tuning, query optimization, partitioning, and caching N
- Data Engineering experience N
- Azure Databricks experience N
nGood-to-Have Skills:
N
- n
- Git, Azure DevOps, GitHub Actions N
- CI/CD implementation and deployment automation N
- Terraform (Infrastructure as Code) N
- Docker and Kubernetes N
- Airflown
- Kafka or Azure Event Hub N
- Power BI or Tableau N
- Databricks Workflows and Job Orchestration N
- Cluster Management and Optimization N
- Experience with Delta Table features such as MERGE, UPSERT, and Time Travel N
- BFSI domain experience N
nKey Responsibilities:
N
- n
- Design, develop, and optimize scalable batch and streaming data pipelines using Azure Databricks. N
- Develop data processingframeworks using PySpark and Spark SQL. N
- Implement Delta Lake-based storage solutions to ensure high reliability and data consistency. N
- Build and maintain Bronze, Silver, and Gold data layers within a Lakehouse architecture. N
- Ingest data f