01 Oct
|
Tata Consultancy Services
|
Tamil Nadu
01 Oct
Tata Consultancy Services
Tamil Nadu
Job Description
TCS Hiring for Azure Databricks, ADF, Pyspark, Python, Terraform
n
nExperience Range: - 06 To 10 Years (Mandatory)
n(Note: Candidates below 06 years of IT experience shall not be considered)
nJOB LOCATION: Chennai
n
nJOB DESCRIPTION
n
nKey Responsibilities:
n
n
- n
- Design and develop scalable data pipelines using Azure Data Factory (ADF) and Azure Databricks.n
- Build and optimize large-scale ETL/ELT processes using PySpark and Python.n
- Ingest data from various structured and unstructured sources into Azure Data Lake.n
- Develop batch and real-time data processing solutions.n
- Create reusable data transformation frameworks and data quality checks.n
- Implement Infrastructure as Code (IaC) using Terraform.n
- Manage Azure resources including Data Lake Storage, Key Vault, Databricks, ADF, and Monitoring services.n
- Optimize Spark jobs for performance, scalability, and cost efficiency.n
- Develop CI/CD pipelines for deployment automation.n
- Collaborate with business stakeholders, architects,
and development teams to define data requirements and solutions.n
- Support production deployments and troubleshoot data pipeline issues.n
- Follow data governance, security, and compliance standards.n
n
nRequired Technical Skills:
n
n1) Azure Services: Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage Gen2, Azure Key Vault, Azure Monitor, Azure DevOps
n2) Data Engineering: Robust expertise in ETL/ELT development, Data Warehousing concepts, Data Modeling (Star Schema, Snowflake Schema). Batch and Streaming Data Processing
n3) Programming: Python, PySpark, SQL
n4) Infrastructure as Code: Terraform, Azure Resource Management Concepts
n5) Databases: Azure SQL Database, SQL Server, PostgreSQL, Cosmos DB (Preferred)
n6)DevOps: Azure DevOps, Git, CI/CD Pipeline Implementation
n
nMandatory Skills:
n
n
- n
- Azure Databricksn
- Azure Data Factory (ADF)n
- PySparkn
- Pythonn
- Terraformn
- SQLn
- Az
📌 Azure Databricks, ADF, Pyspark, Python, Terraform (Tamil Nadu)
🏢 Tata Consultancy Services
📍 Tamil Nadu