Azure Databricks, ADF, Pyspark, Python, Terraform (Tamil Nadu)

Azure Databricks, ADF, Pyspark, Python, Terraform (Tamil Nadu)

01 Oct
|
Tata Consultancy Services
|
Tamil Nadu

01 Oct

Tata Consultancy Services

Tamil Nadu

Job Description
TCS Hiring for Azure Databricks, ADF, Pyspark, Python, Terraform
n

nExperience Range: - 06 To 10 Years (Mandatory)
n(Note: Candidates below 06 years of IT experience shall not be considered)
nJOB LOCATION: Chennai
n

nJOB DESCRIPTION
n

nKey Responsibilities:
n

n
- n
- Design and develop scalable data pipelines using Azure Data Factory (ADF) and Azure Databricks.n
- Build and optimize large-scale ETL/ELT processes using PySpark and Python.n
- Ingest data from various structured and unstructured sources into Azure Data Lake.n
- Develop batch and real-time data processing solutions.n
- Create reusable data transformation frameworks and data quality checks.n
- Implement Infrastructure as Code (IaC) using Terraform.n
- Manage Azure resources including Data Lake Storage, Key Vault, Databricks, ADF, and Monitoring services.n
- Optimize Spark jobs for performance, scalability, and cost efficiency.n
- Develop CI/CD pipelines for deployment automation.n
- Collaborate with business stakeholders, architects,



and development teams to define data requirements and solutions.n
- Support production deployments and troubleshoot data pipeline issues.n
- Follow data governance, security, and compliance standards.n

n

nRequired Technical Skills:
n

n1) Azure Services: Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage Gen2, Azure Key Vault, Azure Monitor, Azure DevOps
n2) Data Engineering: Robust expertise in ETL/ELT development, Data Warehousing concepts, Data Modeling (Star Schema, Snowflake Schema). Batch and Streaming Data Processing
n3) Programming: Python, PySpark, SQL
n4) Infrastructure as Code: Terraform, Azure Resource Management Concepts
n5) Databases: Azure SQL Database, SQL Server, PostgreSQL, Cosmos DB (Preferred)
n6)DevOps: Azure DevOps, Git, CI/CD Pipeline Implementation
n

nMandatory Skills:
n

n
- n
- Azure Databricksn
- Azure Data Factory (ADF)n
- PySparkn
- Pythonn
- Terraformn
- SQLn
- Az

📌 Azure Databricks, ADF, Pyspark, Python, Terraform (Tamil Nadu)
🏢 Tata Consultancy Services
📍 Tamil Nadu

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: azure databricks, adf, pyspark, python, terraform (tamil nadu) / tamil nadu

Subscribe to this job alert:

Get the latest job offers by email for: azure databricks, adf, pyspark, python, terraform (tamil nadu) / tamil nadu