Azure Databricks, ADF, Pyspark, Python, Terraform (Chennai)

Azure Databricks, ADF, Pyspark, Python, Terraform (Chennai)

24 Sep
|
Tata Consultancy Services
|
Chennai

24 Sep

Tata Consultancy Services

Chennai

TCS Hiring for Azure Databricks, ADF, Pyspark, Python, Terraform

Experience Range: -

06 To 10 Years (Mandatory) (Note: Candidates below 06 years of IT experience shall not be considered) JOB LOCATION: Chennai

Key Responsibilities

Design and develop scalable data pipelines using

Azure Data Factory (ADF)

and

Azure Databricks. Build and optimize large-scale ETL/ELT processes using

PySpark and

Python . Ingest data from various structured and unstructured sources into Azure Data Lake. Develop batch and real-time data processing solutions. Create reusable data transformation frameworks and data quality checks. Implement Infrastructure as Code (IaC) using

Terraform . Manage Azure resources including Data Lake Storage, Key Vault, Databricks, ADF, and Monitoring services. Optimize Spark jobs for performance, scalability, and cost efficiency. Develop CI/CD pipelines for deployment automation. Collaborate with business stakeholders, architects, and development teams to define data requirements and solutions. Support production deployments and troubleshoot data pipeline issues. Follow data governance, security, and compliance standards.

Required Technical Skills

- Azure Services:

Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage Gen2, Azure Key Vault, Azure Monitor, Azure DevOps 2) Data Engineering:

Robust expertise in ETL/ELT development, Data Warehousing concepts, Data Modeling (Star Schema, Snowflake Schema). Batch and Streaming Data Processing 3) Programming:

Python, PySpark, SQL 4) Infrastructure as Code:

Terraform, Azure Resource Management Concepts 5) Databases:

Azure SQL Database, SQL Server,



PostgreSQL, Cosmos DB (Preferred) 6)DevOps:

Azure DevOps, Git, CI/CD Pipeline Implementation

Mandatory Skills

Azure Databricks Azure Data Factory (ADF) PySpark Python Terraform SQL Azure Data Lake Storage (ADLS) Azure DevOps

Preferred Skills

Delta Lake Unity Catalog Spark Optimization Data Governance Real-time Streaming (Kafka/Event Hub) Synapse Analytics Machine Learning Integration

Minimum Qualification: 15 years of Full Time Education

Interested candidates kindly share your updated resume to [email protected] along with filling the following details to maximize your chances of getting calls from TCS. The details are as follows:

Section 1: Basic Details: Candidate Name: Email ID: Phone Number: Current Location (City): Preferred Location (City):

Section 2: Educational Details: Highest Regular Full‐Time Qualification (Diploma / Graduation / Post Graduation / Others) 10th Completion Year 12th / Intermediate Completion Year Graduation Completion Year Post‐Graduation Completion Year

(if applicable)

Section 3: Work Experience: Current Company Name Total Experience (in years) Number of Companies Worked Employment Timeline (Example: Company A – 2021 to Present, Company B – 2019 to 2021)

Section 4: Compensation Details

Current CTC (in LPA) Expected CTC (in LPA) Notice Period (Immediate / 15 Days / 30 Days / 60+ Days)

Section 5: Documentation & Compliance (Yes / No):

Valid ID Proof Available (Aadhar & Pan Card): (Yes/No) Educational Documents Available: (Yes/No) Employment Documents Available: (Yes/No) UAN Number Available: (Yes/No)

📌 Azure Databricks, ADF, Pyspark, Python, Terraform (Chennai)
🏢 Tata Consultancy Services
📍 Chennai

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: azure databricks, adf, pyspark, python, terraform (chennai) / chennai

Subscribe to this job alert:

Get the latest job offers by email for: azure databricks, adf, pyspark, python, terraform (chennai) / chennai