03 Aug
|
Tata Consultancy Services
|
Andhra Pradesh
03 Aug
Tata Consultancy Services
Andhra Pradesh
Job Description: Azure Databricks Engineer
Job Title: Azure Databricks Engineer
Experience: 5-10 Years
Location: Vizag (Visakhapatnam)
Drive Type: Weekend Walk-in Drive
Walk-in Date: 1-Aug-2026
Job Summary
We are looking for a highly skilled Azure Databricks Engineer with 5-10 years of experience in Data Engineering, Big Data technologies, and Azure Cloud. The ideal candidate will be responsible for designing, developing, and optimizing scalable data processing pipelines, implementing data lake solutions, and enabling advanced analytics using Azure Databricks.
The candidate should have solid expertise in Azure data services, distributed computing frameworks, and modern data engineering practices to support enterprise-scale data initiatives.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Azure Databricks.
- Build and optimize ETL/ELT processes for large-scale data ingestion and transformation.
- Develop data solutions using PySpark, Spark SQL, and Databricks notebooks.
- Work with Azure Data Lake Storage (ADLS), Azure Synapse Analytics, and Azure Data Factory.
- Implement Delta Lake architecture for reliable and high-performance data processing.
- Monitor, troubleshoot, and optimize Spark jobs for performance and scalability.
- Collaborate with data architects, business analysts, and stakeholders to understand data requirements.
- Ensure data quality, security, and governance standards across data platforms.
- Support CI/CD implementation and automation for data engineering workflows.
- Participate in design reviews, code reviews, and best practice initiatives.
Required Technical Skills
Azure Technologies
- Azure Databricks
- Azure Data Factory (ADF)
- Azure Data Lake Storage (ADLS Gen2)
- Azure Synapse Analytics
- Azure SQL Database
- Azure Key Vault
- Azure Monitor
Big Data & Data Engineering
- Apache Spark
- PySpark
- Spark SQL
- Delta Lake
- Data Modeling
- ETL/ELT Development
- Data Warehousing Concepts
Programming
- Python
- SQL
- Scala (Good to Have)
Database Technologies
- SQL Server
- Azure SQL
- PostgreSQL
- Performance Tuning and Query Optimization
DevOps & Version Control
- Azure DevOps
- Git
- CI/CD Pipelines
📌 Tcs Hiring For Azure Databricks Engineer (Andhra Pradesh)
🏢 Tata Consultancy Services
📍 Andhra Pradesh