Job Description
Overall Experience: 6 to 12 Years
nJob Location: Bangalore/Hyderabad/Chennai
n

nJob Requirements*
n
- n
- Azure data factory, Databricks, synapse, delta lake development with hands-on coding experiencen
- Implement ETL solution to integrate, transform and load data from various sources into data lake and data warehousen
- Hands-on expertise in python, pyspark and sql for large scale data processingn
- Optimize and tune data pipelines for performance and scalabilityn
- Ability to write complex SQL queriesn
- Collaborate with business analysts and business stakeholders to gather requirements and ensure data quality and availability.n
- Valuable understanding of Agile Methodologies and DevOps Culturen
- Strong Problem-solving skillsn

n.
nKey Responsibilities*
n
- n
- Design, develop, and deploy scalable data pipelines using Databricks (PySpark, Spark SQL), Azure Synapse, Azure Data Factory, and other Azure data services.n
- Implement ETL/ELT processes to ingest, transform,



and load data from various sources into data lakes and data warehouses.n
- Optimize and tune data pipelines for performance and scalability.n
- Write and optimize complex SQL queries for data extraction, transformation, and analysis.n
- Use PySpark for large-scale data processing and analytics.n
- Implement data partitioning, bucketing, z-ordering, liquid clustering and indexing strategies for efficient data retrieval.n
- Integrate data from multiple sources, including structured, semi-structured, and unstructured data.n
- Work with APIs, streaming data, and batch processing to ensure seamless data integration.n
- Implement data governance practices to ensure data quality, consistency, and security.n
- Monitor and troubleshoot data pipelines to ensure data accuracy and availability.n
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.n
- Work closely with DevOps teams to deploy and monito

📌 Azure Data Engineer (Tamil Nadu)
🏢 Tata Consultancy Services
📍 Tamil Nadu