30 Sep
|
Tata Consultancy Services
|
Chennai
30 Sep
Tata Consultancy Services
Chennai
Senior Azure Data Engineer
Experience: 5-10 Years
Location: Mumbai/Bangalore/Chennai/Hyderabad/Gujarat
We are looking for an experienced Senior Azure Data Engineer with solid expertise in designing and implementing scalable data solutions using Microsoft Azure technologies. The ideal candidate should have hands-on experience with Azure Databricks, Azure Data Factory, Synapse Analytics, Python, PySpark, and Spark-based data processing.
Key Responsibilities
- Provide technical expertise in Azure Databricks and Azure Data Factory for solution design and implementation.
- Design, develop, unit test, review, and enhance data platforms and pipelines.
- Build and maintain infrastructure for data products, including data pipelines, storage systems, and processing engines.
- Develop data ingestion, curation, and transformation solutions using Spark.
- Ensure adherence to sound architecture and engineering best practices.
- Optimize data infrastructure for scalability, reliability, performance, and resource utilization.
- Minimize downtime and improve the overall efficiency of data platforms.
- Collaborate with Data Architects and Domain Data Stewards to implement solutions aligned with business requirements and Data Mesh principles.
Mandatory Skills
- Minimum 4 years of experience implementing projects using Azure technologies.
- Strong hands-on experience with Azure Databricks and Azure Data Factory.
- Experience with Azure SQL Database, Azure SQL Data Warehouse, and Azure Synapse Analytics.
- Proficiency in Python and PySpark.
- Strong experience in data ingestion, data curation, and transformation using Spark.
- Knowledge of data pipelines, storage systems, processing engines, and cloud-based data architecture.
Preferred Competencies
- Excellent verbal and written communication skills.
- Strong interpersonal and collaboration skills.
- Ability to work independently and within a team environment.
- Strong analytical and problem-solving capabilities.
📌 Azure Data Engineer (Chennai)
🏢 Tata Consultancy Services
📍 Chennai