Required Skills - Python, Pyspark, Azure Data Factory, SQL, Data Modelling

Overview:
The Data Engineer (Azure) plays a crucial role in our organization, responsible for designing, developing, and maintaining scalable data pipelines for data ingestion, transformation, and storage on Azure cloud platform. This position is pivotal in ensuring the efficiency and reliability of data architecture and infrastructure, enabling data-driven decision-making across the organization.
Key Responsibilities:
- Design and develop Azure data solutions, including data lakes, data warehouses, and data integration services.
- Implement and maintain ETL processes to ingest, cleanse, transform, and aggregate data from various sources.
- Optimize data infrastructure for performance, scalability, and cost-effectiveness on Azure.
- Collaborate with data scientists and analysts to understand data requirements and implement effective data retrieval and storage mechanisms.
- Develop and maintain data pipelines using Azure Data Factory, Databricks, or similar tools.




- Ensure data security and compliance with industry regulations in all Azure data solutions.
- Troubleshoot and resolve data-related issues, ensuring the stability of data pipelines and services.
- Document data architecture, processes, and procedures for knowledge sharing and future reference.
- Participate in the evaluation and implementation of new tools and technologies for data engineering on Azure.
- Conduct performance tuning and optimization of Azure data solutions for improved efficiency.

Required Qualifications:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Proven experience in designing, developing, and maintaining data solutions on Azure cloud platform.
- Expertise in SQL programming for data manipulation, querying, and performance optimization.
- Proficiency in programming languages such as Python, Java, or Scala for data processing and manipulation.
- Hands-on experience with

📌 Data Engineer (Bengaluru)
🏢 TCP Corps
📍 Bengaluru