Position: Sr. Data Engineer

Location: Noida, Sector 132

Experience: Minimum 2.5 years

Joining Preference: Immediate Joiners

Job Summary

We are looking for a skilled and experienced Senior Data Engineer with strong expertise in the Azure Data Engineering ecosystem . The ideal candidate should have hands-on experience in designing and developing scalable data pipelines, batch and real-time data processing, and working with Azure data services.

The candidate will be responsible for building robust data solutions, collaborating with cross-functional teams, and contributing to end-to-end data engineering projects.

Key Responsibilities

- Design, develop, and maintain scalable data pipelines and data processing solutions on Microsoft Azure.
- Develop and manage ETL/ELT pipelines using Azure Data Factory (ADF) .
- Work extensively with Azure Data Lake Storage (ADLS) and Azure Databricks .
- Implement batch and real-time data ingestion and processing solutions.
- Develop data transformation solutions using PySpark / Spark / Scala .
- Work with Delta Lake and Spark Structured Streaming .
- Design and work with Azure Synapse Analytics / Synapse Workspace .
- Work with Azure SQL Data Warehouse / Azure Synapse and Cosmos DB .
- Develop and maintain data models and optimize data processing workflows.
- Use Python and Shell scripting for automation and data engineering tasks.
- Work with Azure DevOps for source control, CI/CD, and deployment processes.




- Understand and work with basic Azure infrastructure and cloud concepts .
- Participate in end-to-end implementation of data engineering projects.
- Troubleshoot performance, data quality, and pipeline-related issues.
- Collaborate with technical teams, stakeholders, and clients to understand requirements and deliver effective data solutions.

Required Skills

- Minimum 2.5 years of relevant experience in Data Engineering.
- Strong hands-on experience with:
- Azure Data Factory
- Azure Data Lake / ADLS
- Azure Databricks
- Azure Synapse Analytics
- PySpark / Spark / Scala
- Delta Lake
- Spark Streaming
- Strong understanding of batch and real-time data processing .
- Positive knowledge of Azure SQL / SQL Data Warehouse and Cosmos DB .
- Good programming experience in Python .
- Knowledge of Shell scripting .
- Understanding of Azure DevOps, CI/CD, and Azure infrastructure concepts .
- Strong SQL and data manipulation skills.
- Ability to work independently as well as collaboratively in a team environment.
- Strong analytical, problem-solving, and communication skills.

Good to Have

- Azure or other relevant cloud certifications .
- Experience working on an end-to-end Azure Data Engineering project .
- Experience interacting directly with clients or stakeholders.
- Knowledge of data architecture and scalable cloud-based data solutions.

📌 Data Engineer (Noida)
🏢 Thoughtsol Infotech
📍 Noida