Data Engineer
Experience: 7+ Years
Work Mode: Remote
Employment Type: C2C Contract
Contract Duration: 3 Months
Shift: 12:30 PM – 9:30 PM IST
Role Overview
We are looking for an experienced Data Engineer with 7+ years of hands-on experience in designing, developing, and optimizing scalable data engineering solutions.
The ideal candidate should have strong expertise in Databricks, PySpark, Python, SQL, Microsoft Fabric, and Azure Data Factory, along with practical experience implementing DataOps practices and optimizing data pipelines and workloads.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and data engineering solutions.
- Develop data processing solutions using Databricks and PySpark.
- Write efficient and optimized Python and SQL code for data transformation and processing.
- Build and manage data integration workflows using Azure Data Factory (ADF).
- Work with Microsoft Fabric for modern data engineering and analytics workloads.
- Implement data ingestion, transformation, validation, and processing pipelines.
- Apply DataOps practices to improve development, deployment, monitoring, and reliability of data pipelines.
- Troubleshoot data pipeline failures, performance issues,
and data quality problems.
- Perform performance optimization of data pipelines, queries, Spark jobs, and data processing workloads.
- Collaborate with data architects, analysts, developers, and business stakeholders to understand data requirements.
- Ensure data solutions are scalable, reliable, maintainable, and production-ready.
- Follow best practices for data quality, monitoring, testing, version control, and deployment.
Mandatory Technical Skills
- 7+ years of Data Engineering experience
- Databricks
- PySpark
- Python
- SQL
- Microsoft Fabric
- Azure Data Factory (ADF)
- Strong data pipeline development and ETL/ELT experience
- DataOps practices
- Data pipeline and query performance optimization
- Robust troubleshooting and problem-solving skills
Ideal Candidate Candidates should have robust hands-on experience building and optimizing enterprise-scale data pipelines using the Azure data ecosystem, particularly Databricks, PySpark, ADF, and Microsoft Fabric.
C2C candidates with relevant experience are encouraged to apply.
? Send CV:
[email protected]
? WhatsApp: +91 92848 05350
📌 Data Engineer (India)
🏢 Philodesign Technologies
📍 India