02 Oct
|
Krato Solutions
|
Tamil Nadu
02 Oct
Krato Solutions
Tamil Nadu
Data Engineer (4–5 Years Experience)Location: Chennai Experience: 4–5 Years Employment Type: Full-time Job Summary We are seeking a Data Engineer with 4–5 years of experience to build and maintain scalable data pipelines and data integration solutions. The ideal candidate should have strong expertise in Py Spark, Databricks, Azure Data Factory (ADF), Python, and SQL, with hands-on experience in cloud-based data platforms. Key Responsibilities* Design and develop scalable ETL/ELT pipelines using Py Spark and Databricks* Build and manage data workflows using Azure Data Factory (ADF)* Integrate data from multiple sources such as APIs, databases, flat files, and cloud storage* Optimize and maintain large-scale data processing systems* Ensure data quality, validation, and governance across pipelines* Collaborate with cross-functional teams including data scientists and analysts* Monitor, troubleshoot,
and improve pipeline performance* Implement reusable frameworks and best practices for data engineering* Support deployment using CI/CD pipelines Required Skills* Strong experience with Azure Data Factory (ADF) for pipeline orchestration* Hands-on experience with Databricks and Py Spark* Proficiency in Python* Advanced SQL skills including complex queries and performance tuning* Experience working on Azure Cloud (ADLS, Azure SQL, etc.)* Good understanding of data warehousing and data modeling concepts Preferred Qualifications* Experience with Azure ecosystem including ADF, ADLS, Synapse, and Key Vault* Knowledge of workflow orchestration and scheduling tools* Familiarity with Delta Lake architecture* Experience handling large datasets and performance tuning Nice to Have* Experience with streaming tools such as Kafka or Event Hubs* Knowledge of Dev Ops practices and CI/CD using Azure Dev Ops* Exposure to data governance and security practices Soft Skills* Strong analytical and problem-solving skills* Good communication and teamwork abilities* Ability to work in a rapid-paced
📌 Data Engineer (Tamil Nadu)
🏢 Krato Solutions
📍 Tamil Nadu