20 Nov
|
Kumaran Systems
|
Hyderabad
20 Nov
Kumaran Systems
Hyderabad
Role Over view:
We are seeking a skilled Data Engineer to design, build, and optimize Azure-based data pipelines and lakehouse solutions. The ideal candidate will deliver secure, reliable datasets with robust governance, automation, and documentation while collaborating across teams in an Agile setting. This role requires solid expertise in Databricks, Python, Spark, data pipelines, and Azure ecosystem, along with a focus on performance, scalability, and data quality.
This is a Hybrid role , full time , Hyderabad
Address: Mahaveer Gateway, Madhava Reddy Colony, Gachibowli, Hyderabad, Nanakramguda,Telangana 500032
Time: 1:00 PM 10:00 PM
Required Skills & Experience
- 8+ years of experience in Data Engineering
- Strong experience with Azure Databricks (Python, Spark, Pandas)
- Experience with Azure Data Factory (ADF) for orchestration
- Hands-on experience with Delta Lake and Medallion architecture
- Strong knowledge of Azure Data Lake Storage (ADLS)
- Experience with Unity Catalog migration and data governance
- Strong proficiency in SQL and performance optimization
- Experience in ETL/ELT and data modeling (star/dimensional schema)
- Experience with CI/CD tools (Azure DevOps or GitHub Enterprise)
- Understanding of Azure Entra ID for security and access control
- Experience in data validation, testing, and monitoring pipelines
- Familiarity with Agile/Scrum methodologies (Jira/Confluence)
- Strong communication, documentation, and collaboration skills
Preferred Experience :
- Experience with Databricks DevOps (cluster configuration, secrets management)
- Experience with Azure Functions (Python or C#)
- Exposure to Synapse SQL pools, dbt, or Delta Live Tables
- Experience in Financial Services domain
- Ability to work independently and contribute to team outcomes
- Strong focus on secure, production-grade data solutions
- Commitment to data reliability, performance, and governance
- Continuous learning mindset and adaptability
- Responsible use of Generative AI tools with validation and guardrails
📌 Data Engineer (Hyderabad)
🏢 Kumaran Systems
📍 Hyderabad