15 Sep
|
Yash Technologies
|
Hyderabad
15 Sep
Yash Technologies
Hyderabad
We are looking forward to hire Azure Databricks Professionals in the following areas :
: Senior Software Engineer - Azure Data Engineer / Databrick s
Position: Senior Software Engineer
Role: Azure Data Engineer / Databricks Engineer
Experience: 5+ Years
- Key Responsibilities
Design, develop, and maintain scalable data pipelines using Azure Databricks, PySpark, and Azure Data Factory (ADF).
Build and optimize ETL/ELT workflows for processing large-scale structured and unstructured datasets.
Develop data solutions using Delta Lake and Medallion Architecture (Bronze, Silver, Gold layers).
Integrate data from multiple sources including databases, APIs, cloud storage, and enterprise applications.
Implement data transformation, cleansing, validation, and quality frameworks.
Optimize Spark jobs, cluster configurations, and SQL queries to improve performance and reduce costs.
Develop and maintain data models supporting business intelligence, reporting, and analytics requirements.
Utilize Azure services such as ADLS Gen2, Azure Synapse Analytics, Azure SQL Database, Key Vault, and Azure Monitor.
Implement CI/CD pipelines using Azure DevOps and Git-based version control practices.
Ensure data security, governance, compliance, and access management using Unity Catalog and Azure security best practices.
Monitor production workloads, troubleshoot data issues, and perform root cause analysis.
Collaborate with business stakeholders, solution architects, data scientists, and development teams to deliver end-to-end data solutions.
Participate in Agile ceremonies, code reviews, design discussions,
and technical mentoring of junior team members.
Support cloud migration and modernization initiatives from on-premises platforms to Azure.
2. Required Skills
Strong experience in Azure Databricks, Apache Spark, and PySpark.
Hands-on experience with Azure Data Factory (ADF).
Proficiency in SQL and Python.
Experience with Delta Lake and Lakehouse Architecture.
Strong understanding of Azure Data Lake Storage (ADLS Gen2).
Experience with Azure DevOps, Git, and CI/CD implementations.
Knowledge of Azure Synapse Analytics, Azure SQL Database, and Azure Key Vault.
Expertise in data modeling, performance tuning, and data warehousing concepts.
Strong analytical, problem-solving, and communication skills.
Role Summary:
The Senior Software Engineer will be responsible for designing and delivering enterprise-grade data engineering solutions on Azure, leveraging Databricks, Spark, and Azure-native services to support business intelligence, analytics, and digital transformation initiatives.
Our Hyperlearning workplace is grounded upon four principles
- Flexible work arrangements, Free spirit, and emotional positivity
- Agile self-determination, trust, transparency, and open collaboration
- All Support needed for the realization of business goals,
- Stable employment with a excellent atmosphere and ethical corporate culture
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
📌 Sr. Software Engineer - Azure Databricks (Hyderabad)
🏢 Yash Technologies
📍 Hyderabad