Overview

Microsoft is a company where passionate innovators come to collaborate envision what canbeand take their careersfurther. This is a world ofmorepossibilities more innovation more openness and the skyisthelimitthinkingina cloud-enabled world.

Microsofts Azure Data engineering team is leading the transformation of analytics in the world of data with products like databases data integration big data analytics messaging & real-timeanalyticsand business products ourportfolioincludeMicrosoft Fabric Azure SQL DB Azure Cosmos DB Azure PostgreSQL Azure Data Factory Azure Synapse Analytics Azure Service Bus Azure EventGrid and Power BI. Our mission is tobuild the data platform for the age of AI powering a new class of data-firstapplicationsand driving a data culture.

Within Azure Data the big data analytics teamprovidesa range of products that enable data engineersanddata scientiststo extract intelligence from all datastructured semi-structured and unstructured. We build the Data Engineering Data Science and Data Integration pillars of Microsoft Fabric.

Our team is part of Azure Data building reliable large-scale distributed systems for data engineering. We develop Fabric Materialized Lake Views which automatically refresh analytical data in Microsoft Fabric so customers can query up-to-date results without manual pipelines. We alsomaintainAzure HDInsight in production the PaaS platform running open-source Hadoop Spark HBase and Kafka. You will get hands-on experience with both.
As a Software Engineer II you will design and ship features for our Fabric-based SaaS platform with minimal supervision. You will write high-quality code debug complex distributed systems and work closely with Spark and Spark-based extension frameworks. You will own features through the full lifecycle: requirements design implementation deployment and production support. You will alsomaintainHDInsight components in production. This role will deepen yourexpertisein distributed systems cloud platform engineering and large-scale data infrastructure.

Successful candidates will have strong experience in one or more of these areas:



designing and coding cloud-scale SaaS products; building data lakes or data engineering tools; working with big data technologies such as Spark Kafka Hadoop or HBase; enterprise software development in C# Scala Java or Python; and working with the Azure stack (Storage Compute Networking Fabric Purview Synapse AKS DevOps Data Factory Power BI).

We do not just value differences or different perspectives. We seek them out and invite them in so we can tap into the collective power of everyone in the company. As a result our customers are better served.

Responsibilities

Write extensible maintainable code in C# Java Scala or Python for Fabric Materialized Lake View services and HDInsight components. Use AI tools and coding best practices across the development lifecycle. Produce code with few defects and clear test coverage.
Design data refresh scheduling and queryoptimisationfeatures with minimal supervision. Evaluate design options document trade-offs and begin owning or co-owning the architecture of Fabric data engineering components.
Review code from teammates for correctness test coverage security risks and adherence to team standards. Coach engineers through code reviews and provide feedback that raises code quality across the team.
Debug complex issues in distributed systems running on Azure Linux and Windows. Use debugging tools logs and telemetry to verify assumptions before issues reach production. Conduct incident retrospectives for Fabric and HDInsight services;identifyroot causes implement repairs and prevent recurrence.
Run live site operations on a rotational on-call basis. Diagnose and fix both easy and complex issues across Fabric and HDInsight workloads. Improve troubleshooting guides tests and telemetry to makeon-callbetter for the team.
Integrate logging and instrumentation to gather telemetry on system health performance reliability and security. Classify metrics build dashboards and create alerts that surface problems across the Materialized Lake View pipeline.
Work with product managers technical leads and partners across geographies to define customer requirements for Materialized Lake View features. Incorporate customer feedback into designs. Understand and advocate for the security and privacy needs of customers.

Embody ourcultureandvalues

Qualifications





Bachelors Degree in Computer Science or related technical field AND 4 years technical engineering experience with coding in languages including but not limited to Apache Spark Kafka Spark SQL PySpark C C C# Java JavaScript or Python; OR equivalent experience.

Job Requirements:Other& Additional

Abilityto meet Microsoftcustomerand/or government security screening requirements arerequiredfor this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check:

- This position will berequiredto pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred/Additional Qualifications

Masters 4 years technical engineering experience; OR Bachelors 4 years technical engineering experience; OR equivalent experience.
Experience with the Azure stack including Storage Compute Networking Fabric Purview Synapse AKS DevOps Data Factory or Power BI.
Experience with big data technologies such as Spark Kafka Hadoop or HBase.
Experience building datalakeor data engineering products tools or pipelines.
Familiarity with container-based architectures (Docker Kubernetes).
Ability to debug complex distributed systems on Linux and/or Windows platforms.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.

#azdat

#azuredata

#Fabric #AzureData @BigData #Spark #Kafka

This position will be open for a minimum of 5 days with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age ancestry citizenship color family or medical care leave gender identity or expression genetic information immigration status marital status medical condition national origin physical or mental disability political affiliation protected veteran or military status race ethnicity religion sex (including pregnancy) sexual orientation or any other characteristic protected by applicable local laws regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process read more about requesting accommodations.

Required Experience:

IC

📌 Software Engineer II (Bengaluru)
🏢 Microsoft
📍 Bengaluru