30 Sep
|
Stealth AI Startup
|
Hyderabad
30 Sep
Stealth AI Startup
Hyderabad
Job Role : Data Engineer – Microsoft Azure & AI
Location: Hyderabad
Experience: 2–4 Years
Employment Type: Full-time
Company: Stealth AI Startup
About Us
Join our stealth-mode AI startup on a mission to build next-generation AI, Data and Cloud solutions for enterprise customers.
Headquartered in Hyderabad, we are building a world-class engineering team focused on Generative AI, AI Agents, Data Engineering and Cloud Infrastructure .
As we expand our Microsoft ecosystem capabilities, we are looking for talented engineers with strong Microsoft Azure Data Engineering expertise.
Role Overview
As a Data Engineer , you will design, build and optimize scalable data pipelines and cloud data platforms primarily on Microsoft Azure .
You will work with Azure Data Factory, ADLS Gen2, Azure Databricks, Microsoft Fabric, Azure Synapse and Azure SQL , while collaborating with AI/ML and application engineering teams to build enterprise-grade data solutions.
Key Responsibilities
- Design and develop scalable ETL/ELT data pipelines using Azure Data Factory and Microsoft Fabric.
- Build and manage data lakes using Azure Data Lake Storage Gen2 (ADLS Gen2) .
- Develop distributed data processing solutions using PySpark and Azure Databricks .
- Work with Microsoft Fabric, OneLake and Lakehouse architectures .
- Build batch and real-time data pipelines using Azure Event Hubs and Spark Streaming .
- Integrate data from databases, APIs, files and enterprise applications.
- Develop data transformations and data-quality processes using Python, PySpark and SQL .
- Work with Azure SQL, SQL Server and PostgreSQL .
- Implement pipeline monitoring, logging, error handling and performance optimization.
- Support AI/ML and Generative AI workloads through AI-ready data pipelines and datasets.
- Implement CI/CD for data engineering workloads using Azure DevOps and Git .
- Follow best practices for data security, governance and access management.
- Collaborate with architects, AI/ML engineers, software engineers and business teams.
Required Qualifications
- Bachelor's or Master's degree in Computer Science, Engineering, Data Engineering or related field.
- 2–4 years of experience in Data Engineering.
- Strong hands-on experience with Python and SQL .
- Experience building data pipelines on Microsoft Azure .
- Good understanding of ETL/ELT, data modelling and data warehousing.
- Experience with distributed data processing using PySpark/Spark .
- Robust analytical and problem-solving skills.
- Good communication and collaboration skills.
Key Skills
- Azure: Data Factory, ADLS Gen2, Databricks, Synapse
- Microsoft Fabric: OneLake, Lakehouse, Data Pipelines
- Programming: Python, SQL, PySpark
- Streaming: Azure Event Hubs, Spark Streaming
- Databases: Azure SQL, SQL Server, PostgreSQL
- BI: Power BI
- DevOps: Azure DevOps, Git, CI/CD
- AI/ML: Azure ML, MLflow, GenAI Data Pipelines
Good to Have
- Experience with Microsoft Fabric .
- Experience delivering enterprise Azure data solutions.
- Knowledge of Azure AI / Machine Learning .
- Experience with Generative AI, RAG or vector-data pipelines.
- Microsoft certifications such as DP-203 or DP-700 .
What We Offer
- Opportunity to work on Microsoft Azure + AI projects for enterprise customers.
- Exposure to Microsoft Fabric, Azure Databricks and Generative AI .
- Opportunity to work on modern Cloud + Data + AI architectures .
- High-ownership role in a fast-growing AI startup.
- Opportunity to work with a global engineering team.
📌 Data Engineer (Hyderabad)
🏢 Stealth AI Startup
📍 Hyderabad