30 Sep
|
Sonata Software
|
Bengaluru
30 Sep
Sonata Software
Bengaluru
–
- Senior Azure Data Engineer with Microsoft Fabric &
- Claude
Experience: 6–8 Years
Primary Skills
Azure Data Factory (ADF) | Microsoft Fabric | Claude / Claude Code | AI-Assisted Development | SQL | PySpark | Python
Position Overview
We are looking for a Senior Data Engineer with strong hands-on experience in Azure Data Factory, Microsoft Fabric, SQL, and modern data engineering practices. The candidate should also have practical exposure to AI-driven development tools such as Claude, Claude Code, GitHub Copilot, or Fabric AI capabilities to accelerate development and improve engineering productivity.
Roles &
- Responsibilities
- Data Engineering &
- Development
- Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory (ADF).
- Develop data integration workflows using ADF and Microsoft Fabric Data Factory.
- Build and maintain Fabric Notebooks, Lakehouse, Data Warehouse, and Medallion Architecture solutions using PySpark and SQL.
- Analyze, transform, and integrate data from multiple sources.
- Develop and optimize complex SQL queries, stored procedures, and data models.
- Ensure data quality through validation, reconciliation, exception handling, governance, and security practices.
- AI-Driven Engineering
- Leverage AI tools such as Claude, Claude Code, GitHub Copilot, and Fabric AI capabilities to improve productivity and accelerate software delivery.
- Apply AI-assisted coding, debugging, documentation, unit testing, and code optimization in day-to-day development.
- Utilize Generative AI to enhance data engineering workflows and automate repetitive development activities.
- Identify opportunities to integrate AI-assisted approaches into modern data engineering practices.
- Collaboration &
- Delivery
- Collaborate with Solution Architects, Technical Leads, BI Developers, QA teams, Data Analysts, and business stakeholders.
- Participate in technical design, code reviews, troubleshooting, and production support.
- Translate business requirements into scalable cloud data solutions.
- Contribute to coding standards, reusable frameworks, and engineering best practices.
- DevOps &
- Automation
- Implement CI/CD practices using Azure DevOps and/or GitHub.
- Automate deployment, testing, monitoring, and operational processes.
- Follow Git best practices, DataOps principles, and documentation standards.
Required Skills
- Strong hands-on experience in Azure Data Factory (ADF).
- Strong knowledge of Azure SQL Database/SQL Server, T-SQL, and Stored Procedures.
- Experience with Azure Data Lake Storage (ADLS Gen2).
- Good understanding of Microsoft Fabric and modern data engineering practices.
- Experience with Data Warehouse concepts, Fact/Dimension modeling, and Star Schema.
- Intermediate knowledge of Python and working knowledge of PySpark.
- Experience with Azure DevOps/Git and CI/CD.
- Practical exposure to AI-assisted development tools such as Claude, Claude Code, or GitHub Copilot.
- Strong analytical, problem-solving, and communication skills.
Good to Have
- Microsoft Fabric –
- Data Factory, Lakehouse, and Warehouse.
- Azure Logic Apps.
- Power BI Semantic Models.
- Experience with Generative AI-based automation and AI-driven engineering workflows.
Significant Screening Criteria: Candidates must have practical exposure to AI-assisted development, preferably Claude or Claude Code, along with core Azure Data Engineering skills. Profiles with only traditional data engineering experience and no AI-driven development exposure should not be shortlisted.
📌 Digital Senior Engineer (Bengaluru)
🏢 Sonata Software
📍 Bengaluru