10 Sep
|
Mindstix Software Labs
|
Maharashtra
10 Sep
Mindstix Software Labs
Maharashtra
About Mindstix Software Labs
Mindstix accelerates digital transformation for the world's leading brands. We are a team of passionate innovators specialized in Digital Experiences, Enterprise Mobility, Cloud Engineering, and Data Science.
Our UX studio and modern-stack engineers deliver world-class products for our global customers, including Fortune 500 enterprises and Silicon Valley startups. Our work impacts a diverse set of industries such as eCommerce, Luxury Retail, SaaS, Consumer Tech, Health Tech, and Hospitality.
A fast-moving open culture powered by curiosity and craftsmanship. A team committed to bold thinking and innovation at the very intersection of business, technology, and design. That’s our DNA.
Roles and Responsibilities
Mindstix is looking for an experienced Senior Data Engineer with strong expertise in Microsoft Azure, Microsoft Fabric, and Microsoft Purview to design, build, and maintain scalable enterprise data solutions. The ideal candidate should have strong hands-on experience in data engineering, cloud data platforms, data integration, data governance, and modern data architectures.
As a Senior Data Engineer, you will be responsible for:
- Design and develop scalable and reliable data pipelines and data engineering solutions using Microsoft Azure.
- Build and manage data pipelines using Azure Data Factory (ADF) and Microsoft Fabric.
- Design and implement data solutions using Microsoft Fabric, including Fabric Data Factory, Lakehouse, Data Warehouse, and related services.
- Work with Microsoft Purview for data cataloging, data discovery, lineage, classification, and data governance.
- Develop and optimize data transformation workflows using PySpark, Spark, Python, and SQL.
- Design and implement modern data architectures using Azure Data Lake Storage (ADLS), Azure Synapse Analytics, Databricks, and Microsoft Fabric.
- Develop ETL/ELT pipelines for integrating data from multiple sources into enterprise data platforms.
- Implement data quality, validation, monitoring, and error-handling mechanisms across data pipelines.
- Collaborate with Data Architects, Solution Architects, Engineering, DevOps,
and business stakeholders to translate requirements into scalable data solutions.
- Optimize data pipelines, queries, and data processing workloads for performance and scalability.
- Implement data security, governance, access controls, and compliance using Azure and Microsoft Purview capabilities.
- Work with structured and unstructured data across relational databases, cloud platforms, APIs, and enterprise applications.
- Develop reusable frameworks and best practices for data ingestion, transformation, and processing.
- Troubleshoot data pipeline and production issues and implement long-term solutions.
- Participate in architecture and technical discussions, code reviews, and design reviews.
- Maintain technical documentation, data flow diagrams, pipeline documentation, and deployment plans.
- Follow CI/CD, Git, DevOps, and Agile development practices.
Qualifications and Skills
- Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, or a related field.
- 5+ years of experience in Data Engineering, with strong experience in Azure data technologies.
- Strong hands-on experience with Microsoft Azure Data Services.
- Solid experience with Microsoft Fabric, including Lakehouse, Data Factory, Data Warehouse, and related components.
- Hands-on experience with Microsoft Purview, including Data Catalog, Data Discovery, Data Lineage, Classification, and Governance.
- Strong experience with Azure Data Factory (ADF) and building ETL/ELT pipelines.
- Strong knowledge of Azure Data Lake Storage (ADLS) and modern cloud data architectures.
- Hands-on experience with Azure Synapse Analytics and/or Azure Databricks.
- Strong programming experience in Python, PySpark, and SQL.
- Strong understanding of data warehousing, data modelling, ETL/ELT, and data integration concepts.
- Experience working with batch and real-time data processing.
- Understanding of data governance, data quality, security, and compliance.
- Experience with Git, CI/CD pipelines, and Azure DevOps.
- Experience working with Agile/Scrum methodologies.
- Strong analytical, troubleshooting, and problem-solving skills.
- Good communication and stakeholder management skills.
Who Fits Best?
- You have strong hands-on experience in Azure Data Engineering.
- You have practical experience working with Microsoft Fabric and Microsoft Purview.
- You enjoy designing and building scalable data pipelines and modern data platforms.
- You have strong expertise in Python, PySpark, SQL, ADF, and Azure data services.
- You understand modern data architecture, data governance, and data quality practices.
- You enjoy solving complex data and technical challenges.
- You have good communication skills and can effectively collaborate with technical and business stakeholders.
- You thrive in a fast-paced, collaborative, and innovation-driven environment.
Benefits An opportunity to work in a competitive environment with top-tier engineers in your industry. Flexible working environment, competitive compensation and perks, health insurance coverage, rewards and recognition, accelerated career planning. An opportunity to build products and solutions at a truly global scale.
Location
This position is primarily based at our Pune (India) headquarters, requiring all potential hires to work from this location. A modern workplace is deeply collaborative by nature, while also demanding a touch of flexibility. We embrace deep collaboration at our offices with reasonable flexi-timing and hybrid options to our seasoned team members.
Equal Opportunity Employer
Mindstix is committed to an inclusive and diverse work environment. We do not discriminate based on race, colour, ethnicity, ancestry, national origin, religion, gender, gender identity, gender expression, sexual orientation, age, disability, veteran status, genetic information, marital status or any other legally protected status
📌 Data & AI Architect (Maharashtra)
🏢 Mindstix Software Labs
📍 Maharashtra