14 Oct
|
Finarb
|
Hyderabad
Location: Hyderabad / Kolkata
Experience: 7–11 Years
Employment Type: Full-Time
Company: Finarb Analytics Consulting Pvt. Ltd.
About FinarbFinarb Analytics Consulting is a data, analytics, and AI consulting firm delivering enterprise solutions across data engineering, business intelligence, cloud modernization, and advanced analytics.
About the RoleWe are looking for an experienced, hands-on Lead Data Quality Engineer to drive data validation, reconciliation, and quality automation across enterprise data platforms.
The ideal candidate will have robust expertise in SQL, ETL/ELT testing, data quality automation, and data warehousing, with experience in Azure-based environments and preferably Microsoft Fabric.
The role involves leading data quality initiatives, developing automated validation frameworks, ensuring data integrity during platform migrations, and mentoring junior engineers.
Key Responsibilities
- Lead data quality engineering, validation, and reconciliation activities across enterprise data platforms.
- Design and implement automated data quality testing frameworks using SQL and Python.
- Develop complex SQL queries for source-to-target reconciliation, transformation validation, and data integrity checks.
- Validate ETL/ELT pipelines, including full loads, incremental loads, CDC, and complex transformations.
- Lead data validation and reconciliation during migration from SQL Server and Azure Data Factory to Microsoft Fabric.
- Establish data quality standards, testing strategies, and automated monitoring processes.
- Investigate production data discrepancies, perform root cause analysis, and implement preventive controls.
- Collaborate with data engineers, architects, and BI developers to ensure data accuracy and reliability.
- Mentor data quality engineers, conduct technical reviews, and drive engineering best practices.
Required Skills & Qualifications
- 7–11 years of experience in data quality engineering, ETL testing, or data warehouse testing.
- Advanced SQL/T-SQL skills, including complex joins, CTEs, window functions, and query optimization.
- Strong experience in ETL/ELT testing, source-to-target validation, and data reconciliation.
- Hands-on experience developing automated data quality frameworks using SQL and Python.
- Strong understanding of data warehousing, dimensional modeling, and transformation logic.
- Experience with SQL Server, Azure Data Factory, and Azure data environments.
- Proven ability to troubleshoot complex data discrepancies and production issues.
- Experience leading technical teams, reviewing code, and establishing testing standards.
- Bachelor's degree in Computer Science, Engineering, or a related field.
Good-to-Have Skills
- Microsoft Fabric (Lakehouse, Warehouse, OneLake, Fabric Data Factory).
- PySpark and Spark SQL.
- Data quality tools such as Great Expectations, Soda, or dbt tests.
- Delta Lake and medallion architecture.
- Azure DevOps, Git, and CI/CD.
- Experience with cloud data migration and modernization projects.
- Power BI data validation and Microsoft Purview.
What We're Looking ForA technically strong, hands-on engineering lead who can independently design scalable data quality solutions, automate complex reconciliation processes, and ensure data accuracy across enterprise systems. Candidates with experience in large-scale data migrations, automated testing frameworks, and Microsoft Fabric will be preferred.
Why Join Finarb?
- Work on enterprise-scale data engineering and cloud modernization projects.
- Gain exposure to Microsoft Fabric and modern data platforms.
- Lead data quality engineering initiatives and influence technical standards.
- Collaborate with experienced data architects and engineering teams.
Company Website: https://www.finarb.ai
📌 Lead Data Quality Engineer (Hyderabad)
🏢 Finarb
📍 Hyderabad