Senior Test Engineer- ETL Testing (Chennai)

Senior Test Engineer- ETL Testing (Chennai)

06 Aug
|
CGI
|
Chennai

06 Aug

CGI

Chennai

Founded in 1976, CGI is among the largest independent IT and business consulting services firms in the world. With 94,000 consultants and professionals across the globe, CGI delivers an end-to-end portfolio of capabilities, from strategic IT and business consulting to systems integration, managed IT and business process services and intellectual property solutions. CGI works with clients through a local relationship model complemented by a global delivery network that helps clients digitally transform their organizations and accelerate results. CGI Fiscal 2024 reported revenue is CA$14.68 billion and CGI shares are listed on the TSX (GIB.A) and the NYSE (GIB). Learn more at cgi.com.
Job Title: ETL Testing
Position: Software Engineer
Experience: 4- 7 Years
Category: Software Development/ Engineering
Shift: 1-10PM (Hybrid)
Main location: Bangalore / Chennai
Position ID: J0726-1183
Employment Type: Full Time
Education Qualification: Bachelor's degree in Computer Science or related field or higher with minimum 3 years of relevant experience.

Position Description: We are looking for an experienced ETL Testing to join our team. The ideal candidate should be passionate about coding and developing scalable and high-performance applications The successful candidate will work alongside Software Engineers and ETL Engineers, business analysts, data architects, and Power BI developers to ensure that data is complete, accurate, consistent, traceable, and fit for business use across the end-to-end technology stack.
The role will focus on testing data as it moves through an Azure-based architecture:
Source Systems Azure Data Lake Azure Databricks Microsoft Power BI
This is a hands-on quality engineering role with responsibility for validating data ingestion, transformation logic, business rules, reconciliation, reporting outputs, and application functionality. The QA/QE will help establish scalable test practices, automation, and quality controls across data pipelines and reporting solutions in a regulated Capital Markets environment.
#LI-MP14

Your future duties and responsibilities
• Develop and execute comprehensive test strategies, test plans, test cases, and test scripts for data management, ETL, reporting, and application solutions.
• Validate data across the end-to-end flow from source systems through Azure Data Lake, Azure Databricks, and Microsoft Power BI.
• Test data for:
o Accuracy
o Completeness
o Consistency
o Integrity
o Timeliness
o Uniqueness
o Conformity to business rules
• Perform source-to-target validation to confirm that data is correctly ingested, transformed, aggregated, and presented.
• Validate ETL and ELT pipelines developed in Azure Databricks using SQL, Spark SQL, and data reconciliation techniques.
• Review business requirements, data mappings, transformation specifications, and technical designs to identify test scenarios and quality risks.
• Develop complex SQL queries to compare source and target datasets and identify discrepancies.
• Validate transformation logic, joins, filters, calculations, aggregations, default values, and exception-handling rules.
• Test batch and incremental data loads, including initial loads, delta processing, late-arriving data, duplicate handling, and refresh.
• Validate data stored in Azure Data Lake and Databricks Delta tables across bronze, silver, and gold data layers.




• Test Databricks jobs, workflows, dependencies, schedules, alerts, retries, and failure-recovery processes.
• Perform data reconciliation across source applications, Azure Data Lake, Databricks, databases, and Power BI reports.
• Validate Power BI datasets, semantic models, calculations, measures, filters, drill-downs, dashboards, reports, and visualizations.
• Confirm that Power BI reports accurately reflect underlying data and approved business rules.
• Perform functional, integration, regression, system, end-to-end, and user acceptance testing.
• Test .NET-based applications, APIs, user interfaces, and application integrations where applicable.
• Validate REST API requests, responses, status codes, payloads, authentication, and error handling.
• Create reusable test data, test utilities, reconciliation scripts, and automated validation frameworks.
• Identify, document, prioritize, and track defects through resolution.
• Work with developers and business stakeholders to investigate data discrepancies and determine root causes.
• Support defect triage and clearly communicate quality risks, impacts, and remediation requirements.
• Perform regression testing following application, pipeline, data model, and reporting changes.
• Support production implementation validation, post-deployment testing, and production incident investigation.
• Maintain traceability between requirements, test cases, defects, and test results.
• Produce clear test execution reports, quality metrics, defect summaries, and release-readiness assessments.
• Promote shift-left testing by participating early in requirements, design, and development activities.
• Ensure testing practices align with CIBC technology standards, cybersecurity requirements, data governance controls, and regulatory obligations.

Must-Have Skills:
• Bachelors degree or diploma in Computer Science, Information Technology, Engineering, Data Management, or a related discipline.
• Strong professional experience in quality assurance or quality engineering for enterprise data, ETL, analytics, or reporting solutions.
• Strong experience testing data pipelines and validating data across multiple processing layers.
• Advanced SQL skills, including:
o Complex queries
o Multi-table joins
o Aggregations
o Window functions
o Stored procedures
o Data profiling
o Data comparison
o Reconciliation queries
o Duplicate and exception detection
• Hands-on experience testing ETL or ELT processes in Azure Databricks.
• Experience validating data in:
o Azure Data Lake Storage
o Databricks tables
o Delta Lake
o Microsoft SQL Server
• Experience validating notebooks, jobs, workflows, and transformation logic.
• Strong understanding of data warehousing, data lakes, lakehouse architecture, and medallion architecture patterns.
• Experience performing source-to-target testing using data mapping and transformation specifications.




• Experience testing structured and semi-structured data formats, including CSV, JSON, Parquet, and Delta.
• Experience testing Microsoft Power BI reports, datasets, dashboards, measures, and visualizations.
• Ability to reconcile report outputs to underlying source and transformed datasets.
• Experience with functional, integration, regression, system, and end-to-end testing.
• Experience with defect management, root-cause analysis, and test reporting.
• Experience working within Agile delivery teams and participating in sprint planning, refinement, stand-ups, and retrospectives.
• Strong analytical skills and attention to detail.
• Strong written and verbal communication skills, including the ability to explain data discrepancies to business and technical stakeholders.
• Experience supporting applications or data pipelines in production environments.
Test Automation and Quality Engineering
• Experience developing automated data validation and reconciliation scripts.
• Ability to build reusable testing frameworks using Python, PySpark, SQL, or similar technologies.
• Experience automating regression testing for ETL pipelines and reporting solutions.
• Experience integrating automated tests into Azure DevOps CI/CD pipelines.
• Knowledge of unit, integration, component, and end-to-end testing approaches.
• Experience validating schema changes, data contracts, and pipeline dependencies.
• Familiarity with automated API testing tools and frameworks.
• Understanding of test data management, masking, and synthetic test-data generation.
• Ability to define quality gates for code promotion and production releases.

Good-to-Have Skills:
• Experience with Python or PySpark test automation.
• Experience using testing frameworks such as pytest, unittest, or similar tools.
• Experience with Databricks Unity Catalog, data lineage, and access controls.
• Experience with Databricks SQL Warehouses.
• Knowledge of Databricks Auto Loader, Structured Streaming, or Lakeflow pipelines.
• Experience testing Power BI row-level security and data-access controls.
• Experience validating DAX measures and Power Query transformations.
• Experience with API testing tools such as Postman, REST Assured, or equivalent.
• Experience with user-interface automation tools such as Selenium, Playwright, or Cypress.
• Experience with Azure DevOps Test Plans or similar test-management tools.
• Knowledge of performance testing for large-volume data pipelines and reporting solutions.
• Experience validating data migration or legacy ETL modernization initiatives.
• Familiarity with Informatica, SSIS, or other enterprise ETL platforms.
• Previous experience within banking, capital markets, corporate banking, commercial banking, or another regulated financial-services setting.
• Knowledge of corporate lending, credit risk, client onboarding, exposure management, financial reporting, or regulatory reporting data.
CGI is an equal opportunity employer. In addition, CGI is committed to providing accommodation for people with disabilities in accordance with provincial legislation. Please let us know if you require reasonable accommodation due to a disability during any aspect of the recruitment process and we will work with you to address your needs.

📌 Senior Test Engineer- ETL Testing (Chennai)
🏢 CGI
📍 Chennai

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: senior test engineer- etl testing (chennai) / chennai

Subscribe to this job alert:

Get the latest job offers by email for: senior test engineer- etl testing (chennai) / chennai