30 Sep
|
HCLTech
|
Chennai
Snowflake Technical Lead
Chennai, Tamil Nadu
Job Summary
Senior Data Engineer – Informatica to dbt MigrationWe are seeking an experienced Senior Data Engineer to support a large-scale data modernization initiative involving the migration of Informatica workflows to dbt on Snowflake. The role will be part of a factory-based delivery model responsible for workflow analysis, code conversion, testing, reconciliation, deployment, and certification.The engineer will analyze Informatica workflows, mappings, sessions, mapplets, reusable transformations, parameter files, source-to-target mappings, and workflow dependencies. The role requires identifying transformation logic, business rules, lookups, joins, filters, aggregations, update strategies, pre/post SQL, scripts, and unsupported patterns that may require redesign.The engineer will convert Informatica mappings into modular and maintainable dbt models using Snowflake SQL. Responsibilities include developing staging, intermediate, and presentation-layer models, reusable macros, incremental models, snapshots, seeds, and dbt tests. The engineer will also review and remediate code generated through automated conversion tools and ensure compliance with project coding, naming, documentation, and architecture standards.A major responsibility will be validating dbt output against the corresponding Informatica output. This includes row-count validation, column-level comparison, aggregate checks, null and duplicate checks, checksum validation, business-rule validation, and reconciliation reporting. The engineer will support parallel runs, investigate data discrepancies, resolve defects,
and prepare evidence required for technical and business certification.The role will also support unit testing, system integration testing, regression testing, performance testing, user acceptance testing, production deployment, smoke testing, and post-production validation. The engineer will assist with Git-based code management, pull requests, CI/CD pipelines, deployment documentation, Control-M or equivalent scheduling, rollback planning, and hypercare support.Candidates should have 5–10 years of data engineering or ETL experience with strong hands-on expertise in Informatica PowerCenter, dbt, Snowflake, and advanced SQL. Experience with workflows, mappings, mapplets, parameterization, incremental processing, stored procedures, reconciliation, and ETL modernization is required. Knowledge of Git, CI/CD, Agile delivery, data quality, and performance optimization is also expected.Experience in the insurance domain, factory-based migration programs, Control-M, automated conversion accelerators, and Snowflake or dbt certification is preferred. The candidate should possess strong analytical, troubleshooting, communication, documentation, and stakeholder-management skills.Success will be measured through conversion productivity, first-time-right quality, reconciliation accuracy, low defect leakage, adherence to standards, timely certification,
and stable production deployment. The Technical Lead will be responsible for overseeing and leading technical projects in the areas of Snowflake, DBT, SQL, and Python. They will be required to provide technical guidance, mentor team members, and ensure the successful implementation of solutions.
Key Responsibilities
1. Lead technical projects involving snowflake, dbt, sql, and python from conception to completion.
2. Provide technical expertise and guidance to team members.
3. Collaborate with stakeholders to understand project requirements and translate them into technical solutions.
4. Develop and maintain database systems using snowflake and sql.
5. Implement data transformation and modeling using dbt (data build tool).
6. Write and optimize python code for data extraction, transformation, and loading (etl) processes.
7. Troubleshoot technical issues and provide timely resolutions.
8. Stay updated on industry trends and technologies related to snowflake, dbt, sql, and python.
Skill Requirements
1. Proficiency in snowflake for database development and management.
2. Experience with dbt for data transformation and modeling.
3. Strong sql skills for querying and managing databases.
4. Advanced knowledge of python for data manipulation and etl processes.
5. Ability to work in a fast paced setting and manage multiple priorities effectively.
6. Excellent problem-solving skills and attention to detail.
7. Strong communication and leadership abilities to guide and mentor team members effectively.
Other Requirements
1.Relevant certifications in Snowflake, DBT, SQL, or Python are a plus.
📌 Snowflake Technical Lead (Chennai)
🏢 HCLTech
📍 Chennai