17 Nov
|
Grant Thornton INDUS
|
Bengaluru
17 Nov
Grant Thornton INDUS
Bengaluru
Summary:
The Data Engineer – Manager will design, build, optimize, and support scalable enterprise data pipelines and cloud-based data platforms, with a strong emphasis on Snowflake and Informatica.
The role will develop data-ingestion, transformation, modeling, and integration solutions across diverse enterprise data sources. Responsibilities include Snowflake data-warehouse design and performance optimization, ETL/ELT development, automation, data governance, security, and cloud modernization. The position requires strong hands-on technical expertise and effective collaboration across engineering, application, architecture, analytics, and business teams.
Location: Bangalore/Hyderabad/Kolkata, India.
Key Responsibilities:
Data Engineering & Integration
- Design and implement scalable data pipelines and ETL/ELT processes using Snowflake, Informatica, Microsoft Fabric, AWS Glue, or comparable technologies.
- Integrate data from APIs, flat files, databases, and other enterprise sources into centralized data platforms.
- Develop reliable and reusable data-integration components supporting enterprise applications and analytics.
- Design and implement data transformations, workflows, dependencies, and data movement between source and target platforms.
- Collaborate with cross-functional teams to gather requirements, define data models, and deliver business-critical data solutions.
Snowflake Engineering & Optimization
- Develop and optimize Snowflake data warehouses and data structures.
- Design dimensional data models, including star and snowflake schemas.
- Optimize Snowflake workloads through appropriate schema design, clustering, query optimization, and performance tuning.
- Leverage Snowflake capabilities including Time Travel, Cloning, Tasks, Streams, and security policies.
- Automate data workflows using Snowflake Tasks, OpenFlow, Cortex AI, Streams, DBT, and related technologies where appropriate.
Data Governance, Security & Quality
- Implement data-governance, security, and access-control requirements across cloud data platforms.
- Configure and support appropriate Snowflake security capabilities,
including row-level security and column masking.
- Support applicable regulatory and compliance requirements, including HIPAA and GDPR.
- Incorporate data-quality, validation, monitoring, and reconciliation practices into data pipelines and data-platform solutions.
Cloud Data Engineering & Modernization
- Lead or contribute to cloud migration and data-platform modernization initiatives.
- Develop data solutions utilizing AWS services such as S3, Glue, Lambda, and Redshift and/or Azure data technologies such as Azure Databricks.
- Support modernization of legacy data-processing and integration patterns using scalable cloud-native architectures.
- Contribute to proofs of concept (POCs), reusable accelerators, and engineering standards.
Engineering Practices & Collaboration
- Apply source-control and software-development practices using GitHub or comparable tools.
- Work within Agile delivery environments utilizing tools such as Azure DevOps, JIRA, and Confluence.
- Mentor junior engineers and promote data-engineering, Snowflake, integration, and cloud-architecture best practices.
- Communicate technical concepts, design decisions, risks, and solutions effectively to technical and business stakeholders.
Required Skills:
- 5+ years of experience in data engineering or a related technology role.
- Strong hands-on Snowflake experience, including data-warehouse development, performance tuning, Time Travel, Cloning, and security policies.
- Hands-on experience with Informatica or comparable enterprise ETL/data-integration technologies.
- Strong SQL skills for data engineering, transformation, troubleshooting, and validation.
- Experience with Python and Shell scripting.
- Strong understanding of ETL/ELT architecture and scalable data-pipeline design.
- Experience integrating data from APIs,
files, databases, and other enterprise sources.
- Strong understanding of dimensional modeling, including star and snowflake schemas.
- Experience with AWS technologies such as S3, Glue, Lambda, and Redshift and/or Azure data technologies such as Azure Databricks.
- Experience using GitHub or comparable version-control platforms.
- Experience working with Azure DevOps, JIRA, Confluence, or comparable Agile delivery tools.
- Solid analytical and problem-solving capabilities with an emphasis on performance, scalability, and reliability.
- Strong communication and stakeholder-management skills.
Preferred Skills:
- Experience with Microsoft Fabric.
- Experience with Snowflake OpenFlow, Cortex AI, Tasks, and Streams.
- Experience with DBT.
- SnowPro Core certification.
- Informatica certification or advanced Informatica experience.
- AWS certification or certification in Agile methodologies.
- Experience leading proofs of concept and developing reusable engineering accelerators.
- Experience with Oracle HCM integrations or data extraction.
- Experience working with data solutions supporting life sciences, banking, or telecommunications.
Education / Professional Experience / Qualifications:
- Bachelor’s degree in Computer Science, Engineering, Information Technology, Data Engineering, or a related discipline, or equivalent relevant professional experience.
- 5+ years of relevant experience in data engineering, data integration, cloud data platforms, or related roles.
- Demonstrated hands-on experience designing and developing enterprise-scale data pipelines and ETL/ELT solutions.
- Strong Snowflake and SQL experience with practical knowledge of data modeling and performance optimization.
- Experience with Informatica or comparable enterprise integration technology.
- Experience implementing data solutions within AWS and/or Azure environments.
- Ability to design solutions for performance, scalability, security, governance, and maintainability.
- Strong analytical, technical-documentation, communication, and cross-functional collaboration skills.
📌 Manager - Data Engineer (Bengaluru)
🏢 Grant Thornton INDUS
📍 Bengaluru