16 Nov
|
Grant Thornton INDUS
|
Bengaluru
16 Nov
Grant Thornton INDUS
Bengaluru
Summary: The Data Engineer – Manager will design, build, optimize, and support scalable enterprise data pipelines and cloud-based data platforms, with a strong emphasis on Snowflake and Informatica. The role will develop data-ingestion, transformation, modeling, and integration solutions across diverse enterprise data sources. Responsibilities include Snowflake data-warehouse design and performance optimization, ETL/ELT development, automation, data governance, security, and cloud modernization. The position requires strong hands-on technical expertise and effective collaboration across engineering, application, architecture, analytics, and business teams.
Location:
Bangalore/Hyderabad/Kolkata, India.
Key Responsibilities
Data Engineering & Integration
• Design and implement scalable data pipelines and ETL/ELT processes using Snowflake, Informatica, Microsoft Fabric, AWS Glue, or comparable technologies.
• Integrate data from APIs, flat files, databases, and other enterprise sources into centralized data platforms.
• Develop reliable and reusable data-integration components supporting enterprise applications and analytics.
• Design and implement data transformations, workflows, dependencies, and data movement between source and target platforms.
• Collaborate with cross-functional teams to gather requirements, define data models, and deliver business-critical data solutions. Snowflake Engineering & Optimization
• Develop and optimize Snowflake data warehouses and data structures.
• Design dimensional data models, including star and snowflake schemas.
• Optimize Snowflake workloads through appropriate schema design, clustering, query optimization, and performance tuning.
• Leverage Snowflake capabilities including Time Travel, Cloning, Tasks, Streams, and security policies.
• Automate data workflows using Snowflake Tasks, OpenFlow, Cortex AI, Streams, DBT, and related technologies where appropriate. Data Governance, Security & Quality
• Implement data-governance, security, and access-control requirements across cloud data platforms.
• Configure and support appropriate Snowflake security capabilities, including row-level security and column masking.
• Support applicable regulatory and compliance requirements, including HIPAA and GDPR.
• Incorporate data-quality, validation, monitoring, and reconciliation practices into data pipelines and data-platform solutions. Cloud Data Engineering & Modernization
• Lead or contribute to cloud migration and data-platform modernization initiatives.
• Develop data solutions utilizing AWS services such as S3, Glue, Lambda, and Redshift and/or Azure data technologies such as Azure Databricks.
• Support modernization of legacy data-processing and integration patterns using scalable cloud-native architectures.
• Contribute to proofs of concept (POCs), reusable accelerators, and engineering standards. Engineering Practices & Collaboration
• Apply source-control and software-development practices using GitHub or comparable tools.
• Work within Agile delivery environments utilizing tools such as Azure DevOps, JIRA, and Confluence.
• Mentor junior engineers and promote data-engineering, Snowflake, integration, and cloud-architecture best practices.
• Communicate technical concepts, design decisions, risks, and solutions effectively to technical and business stakeholders. Required
Skills:
• 5+ years of experience in data engineering or a related technology role.
• Strong hands-on Snowflake experience, including data-warehouse development, performance tuning, Time Travel, Cloning, and security policies.
• Hands-on experience with Informatica or comparable enterprise ETL/data-integration technologies.
• Strong SQL skills for data engineering, transformation, troubleshooting, and validation.
• Experience with Python and Shell scripting.
• Strong understanding of ETL/ELT architecture and scalable data-pipeline design.
• Experience integrating data from APIs, files, databases,
and other enterprise sources.
• Strong understanding of dimensional modeling, including star and snowflake schemas.
• Experience with AWS technologies such as S3, Glue, Lambda, and Redshift and/or Azure data technologies such as Azure Databricks.
• Experience using GitHub or comparable version-control platforms.
• Experience working with Azure DevOps, JIRA, Confluence, or comparable Agile delivery tools.
• Solid analytical and problem-solving capabilities with an emphasis on performance, scalability, and reliability.
• Strong communication and stakeholder-management skills. Preferred
Skills:
• Experience with Microsoft Fabric.
• Experience with Snowflake OpenFlow, Cortex AI, Tasks, and Streams.
• Experience with DBT.
• SnowPro Core certification.
• Informatica certification or advanced Informatica experience.
• AWS certification or certification in Agile methodologies.
• Experience leading proofs of concept and developing reusable engineering accelerators.
• Experience with Oracle HCM integrations or data extraction.
• Experience working with data solutions supporting life sciences, banking, or telecommunications. Education / Professional Experience /
Qualifications:
• Bachelor’s degree in Computer Science, Engineering, Information Technology, Data Engineering, or a related discipline, or equivalent relevant professional experience.
• 5+ years of relevant experience in data engineering, data integration, cloud data platforms, or related roles.
• Demonstrated hands-on experience designing and developing enterprise-scale data pipelines and ETL/ELT solutions.
• Strong Snowflake and SQL experience with practical knowledge of data modeling and performance optimization.
• Experience with Informatica or comparable enterprise integration technology.
• Experience implementing data solutions within AWS and/or Azure environments.
• Ability to design solutions for performance, scalability, security, governance, and maintainability.
• Strong analytical, technical-documentation, communication, and cross-functional collaboration skills.
📌 Manager - Data Engineer (Bengaluru)
🏢 Grant Thornton INDUS
📍 Bengaluru