22 Aug
|
InfoCepts
|
Pune
Position: Data Engineer
Location: Nagpur/Pune
Type of Employment: Full-time
Purpose of the Position: To design, develop, and maintain scalable data pipelines and models in Snowflake for retail operations, enabling accurate reporting and analytics across customer, sales, inventory, and workforce domains.
Key Result Areas and Activities:
Data Pipeline Development: Integrate data from different sources like MMS, CRM, Workday, Courion, and other sources via S3 files, APIs, or direct staging in Snowflake.
ETL Development: Build and optimize ETL workflows using Talend , AWS Glue and SQL stored procedures.
Data Modeling: Create and maintain Snowflake tables and layered views for business consumption.
Collaboration: Work closely with data analysts, business stakeholders, and regulatory teams to understand data needs and deliver solutions.
Performance Optimization: Ensure productive query performance and cost-effective data processing in Snowflake.
Documentation & Governance: Maintain explicit documentation of data models, transformations,
and lineage to support audit and compliance requirements.
Essential Skills:
Strong hands-on experience with Snowflake (data warehousing, performance tuning, security).
Strong SQL skills with stored procedure development.
Solid understanding of SQL and advanced query optimization techniques.
Strong experience in Python development for data engineering, automation, and ETL/ELT pipeline development.
Hands-on experience in designing, developing, and maintaining AWS Glue pipelines, including Glue Jobs, Crawlers, Data Catalog, and workflow orchestration.
Experience building scalable data integration and transformation solutions using AWS services such as S3, Glue, Lambda, and Step Functions.
Familiarity with version control (Git) and CI/CD workflows.
Experience with cloud platforms (AWS, Azure, or GCP), with robust preference for AWS.
Knowledge of data pipeline monitoring, performance optimization, and troubleshoot
📌 Data Engineer Pune
🏢 InfoCepts
📍 Pune