19 Aug
|
InfoCepts
|
Pune
Position: Data Engineer
Location: Nagpur/Pune
Type of Employment: Full-time
Purpose of the Position: To design, develop, and maintain scalable data pipelines and models in Snowflake for retail operations, enabling accurate reporting and analytics across customer, sales, inventory, and workforce domains.
Key Result Areas and Activities:
- Data Pipeline Development: Integrate data from different sources like MMS, CRM, Workday, Courion, and other sources via S3 files, APIs, or direct staging in Snowflake.
- ETL Development: Build and optimize ETL workflows using Talend , AWS Glue and SQL stored procedures.
- Data Modeling: Create and maintain Snowflake tables and layered views for business consumption.
- Collaboration: Work closely with data analysts, business stakeholders, and regulatory teams to understand data needs and deliver solutions.
- Performance Optimization: Ensure efficient query performance and cost-effective data processing in Snowflake.
- Documentation & Governance: Maintain clear documentation of data models, transformations, and lineage to support audit and compliance requirements.
Essential Skills:
- Strong hands-on experience with Snowflake (data warehousing, performance tuning, security).
- Robust SQL skills with stored procedure development.
- Solid understanding of SQL and advanced query optimization techniques.
- Strong experience in Python development for data engineering, automation, and ETL/ELT pipeline development.
- Hands-on experience in designing, developing, and maintaining AWS Glue pipelines, including Glue Jobs, Crawlers, Data Catalog, and workflow orchestration.
- Experience building scalable data integration and transformation solutions using AWS services such as S3, Glue, Lambda, and Step Functions.
- Familiarity with version control (Git) and CI/CD workflows.
- Experience with cloud platforms (AWS, Azure, or GCP), with solid preference for AWS.
- Knowledge of data pipeline monitoring, performance optimization, and troubleshooting in cloud-based data environments.
Desirable Skills:
- Exposure/working knowledge
- Understanding of retail data structures (sales, customer, product, workforce).
- Experience with API-based data ingestion
Qualification:
- 3?5 years in data engineering, with at least 1?2 years in Snowflake.
- Bachelor?s or master?s degree in computer science, Data Science, Bioinformatics, or related field.
Qualities:
- Robust analytical and problem-solving mindset.
- Detail-oriented with a focus on data accuracy and compliance.
- Excellent communication and stakeholder management skills.
- Ability to work independently and collaboratively in cross-functional teams.
Location
India
Years Of Exp
Above 3 years
📌 Data Engineer (Pune)
🏢 InfoCepts
📍 Pune