19 Nov
|
Palo Alto Labs
|
Pune
19 Nov
Palo Alto Labs
Pune
Role: SDE III Data Engineer
Location: Remote
Employment Type: Contractor (6 months)
Application Stack
· Python/ PySpark
· Apache AirFlow
· Snowflake
· SQL Database
· MLOps
· Snowpark
· Azure/AWS Functions
· Blob Storage
· XML, JSON
· GitHub
Essentials for Being Successful in This Role
· Minimum 5 years of experience in software development and system design
· Minimum 2 years of experience as a Data Engineer focused on data modelling, governance, and platform administration.
· Expertise in Snowflake or similar MPP databases.
· Robust SQL skills.
· Experience with multiple database technologies (MSSQL, PostgreSQL, OLAP, OLTP).
· Familiarity with ETL/ELT tools and methodologies.
· Experience with database health monitoring, stored procedures, and schema design.
· Practical understanding of data governance principles.
· Experience with cloud environments (SaaS, PaaS, IaaS).
· Strong communication skills, both written and verbal.
· Experience in technical design and documentation.
· Proficiency with source control systems (Git, Gitflow).
· Experience with Agentic AI (Claude, GPT, etc.).
Desirables (Nice to Have)
· Familiarity with Generative AI and Spec-Driven Development.
· Experience with test automation.
· Experience with Kafka, Azure Event Hubs, Azure Service Bus.
· Knowledge of CI/CD practices.
· Ability to work independently and within Agile teams.
· Experience with Azure cloud services.
· Exposure to Master Data Management (MDM).
· Python skills for data transformation and pipeline automation.
· Understanding data mesh principles.
· Strong prioritization and multitasking abilities.
Roles & Responsibilities
· Designing, building, testing, and maintaining scalable data models using Apache Airflow and Python.
· Administering Snowflake environments, monitoring system health and performance.
· Managing and optimizing Snowflake virtual warehouses for efficiency and cost-effectiveness.
· Managing the MLOps workflow through Snowflake registrations and Snowpark.
· Promoting self-service and decentralized data ownership across teams.
· Enforcing data governance policies to ensure standardization, quality, and compliance.
· Providing technical assistance and cross-training to team members.
· Participating in design sessions and creating technical design documents and diagrams.
· Conducting code reviews and offering constructive feedback.
· Mentoring engineers to support team growth and development.
· Collaborating with senior engineers in the Architecture Review Board.
· Ensuring delivery quality and supporting production services.
📌 Data Enigneer-III (Pune)
🏢 Palo Alto Labs
📍 Pune