27 Oct
|
Algoleap Technologies
|
Hyderabad
27 Oct
Algoleap Technologies
Hyderabad
Job Title: Senior Snowflake Data Engineer –Data Platform & AI
JobLocation: Hyderabad
Experience: 6–10 years
Start Date: As soon as possible
Role Overview
We are seeking a Senior Snowflake Data Engineer to design, develop, andmaintain scalable data platform solutions for the Pacific Data Platform. Therole covers end-to-end data ingestion, transformation, data modeling,performance optimization, security, and data quality.
The role also involves developing AI-enabled solutions usingSnowflake Cortex AI, Cortex Analyst, and Cortex Searchto support natural-language analytics, intelligentsearch, and insights from structured and unstructured data.
The successful candidate will work closely with cross-functional teams totranslate business requirements into reliable, secure, and cost-effectivesolutions. They should be self-directed and comfortable supporting the dataneeds of multiple teams, systems, and products.
Key Responsibilities
Snowflake Data Engineering
Design and implement scalable Snowflake data architectures for storage,processing, reporting, analytics, and AI use cases and strong sql,
Develop and maintain ETL/ELT pipelines using SQL, Python, Snowpark, SnapLogic,and/or Azure Data Factory.
Integrate structured and semi-structured data from databases, APIs, enterpriseapplications, and files, and prepare unstructured content for AI processing.
Implement full-load, incremental-load, and change data capture processes withappropriate validation, reconciliation, and error handling.
Develop and maintain dimensional and relational data models that accuratelyrepresent business requirements.
Build and optimize tables, views,
stored procedures, tasks, streams, anddynamic tables where appropriate.
Analyze query profiles and optimize warehouse sizing, clustering, partitionpruning, and caching to improve performance and control costs.
Review existing SQL and Python code to improve efficiency, security,robustness, and maintainability.
Implement data quality checks for completeness, accuracy, consistency,validity, and duplication.
Snowflake AI and Cortex
Design and implement AI-enabled data solutions using Snowflake Cortex AIand Snowpark,Cortex Analyst, Cortex Search and Agent creation
Apply Cortex AI functions to relevant use cases such as text summarization,classification, information extraction, and data enrichment.
Collaborate with business stakeholders to identify practical AI use casesacross property, lease, availability, client, and market data.
Platform Operations andCollaboration
Implement Snowflake role-based access control, masking policies, rowaccess policies, and auditing in line with enterprise security requirements.
Monitor pipeline execution, data freshness, warehouse utilization, failures,and service performance.
Establish logging, alerting, retry, and recovery mechanisms for reliableproduction operations.
Maintain version-controlled code and support automated deployments through Gitand Azure DevOps.
Document architectures, data mappings, pipelines, semantic definitions, andoperational procedures.
Collaborate with application engineers, analysts, architects, and businessstakeholders throughout delivery.
Mentor junior engineers and promote engineering standards, code reviews, andcontinuous improvement.
Key Qualifications
Required Qualifications
Bachelor’s ormaster’s degree in Computer Science, Information Technology, Engineering, or arelated field.
6–10 years of relevant experience in data engineering, database development, or cloud data platforms.
Strong hands-on experience with Snowflake architecture, data loading, SQLdevelopment, performance optimization, and security.
Advanced SQL skills, including complex joins, window functions, storedprocedures, query profiling, and troubleshooting.
Strong Python programming skills for data processing, automation, APIintegration, and error handling.
Experience with Snowpark for data transformations and application integration.
Experience building pipelines using Azure Data Factory, or comparableintegration tools.
Practical experience with Snowflake Cortex AI, Cortex Analyst, and CortexSearch.
Ability to develop semantic views or semantic models with transparent businessdefinitions and validated analytical queries.
Understanding of natural-language-to-SQL, semantic and keyword search,embeddings, text chunking, and RAG.
Experience integrating Snowflake AI capabilities with applications using APIsor Python.
📌 Senior Snowflake Data Engineer (Hyderabad)
🏢 Algoleap Technologies
📍 Hyderabad