31 Jul
|
Factspan Analytics Private
|
India
31 Jul
Factspan Analytics Private
India
:
We are looking for an experienced Senior Data Engineer - Snowflake Cortex AI to design and build next-generation cloud-native data platforms powered by Snowflake and AI capabilities. The ideal candidate will have strong expertise in Python, SQL, Snowflake, Snowpark, dbt, and AWS, with hands-on experience in leveraging Snowflake Cortex AI to build intelligent data applications, automate analytics workflows, and develop scalable AI-enabled solutions.
This role requires collaboration with data scientists, ML engineers, analytics teams, and business stakeholders to create secure, high-performance data pipelines and AI-powered data products.
Key Responsibilities :
- Design, develop, and optimize scalable data pipelines using Snowflake, Python, SQL, and dbt.
- Build enterprise-grade ELT/ETL workflows for structured and semi-structured datasets.
- Develop AI-powered applications using Snowflake Cortex AI capabilities.
- Implement data transformations using Snowpark for advanced processing within Snowflake.
- Build and deploy AI/ML models integrated with Snowflake data platforms.
- Develop interactive applications using Snowflake Streamlit.
- Optimize Snowflake warehouse performance, query execution, clustering, and storage management.
- Create reusable data engineering frameworks and automation utilities.
- Design secure and governed data models supporting analytics and AI workloads.
- Integrate Snowflake with AWS services for ingestion, orchestration, and storage.
- Build APIs and services to expose AI-powered data insights to downstream applications.
- Collaborate with data scientists for feature engineering and model deployment.
- Monitor pipeline health, troubleshoot production issues, and ensure data quality.
- Implement CI/CD pipelines for data engineering projects.
- Document architecture, technical designs, and engineering best practices.
- Mentor junior engineers and drive engineering excellence across the team.
Required Skills :
- Strong programming experience in Python.
- Advanced SQL development and query optimization.
- Hands-on experience with Snowflake Data Cloud.
- Expertise in Snowpark for data processing.
- Experience working with Snowflake Cortex AI.
- Strong knowledge of dbt (Data Build Tool).
- Experience developing applications using Snowflake Streamlit.
- Good understanding of AI/ML model development and deployment.
- Experience building ETL/ELT pipelines.
- Strong knowledge of AWS cloud services.
- Experience with data modeling and dimensional modeling.
- Knowledge of data warehousing concepts.
- Experience with Git and version control.
- Understanding of CI/CD practices.
- Solid debugging and performance tuning skills.
Preferred Qualifications :
- Experience with Generative AI and Large Language Models (LLMs).
- Knowledge of Retrieval-Augmented Generation (RAG) architectures.
- Experience integrating vector search within Snowflake.
- Familiarity with REST APIs and microservices.
- Understanding of MLOps concepts and model lifecycle management.
- Exposure to Apache Airflow or similar workflow orchestration tools.
- Experience working in Agile/Scrum environments.
Key Competencies :
- Analytical and problem-solving mindset.
- Strong communication and stakeholder management skills.
- Ability to design scalable cloud-native data solutions.
- Ownership and accountability for end-to-end delivery.
- Ability to work independently in fast-paced environments.
- Continuous learning mindset for emerging AI technologies.
📌 Factspan - Senior Data Engineer - Snowflake Cortex AI (India)
🏢 Factspan Analytics Private
📍 India