12 Sep
|
Pyramid IT Consulting
|
Bengaluru
12 Sep
Pyramid IT Consulting
Bengaluru
Role : Snowflake Data engineer
Location : Remote
Shift Timings : 2-11 PM IST
Skills
We are seeking a Data Engineer to design, build, and support scalable enterprise data solutions using Snowflake and Databricks. The role will focus on data ingestion, data modeling, secure data products, and building trusted data foundations for analytics, AI/ML, and Generative AI use cases.
Key Responsibilities
- Design and develop scalable ETL/ELT data pipelines using Snowflake, Databricks, SQL, Python, Spark/PySpark, and cloud technologies.
- Build ingestion frameworks for batch, incremental, CDC, API, and file-based data sources.
- Design data warehouse/lakehouse models, including fact/dimension models, star schemas, historical data, and curated data products.
- Develop and optimize solutions using Snowflake and Databricks, including performance, scalability, reliability, and cost.
- Build AI/ML-ready datasets and pipelines supporting predictive analytics, forecasting, anomaly detection, Generative AI, RAG, and AI Agents.
- Partner with Data Science/AI teams to support feature engineering, model development, deployment, and MLOps.
- Design and implement RBAC, row-level and column-level security, dynamic data masking, and secure views.
- Protect sensitive and PII data through least-privilege access, classification, encryption, masking, and auditing.
- Implement data quality, reconciliation, metadata, lineage, monitoring, and governance controls.
- Establish Git/CI-CD, automated testing, monitoring, and production support practices.
- Collaborate with business, analytics, architecture, cybersecurity, privacy, and governance teams.
Required Skills
- Robust hands-on experience with Snowflake and/or Databricks.
- Advanced SQL, Python, Spark/PySpark skills.
- Experience with ETL/ELT, APIs, CDC, data warehousing, data lakes, and lakehouse architectures.
- Strong knowledge of dimensional data modeling and enterprise data architecture.
- Experience implementing RBAC, data masking, row/column-level security, and PII protection.
- Understanding of AI/ML, GenAI, RAG, AI Agents, and ML lifecycle concepts.
- Experience with Azure, AWS, or GCP, Git, and CI/CD.
- Strong analytical, troubleshooting, and communication skills.
Preferred Experience with Snowflake Cortex/Snowpark, Databricks Unity Catalog, Delta Lake, MLflow, data catalogs, lineage, and AI/ML platforms. Snowflake and/or Databricks certifications are a plus.
📌 Snowflake Data Engineer- Remote position (Bengaluru)
🏢 Pyramid IT Consulting
📍 Bengaluru