18 Nov
|
STRATOSPHERE IT SERVICES
|
Bengaluru
18 Nov
STRATOSPHERE IT SERVICES
Bengaluru
DATABRICKS / SNOWFLAKE - DATA ENGINEER
- Lead design and implementation of complex analytics solutions on Databricks platform
- Architect scalable machine learning pipelines with model versioning and deployment automation
- Optimize Spark jobs and cluster configurations for performance and cost efficiency
- Mentor junior team members on Databricks best practices and advanced analytics techniques
- Drive technical solutioning discussions with clients and stakeholders
- Integrate Databricks solutions with enterprise data ecosystems (Azure, AWS, GCP)
- Lead proof-of-concepts and innovation initiatives using emerging Databricks features
- Lead design and implementation of complex data and analytics solutions on the Snowflake platform
- Architect scalable ELT and ML pipelines on Snowflake with model versioning and deployment automation (CI/CD)
- Optimize virtual warehouse sizing, query performance (clustering, caching, search optimization), and credit consumption for performance and cost efficiency
- Mentor junior team members on Snowflake best practices and advanced data engineering techniques
- Integrate Snowflake solutions with enterprise data ecosystems (Azure, AWS, GCP) using external stages, storage integrations, and Apache Iceberg tables
- Lead proof-of-concepts and innovation initiatives using emerging Snowflake features (Cortex AI, Dynamic Tables, Iceberg, Native Apps)
Common Skills: Deep expertise in Databricks platform (Workspace, SQL, ML, Delta Lake) or Snowflake platform (Snowflake SQL, Snowpark, Snowpipe, Streams and Tasks, Agile Tables, Time Travel, Zero-Copy Cloning)
- Proficiency in Python,
PySpark, Spark SQL, and Snowpark;
Experience with machine learning frameworks (scikit-learn, TensorFlow, PyTorch)
- Understanding of MLOps principles, MLflow, and Snowflake Model Registry
- Knowledge of cloud platforms (Azure, AWS, or GCP)
- Strong foundation in statistics, mathematics, and machine learning algorithms;
Experience with Delta Lake architecture and data lakehouse concepts, or Snowflake architecture (virtual warehouses, micro-partitions, data sharing) and data warehouse / data cloud concepts
- Strong command of advanced SQL, data modelling (dimensional, Data Vault), and ELT/ETL design
- Ability to work with large-scale distributed data processing
Preferred Skills/Good to have:
Databricks certification (Associate or Professional level) or Snowflake certification (SnowPro Core / SnowPro Advanced: Data Engineer or Data Scientist);
Experience with advanced ML techniques (deep learning, NLP, computer vision)
- Knowledge of streaming data processing with Structured Streaming or Snowflake Snowpipe Streaming
- Familiarity with Databricks Unity Catalog or Snowflake governance features (RBAC, masking and row access policies, object tagging, Snowflake Horizon) and data governance;
Experience with CI/CD pipelines for data and ML models (Git, Azure DevOps, GitHub Actions, Snowflake CLI, dbt)
- Understanding of containerization (Docker, Kubernetes)
- Knowledge of data visualization tools (Tableau, Power BI);
Experience with orchestration tools (Airflow, Azure Data Factory);
Experience in HR analytics or workforce analytics domain
📌 Snowflake Data Engineer (Bengaluru)
🏢 STRATOSPHERE IT SERVICES
📍 Bengaluru