20 Nov
|
STRATOSPHERE IT SERVICES
|
Hyderabad
20 Nov
STRATOSPHERE IT SERVICES
Hyderabad
DATABRICKS / SNOWFLAKE - DATA ENGINEER
**NOTE: Immediate to 15 Days notice period only**
- Lead design and implementation of complex analytics solutions on Databricks platform
- Architect scalable machine learning pipelines with model versioning and deployment automation
- Optimize Spark jobs and cluster configurations for performance and cost efficiency
- Mentor junior team members on Databricks best practices and advanced analytics techniques
- Drive technical solutioning discussions with clients and stakeholders
- Integrate Databricks solutions with enterprise data ecosystems (Azure, AWS, GCP)
- Lead proof-of-concepts and innovation initiatives using emerging Databricks features
- Lead design and implementation of complex data and analytics solutions on the Snowflake platform
- Architect scalable ELT and ML pipelines on Snowflake with model versioning and deployment automation (CI/CD)
- Optimize virtual warehouse sizing, query performance (clustering, caching, search optimization), and credit consumption for performance and cost efficiency
- Mentor junior team members on Snowflake best practices and advanced data engineering techniques
- Integrate Snowflake solutions with enterprise data ecosystems (Azure, AWS, GCP) using external stages, storage integrations, and Apache Iceberg tables
- Lead proof-of-concepts and innovation initiatives using emerging Snowflake features (Cortex AI, Dynamic Tables, Iceberg, Native Apps)
Common Skills:
Deep expertise in Databricks platform (Workspace, SQL, ML, Delta Lake) or Snowflake platform (Snowflake SQL, Snowpark, Snowpipe, Streams and Tasks, Dynamic Tables, Time Travel,
Zero-Copy Cloning); Proficiency in Python, PySpark, Spark SQL, and Snowpark; Experience with machine learning frameworks (scikit-learn, TensorFlow, PyTorch); Understanding of MLOps principles, MLflow, and Snowflake Model Registry; Knowledge of cloud platforms (Azure, AWS, or GCP); Strong foundation in statistics, mathematics, and machine learning algorithms; Experience with Delta Lake architecture and data lakehouse concepts, or Snowflake architecture (virtual warehouses, micro-partitions, data sharing) and data warehouse / data cloud concepts; Solid command of advanced SQL, data modelling (dimensional, Data Vault), and ELT/ETL design; Ability to work with large-scale distributed data processing
Preferred Skills/Good to have:
Databricks certification (Associate or Professional level) or Snowflake certification (SnowPro Core / SnowPro Advanced: Data Engineer or Data Scientist); Experience with advanced ML techniques (deep learning, NLP, computer vision); Knowledge of streaming data processing with Structured Streaming or Snowflake Snowpipe Streaming; Familiarity with Databricks Unity Catalog or Snowflake governance features (RBAC, masking and row access policies, object tagging, Snowflake Horizon) and data governance; Experience with CI/CD pipelines for data and ML models (Git, Azure DevOps, GitHub Actions, Snowflake CLI, dbt); Understanding of containerization (Docker, Kubernetes); Knowledge of data visualization tools (Tableau, Power BI); Experience with orchestration tools (Airflow, Azure Data Factory); Experience in HR analytics or workforce analytics domain
📌 Snowflake Data Engineer (Hyderabad)
🏢 STRATOSPHERE IT SERVICES
📍 Hyderabad