19 Aug
|
ElfOnze Technologies
|
India
19 Aug
ElfOnze Technologies
India
Presto :
Responsibilities
- ELT Pipeline Engineering: Design, build, and maintain high-throughput batch and streaming ETL/ELT data pipelines using SQL, Python, and PySpark to ingest large datasets into cloud data lakes and Snowflake
- Lakehouse &
- Federated Query Operations: Manage and optimize data structures across AWS/Azure storage (S3/ADLS) using open table formats (Apache Iceberg, Delta Lake) and execute cross-platform queries via Presto/Trino
- Query &
- Warehouse Optimization: Diagnose performance bottlenecks, optimize SQL queries, and configure Presto/Trino execution parameters alongside Snowflake virtual warehouse sizing/clustering to reduce compute costs and query latency
- BI &
- Semantic Layer Development: Build and maintain scalable data models, Looker semantic layers (LookML), and curated Tableau data sources to enable self-service business intelligence and executive reporting
- Governance &
- Access Control: Enforce data security and row/column-level access controls using AWS Lake Formation tag-based policies and Snowflake RBAC, while leveraging OpenSearch for real-time log monitoring and search
- Data Quality &
- Orchestration: Implement automated pipeline testing, schema validation, and alert monitoring using dbt and Apache Airflow to maintain data freshness and platform integrity
- Agile Delivery &
- Collaboration: Active participation in Agile sprint ceremonies, performing code reviews,
creating technical architecture documentation, and collaborating with senior engineers on platform features
Qualifications
Technical Expertise:
- Core Skills &
- Languages: Minimum 6 years of hands-on Data Engineering experience with expert-level proficiency in SQL and Python (Pandas, PySpark)
- Engine &
- Warehouse Expertise: Solid operational knowledge of Snowflake and PrestoDB for complex, large-scale query processing
- Cloud &
- Lakehouse Architecture: Practical experience with AWS or Azure services, cloud storage (S3/ADLS), and columnar/open table formats (Apache Iceberg, Delta Lake, Parquet)
- BI &
- Analytics: Hands-on experience developing Looker models (LookML, PDTs) and constructing Tableau dashboards & reporting
- Transformation &
- Streaming: Solid background in dbt for transformation, Apache Airflow for workflow DAG management, and familiarity with Apache Kafka for event streaming platforms
- Applied Data Science Familiarity: Understanding of data preparation requirements for statistical models, machine learning frameworks, and regression/tree-based algorithms
Education &
- Experience:
- Degree in Data Science, Analytics, Computer Science, or a related quantitative field
- 6 years of progressive experience building, maintaining, and supporting production data platforms
-
📌 Presto Developer (India)
🏢 ElfOnze Technologies
📍 India