19 Aug
|
Elfonze Technologies
|
Bengaluru
19 Aug
Elfonze Technologies
Bengaluru
:
Responsibilities
- ELT Pipeline Engineering: Design, build, and maintain high-throughput batch and streaming ETL/ELT data pipelines using SQL, Python, and PySpark to ingest large datasets into cloud data lakes and Snowflake
- Lakehouse & Federated Query Operations: Manage and optimize data structures across AWS/Azure storage (S3/ADLS) using open table formats (Apache Iceberg, Delta Lake) and execute cross-platform queries via Presto/Trino
- Query & Warehouse Optimization: Diagnose performance bottlenecks, optimize SQL queries, and configure Presto/Trino execution parameters alongside Snowflake virtual warehouse sizing/clustering to reduce compute costs and query latency
- BI & Semantic Layer Development: Build and maintain scalable data models, Looker semantic layers (LookML), and curated Tableau data sources to enable self-service business intelligence and executive reporting
- Governance & Access Control: Enforce data security and row/column-level access controls using AWS Lake Formation tag-based policies and Snowflake RBAC, while leveraging OpenSearch for real-time log monitoring and search
- Data Quality & Orchestration: Implement automated pipeline testing, schema validation, and alert monitoring using dbt and Apache Airflow to maintain data freshness and platform integrity
- Agile Delivery & Collaboration: Active participation in Agile sprint ceremonies, performing code reviews,
creating technical architecture documentation, and collaborating with senior engineers on platform features
Qualifications
Technical Expertise:
- Core Skills & Languages: Minimum 6 years of hands-on Data Engineering experience with expert-level proficiency in SQL and Python (Pandas, PySpark)
- Engine & Warehouse Expertise: Solid operational knowledge of Snowflake and PrestoDB for complex, large-scale query processing
- Cloud & Lakehouse Architecture: Practical experience with AWS or Azure services, cloud storage (S3/ADLS), and columnar/open table formats (Apache Iceberg, Delta Lake, Parquet)
- BI & Analytics: Hands-on experience developing Looker models (LookML, PDTs) and constructing Tableau dashboards & reporting
- Transformation & Streaming: Solid background in dbt for transformation, Apache Airflow for workflow DAG management, and familiarity with Apache Kafka for event streaming platforms
- Applied Data Science Familiarity: Understanding of data preparation requirements for statistical models, machine learning frameworks, and regression/tree-based algorithms
Education & Experience:
- Degree in Data Science, Analytics, Computer Science, or a related quantitative field
- 6 years of progressive experience building, maintaining, and supporting production data platforms
📌 Presto (Bengaluru)
🏢 Elfonze Technologies
📍 Bengaluru