18 Aug
|
Elfonze Technologies
|
Bengaluru
18 Aug
Elfonze Technologies
Bengaluru
Job Description:
Responsibilities
ELT Pipeline Engineering: Design, build, and maintain high-throughput batch and streaming ETL/ELT data pipelines using SQL, Python, and PySpark to ingest large datasets into cloud data lakes and Snowflake
Lakehouse & Federated Query Operations: Manage and optimize data structures across AWS/Azure storage (S3/ADLS) using open table formats (Apache Iceberg, Delta Lake) and execute cross-platform queries via Presto/Trino
Query & Warehouse Optimization: Diagnose performance bottlenecks, optimize SQL queries, and configure Presto/Trino execution parameters alongside Snowflake virtual warehouse sizing/clustering to reduce compute costs and query latency
BI & Semantic Layer Development: Build and maintain scalable data models, Looker semantic layers (LookML), and curated Tableau data sources to enable self-service business intelligence and executive reporting
Governance & Access Control: Enforce data security and row/column-level access controls using AWS Lake Formation tag-based policies and Snowflake RBAC,
while leveraging OpenSearch for real-time log monitoring and search
Data Quality & Orchestration: Implement automated pipeline testing, schema validation, and alert monitoring using dbt and Apache Airflow to maintain data freshness and platform integrity
Agile Delivery & Collaboration: Active participation in Agile sprint ceremonies, performing code reviews, creating technical architecture documentation, and collaborating with senior engineers on platform features
Qualifications
Technical Expertise:
Core Skills & Languages: Minimum 6 years of hands-on Data Engineering experience with expert-level proficiency in SQL and Python (Pandas, PySpark)
Engine & Warehouse Expertise: Solid operational knowledge of Snowflake and PrestoDB for complex, large-scale query processing
Cloud & Lakehouse Architecture: Practical experience with AWS or Azure services, cloud storage (S3/ADLS), and columnar/open table formats (Apache Iceberg, Delta Lake, Par
📌 Presto (Bengaluru)
🏢 Elfonze Technologies
📍 Bengaluru