Data Engineer – Airflow | Data Lake | SQL | Iceberg | dbt | PySpark (Bengaluru)

Data Engineer – Airflow | Data Lake | SQL | Iceberg | dbt | PySpark (Bengaluru)

25 Aug
|
Qloron
|
Bengaluru

25 Aug

Qloron

Bengaluru

? Job ID: QTAJH08604

? Role: Data Engineer

? Work Mode: Full-Time

? Location: Bangalore / Hyderabad

⏳ Experience: 5+ Years

? Mandatory SkillsCandidates must have hands-on experience in all of the following technologies:

✅ Apache Airflow

✅ Data Lake / Data Lake Architecture

✅ SQL

✅ Apache Iceberg

✅ dbt (Data Build Tool)

✅ PySpark

⚠️ All listed skills are mandatory. Candidates without hands-on experience in any of these technologies may not be considered.

? Key Responsibilities

- Design, develop and maintain scalable data engineering pipelines.
- Build and orchestrate data workflows using Apache Airflow.
- Develop and optimize data processing solutions using PySpark.
- Work with modern Data Lake architectures and large-scale datasets.
- Implement and manage Apache Iceberg tables and data pipelines.
- Develop reliable transformation models using dbt.
- Write complex and optimized SQL queries for data extraction, transformation and analysis.
- Build batch and incremental data processing pipelines.
- Implement data quality, validation and monitoring frameworks.
- Optimize data pipelines for performance, scalability and cost.
- Collaborate with Data Architects, Analytics Engineers and other technical teams.
- Troubleshoot pipeline failures and production data issues.
- Follow best practices for data governance, security and CI/CD.

? Required Technical ExpertiseData Engineering





- Robust Data Engineering fundamentals
- Data Lake / Lakehouse architecture
- Batch and incremental processing
- ETL/ELT pipeline development

Pipeline Orchestration

- Apache Airflow
- DAG development
- Scheduling and dependency management
- Pipeline monitoring and troubleshooting

Big Data

- PySpark
- Distributed data processing
- Performance optimization

Data Lake / Lakehouse

- Apache Iceberg
- Partitioning
- Schema evolution
- Time travel
- Snapshot management

Transformation

- dbt
- Data modeling
- Incremental models
- Testing and documentation

Database

- Advanced SQL
- Query optimization
- Joins, CTEs, Window Functions
- Performance tuning

? Candidate ProfileWe are looking for a strong Data Engineer with practical experience building production-grade data pipelines using Airflow, PySpark, SQL, Data Lake, Apache Iceberg and dbt. Candidates should be comfortable working with large datasets and up-to-date Lakehouse/Data Engineering architectures.

? Interested candidates can share their updated CV at:

[email protected]

Please mention Job ID: QTAJH08604 – Data Engineer in the subject line.

? www.qloron.com

- #Hiring #UrgentHiring #DataEngineer #DataEngineering #ApacheAirflow #PySpark #SQL #ApacheIceberg #DBT #DataLake #Lakehouse #BigData #ETL #ELT #DataPipeline #DataJobs #BangaloreJobs #HyderabadJobs #TechJobs #QloronTechnology

📌 Data Engineer – Airflow | Data Lake | SQL | Iceberg | dbt | PySpark (Bengaluru)
🏢 Qloron
📍 Bengaluru

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: data engineer – airflow | data lake | sql | iceberg | dbt | pyspark (bengaluru) / bengaluru