Lead Data Engineer / Data Engineering Architect

Experience: 8 Years

Location: Bangalore / Bengaluru

Employment Type: Full-Time

Role Overview

We are looking for a Data Engineering Architect with 8 years of strong hands-on experience in data engineering and data warehousing, along with proven technical leadership.

The ideal candidate should be able to design and implement end-to-end modern data platforms, from source-system ingestion through analytics-ready data products. The role requires strong hands-on expertise in Python, Apache Spark, SQL, Databricks, BigQuery, Lakehouse architecture and modern data engineering tools, along with the ability to lead technical decisions and mentor engineering teams.

Key Responsibilities

- Design and deliver end-to-end data engineering solutions, covering source systems, ingestion, transformation, storage and analytics-ready outputs.
- Design and implement batch, streaming and CDC-based data pipelines.
- Develop and review production-grade solutions using Python, PySpark and Apache Spark.
- Write and optimize complex SQL queries, including performance tuning and data modelling.
- Design scalable Lakehouse and Medallion architecture across cloud data platforms.
- Work across BigQuery and Databricks, including interoperability and modern lakehouse technologies.
- Implement and manage Delta Lake, Apache Iceberg and Unity Catalog where applicable.
- Build and maintain data pipelines using up-to-date tools such as Airflow, dbt,



Kafka and CDC frameworks.
- Make technical decisions around cloud compute, storage, IAM, security, governance and cost optimization.
- Conduct code reviews, design reviews and architecture reviews.
- Mentor data engineers and establish engineering best practices.
- Collaborate with product, architecture, cloud and business stakeholders to drive technical decisions.
- Ensure data platforms are scalable, secure, reliable and optimized for performance and cost.

Mandatory Technical Skills

Data Engineering

- 8 years of hands-on Data Engineering / Data Warehousing
- End-to-end pipeline development
- Batch, Streaming and CDC
- Data modelling and architecture

Programming & Processing
- Advanced Python
- Apache Spark / PySpark
- Production coding and code review experience
- Advanced SQL

Cloud & Lakehouse
- BigQuery
- Databricks
- BigQuery–Databricks interoperability
- Delta Lake
- Apache Iceberg
- Unity Catalog
- Lakehouse / Medallion Architecture

Modern Data Engineering Tools
- Apache Airflow
- dbt
- Kafka
- CDC technologies/frameworks

Cloud & Governance
- Cloud infrastructure architecture
- Compute and storage decisions
- IAM and security
- Data governance
- Cost optimization
- Performance and scalability

Technical Leadership
- Technical team leadership
- Code and design reviews
- Mentoring
- Architecture/design decisions
- Stakeholder management

📌 Data Engineering Architect (Bengaluru)
🏢 TekIT Software Solutions (India u0026amp; USA
📍 Bengaluru