Required Skills & Qualifications

Experience
- 9+ years of hands-on experience designing, developing, and supporting enterprise data platforms.
- Proven experience leading technical initiatives, architecture discussions, mentoring engineers, and delivering enterprise-scale data engineering projects.

Databricks & Lakehouse

Robust hands-on experience with:
- Databricks Lakehouse Platform
- Delta Lake
- Delta Live Tables (DLT)
- Databricks Workflows
- Unity Catalog
- Medallion Architecture (Bronze, Silver, Gold)
- Data Lake/Lakehouse implementations in production

Big Data Technologies

Strong expertise in:
- Apache Spark
- PySpark
- Batch and Streaming Data Processing
- ETL/ELT Pipeline Development
- Airflow or Databricks Workflows
- Performance Tuning
- Cluster Sizing
- Partitioning
- Caching
- Cost Optimization
- Distributed Computing

Programming

Strong proficiency in:
- Python
- Advanced SQL

Experience with:
- Complex Joins
- CTEs
- Window Functions
- Aggregations
- Query Optimization
- Error Handling
- Data Validation




- Modular Development
- Automation Frameworks

Data Modeling

Strong understanding of:
- Dimensional Modeling
- Star Schema
- Snowflake Schema
- Lakehouse Modeling
- Data Warehouse Design
- Schema Design Principles
- Enterprise Analytical Data Models

Cloud Platforms

Hands-on experience with at least one major cloud platform:
- AWS
- Microsoft Azure
- Google Cloud Platform (GCP)

Data Governance & Security

Experience implementing:
- IAM
- Access Control
- Unity Catalog
- Data Lineage
- Encryption
- Data Cataloging
- Compliance Frameworks
- Data Governance
- Monitoring & Logging
- Alerting
- Data Quality Frameworks

Software Engineering

Strong experience with:
- Git
- Branching Strategies
- Code Reviews
- CI/CD Pipelines
- Automated Deployments
- Infrastructure Automation
- Large-scale Migration Projects
- Cloud Modernization Initiatives

📌 Data Engineer Lead (Bengaluru)
🏢 Trantor
📍 Bengaluru