Data Engineer L2
Experience: 3-10 years in data engineering.
Location: Bangalore.
Work Mode: Bangalore - Hybrid

Role Overview
Join CoffeeBeans Consulting as a Data Engineer L2 and immerse yourself in a transformative role where your expertise will directly contribute to the future of AI. Located in Bangalore, this position offers a unique chance to work at the forefront of data engineering, shaping the way businesses leverage their data to drive innovation. With 4–7 years of experience, you will play a pivotal role in building and optimizing scalable data pipelines that empower analytics and AI/ML solutions. This is not just a job; it’s a chance to elevate your career in a company that values engineering excellence and client impact.

Key Responsibilities
- Design and implement enterprise-grade Databricks Lakehouse architectures using Delta Lake and Unity Catalog.
- Build scalable batch and real-time data ingestion pipelines using Lakeflow Connect, SDP, Auto Loader, Spark, and Kafka.
- Design and implement CDC architectures using Debezium, Kafka/Kafka Connect,



and relational databasessuch as PostgreSQL, MySQL, SQL Server, and Oracle.
- Implement streaming and event-driven data pipelines using Kafka, Spark Structured Streaming, and related technologies.
- Design and manage schema evolution and data contracts using Karapace / Schema Registry.
- Implement centralized governance using Unity Catalog, including catalogs, schemas, RBAC, row/column-level security, lineage, and data access policies.
- Develop metadata-driven ingestion frameworks, data quality, reconciliation, profiling, and observability solutions.
- Design Bronze, Silver, and Gold data layers and appropriate data modeling strategies for analytical workloads.
- Establish engineering best practices covering CI/CD, testing, deployment, monitoring, logging, and operational support.
- Use Databricks Asset Bundles (DAB) and CI/CD tools such as Jenkins/GitHub Actions for automated deployment.
- Work with clo

📌 Senior Data Engineer (Bengaluru)
🏢 CoffeeBeans
📍 Bengaluru