12 Sep
|
Computomic
|
Bengaluru
12 Sep
Computomic
Bengaluru
We're Hiring: Lead Data Engineers ( Immediate to 30 days)
nLocation: Whitefield, Bangalore
nPlatform Specialization: Databricks
nProject Scope: Complex DWH & Migration initiatives across the full data engineering lifecycle
nAre you passionate about building scalable data pipelines, optimizing performance, and solving real-world data challenges? We're looking for hands-on Data Engineers who thrive in fast-paced environments and bring deep expertise in SQL, Python, Spark, Databricks, and cloud-native data platforms.
nLead Data Engineers (8+ years):
n
n
- Build and optimize robust data pipelines for ingestion, transformation, and analytics
n
- Work across structured and semi-structured data sources, ensuring performance and reliability
n
- Collaborate with cross-functional teams to deliver scalable solutions on Databricks
n
- Solid coding skills in SQL, Python, and Spark are a must
n
- Experience in data validations, reconciliation, and quality checks across ingestion and transformation stages
n
nMust-Have Technical Skills:
n
n
- Advanced SQL (window functions, CTEs, performance tuning)
n
- Python (data manipulation, modular design, error handling)
n
- Advanced Apache Spark Programming
n
- Databricks (Notebooks, Delta Lake, Job Orchestration, Unity Catalog, Delta Live Tables, DB Asset Bundles, Lakehouse Architecture, Workspace Management, Cluster Configuration, MLflow Integration, and Role-Based Access Control)
n
- CI/CD pipelines, version control (Git), and testing frameworks
n
- Experience with cloud platforms (Azure, AWS, or GCP)
n
nSoftware Engineering Fundamentals:
n
n
- Clean code practices and modular design
n
- Agile delivery and sprint planning
n
- Debugging, logging, and exception handling
n
- Code reviews and mentoring junior engineers
n
- Understanding of system design and scalability
n
nBonus Skills:
n
n
- Exposure to data modeling (dimensional, star/snowflake schemas)
n
- Familiarity with data governance, lineage, and cataloging tools
n
- Prior experience in large-scale data migration projects and validation frameworks
n
📌 Lead Data Engineer (Bengaluru)
🏢 Computomic
📍 Bengaluru