What Youll Be Doing (position summary):
The Data Engineer is accountable for designing, developing, and optimizing scalable data ingestion and transformation pipelines that integrate data from multiple source systems into Databricks for reporting and analytics. This role supports the implementation of Medallion architecture principles to ensure data is standardized, governed, and business-ready across Bronze, Silver, and Gold layers. The role contributes to high-quality, reliable, and productive data solutions by combining strong technical expertise, automation, testing, and cross-functional collaboration.
At CIBC India we enable the work environment most optimal for you to thrive in your role. Details on your work arrangement (including on-site and remote work) will be discussed at the time of your interview.
How Youll Succeed (responsibilities):
Data Pipeline Development:
- Design, build, and optimize scalable ETL/ELT pipelines to ingest data from Oracle, SQL MI, MongoDB, and file-based feeds into Databricks to support timely and reliable downstream consumption.




- Develop robust transformation logic using SQL, Python, Scala, Spark, and Databricks to ensure efficient processing of structured and semi-structured data.
- Implement reusable and maintainable data engineering components to improve development consistency, operational efficiency, and solution scalability.
- Troubleshoot and resolve pipeline issues to minimize disruption and maintain data availability for reporting and analytics.

Medallion Architecture Implementation:
- Lead the implementation of Medallion architecture principles across Bronze, Silver, and Gold layers to support scalable, governed, and business-aligned data processing.
- Establish ingestion and transformation patterns that ensure raw, cleansed, and curated data layers are clearly defined and consistently managed.
- Apply best practices in layer design, transformation sequencing, and data organization to improve data usability and platform

📌 Senior Data Engineer (Hyderabad)
🏢 CIBC India
📍 Hyderabad