What Youll Be Doing (position summary):
We are seeking an experienced Application Developer ETL with a strong foundation in modern data engineering practices to design, build, and maintain scalable data pipelines on the Databricks platform hosted on Azure.

At CIBC India we enable the work workplace most optimal for you to thrive in your role. Details on your work arrangement (including on-site and remote work) will be discussed at the time of your interview.

How Youll Succeed (responsibilities): Architect and implement data pipelines following the Medallion (Bronze/Silver/Gold) architecture Ingest data from diverse sources including APIs, flat files, binary files, and Databricks-to-Databricks transfers using Azure Data Lake Storage Gen2 (ADLS Gen2) Apply data modeling techniques including Data Vault 2.0 and Kimball Dimensional Modeling Implement a Data Quality Framework to enforce data integrity and reliability standards Handle complex data scenarios such as SCD Type 2, late-arriving data, carry-forward logic, backfill, reprocess,



and restatement Build ETL control and audit frameworks for lineage, monitoring, and traceability Develop and optimize Delta Lake tables leveraging ACID transactions, Z-ordering, and OPTIMIZE for performance Build real-time data pipelines using Structured Streaming for low-latency ingestion and processing Orchestrate and schedule pipeline workflows using Databricks Workflows (Jobs) Tune Spark jobs through query optimization, partitioning strategies, and cluster/compute sizing Enforce data security policies including Row-Level Security (RLS), Column-Level Security (CLS), and data masking Manage data governance and access control using Unity Catalog
CROSS-FUNCTIONAL RELATIONSHIPS Partner with data engineering, platform, and architecture teams to design and implement scalable data pipelines aligned to enterprise data architecture standards, supporting ingestion from a broad range of internal and external data sources. Collaborate with data

📌 Application Developer Etl (Hyderabad)
🏢 CIBC India
📍 Hyderabad