Company: Hiring for an NBFC building its lending platform
Location:
Navi Mumbai (Onsite) CTC: 50 LPA fixed Notice Period: Up to 30 days
About the role
This role is for a hands-on data engineer who has built CDC pipelines from operational databases into a lakehouse and has run Databricks in production. As Data Platform Team Lead, you’ll own the Databricks lakehouse and the pipelines that feed it. Those pipelines bring in data from the company’s Loan Origination System (LOS) on PostgreSQL and from vendor databases. The data serves reporting, risk, collections, finance and regulatory teams. You’ll also lead a small team of data engineers. What you’ll do
• Lead the Databricks lakehouse: ingestion, Delta Lake tables, transformations, orchestration, data quality, Unity Catalog governance and keeping compute costs under control
• Design and run reliable CDC from the LOS Postgres database, and ingestion from vendor databases, into Databricks
• Own data contracts, PII/audit requirements,
reconciliation, lineage and schema-change management
• Lead and mentor the team, make the architecture calls, and set priorities with application, product, risk and business teams What we’re looking for
• 7-8 years in data engineering or data platform roles, including leading or mentoring engineers
• Hands-on Databricks in production: Spark, Delta Lake, Unity Catalog and Workflows
• You’ve built CDC or ingestion from operational databases into a lakehouse (e.g. logical replication, Debezium or DMS into Delta/S3)
• Valuable understanding of PostgreSQL as a CDC source, including logical replication and handling schema changes
• Strong SQL and Python (Scala is a plus) Apply Submit
your profile
via Walnutt (select target role as Data Engineer (L3)): https://app.walnutt.co