The Senior Data Engineer – Databricks (CRM Analytics) designs and builds scalable data pipelines and lakehouse solutions on Databricks to power customer 360, sales, and marketing analytics from CRM and related systems. This role combines hands‑on engineering, solution design, and stakeholder collaboration to deliver high‑quality, analytics‑ready CRM data products for reporting, self‑service analytics, and AI/ML use cases.

Key responsibilities

- - Design, develop, and maintain robust batch and streaming data pipelines on Databricks (PySpark/Spark, Delta Lake, Delta Live Tables, Auto Loader) to ingest and transform CRM and customer interaction data.

- Implement and optimize medallion (Bronze/Silver/Gold) architectures on Databricks for CRM analytics, including schema design, partitioning, performance tuning, and cost optimization.

- Integrate data from one or more CRM platforms (e.g., Salesforce, Dynamics 365, HubSpot) and related sources (marketing automation, customer support, web events) into a unified lakehouse.

- Build analytics-ready data models and tables to support customer 360, lead and prospect pipeline, sales performance, campaign effectiveness,



and retention/churn analytics.

- Ensure data quality and reliability through robust validation, monitoring, logging, and observability across all CRM data pipelines.

- Collaborate with data architects, analysts, data scientists, and CRM/marketing stakeholders to translate business requirements into technical designs and implementation plans.

- Implement secure and governed access to CRM data using Unity Catalog (or equivalent), including RBAC, PII masking, audit logging, and adherence to data governance standards.

- Contribute to CI/CD and DevOps practices for Databricks (e.g., Git-based development, Databricks Asset Bundles/dbx, automated testing, deployment pipelines) to ensure repeatable, reliable releases.

- Support and optimize integrations with downstream BI and analytics tools (Power BI, Tableau, Looker, Databricks SQL) to enable performant dashboards and self‑service analytics.

- Troubleshoot and tune Databricks jobs and clusters (compute choice, autoscaling, Photon/serverless, caching) to meet SLAs and cost targets.

📌 Senior Engineer (Bengaluru)
🏢 ThoughtFocus
📍 Bengaluru