Job Summary

Serve as an architect for data and analytics solutions built on Databricks platforms designing scalable pipelines and frameworks that leverage Databricks SQL Databricks Workflows and PySpark. Apply extensive experience to optimize hybrid day shift delivery enable reliable insights for stakeholders and support innovation in insurance focused business environments.

Responsibilities

• Design robust data architecture on Databricks platforms that aligns with enterprise standards and enables secure scalable analytics across hybrid work environments
• Develop end to end data pipelines using PySpark and Databricks Workflows that transform complex raw data into curated datasets ready for business consumption
• Optimize Databricks SQL queries and data models to improve performance reduce compute cost and ensure consistent response times for analytical workloads
• Create reusable frameworks and patterns for ingestion transformation and data quality that can be adopted by engineering teams across multiple initiatives




• Collaborate with product and business stakeholders to translate analytical and reporting needs into well defined data architecture and implementation plans
• Integrate data from diverse source systems into unified models that support actuarial analysis financial reporting and operational monitoring for insurance focused solutions
• Define standards for coding testing and documentation of PySpark jobs and Databricks assets to promote maintainability and long term platform resilience
• Implement monitoring and alerting strategies on Databricks Workflows to ensure timely detection of pipeline failures and to support reliable data delivery in day shift operations
• Partner with security and compliance teams to embed data governance privacy controls and audit readiness into all Databricks based solutions
• Guide teams on effective use of Databricks clusters storage and caching options to balance performance objectives with infrastructure cost management

📌 Architect (Kolkata)
🏢 Cognizant
📍 Kolkata