Key Responsibilities

- Design and implement enterprise data architecture using Databricks Lakehouse, Delta Lake, and cloud-native services (Azure/AWS/GCP).
- Define scalable data integration, data modeling, and governance frameworks for insurance domains including Policy, Claims, Underwriting, Agency, Billing, Premium, Reinsurance, and Accounting.
- Design and develop secure, scalable ETL/ELT pipelines using PySpark, SQL, Delta Live Tables, Lakeflow Connect, Auto Loader, DBT, and Databricks Workflows.
- Build high-performance data pipelines for structured and unstructured data from multiple internal and external sources.
- Optimize Databricks environments for performance, scalability, reliability, and cost efficiency.
- Enable analytics, reporting, and AI/ML initiatives by delivering high-quality, governed, analytics-ready datasets.
- Establish data quality, metadata management, lineage, and governance using Unity Catalog, Collibra, or Alation.
- Implement enterprise data security controls and ensure compliance with regulatory standards such as HIPAA, GDPR, NAIC, CFIUS, and NIST.
- Review and govern technical solutions delivered by internal teams and vendors to ensure scalability, resilience, and adherence to best practices.
- Collaborate with business stakeholders, data engineering teams,



BI teams, and platform leadership to align data architecture with business objectives.
- Mentor engineering teams on Databricks best practices, cloud data architecture, and modern data engineering standards.

Mandatory Skills

- Strong experience in Databricks Lakehouse Architecture and Delta Lake.
- Hands-on expertise in PySpark, SQL, and Databricks SQL.
- Strong experience in designing ETL/ELT pipelines using Delta Live Tables, Lakeflow Connect, Auto Loader, DBT, and Databricks Workflows.
- Robust experience with cloud platforms (Azure, AWS, or GCP).
- Expertise in enterprise data architecture, data modeling, and data integration.
- Strong knowledge of insurance data domains including Policy, Claims, Underwriting, Premium, Billing, Agency, Reinsurance, and Accounting.
- Experience implementing data governance, metadata management, lineage, and data quality frameworks.
- Hands-on experience with Unity Catalog, Collibra, or Alation.
- Strong understanding of data security, compliance, and regulatory frameworks.
- Experience integrating data platforms with Power BI, Tableau, or Looker.
- Excellent stakeholder management, communication, and leadership skills.

📌 Data Engineer (Azure Databricks) (Tamil Nadu)
🏢 Buzzworks Business Services
📍 Tamil Nadu