04 Aug
|
Buzzworks Business Services
|
Tamil Nadu
04 Aug
Buzzworks Business Services
Tamil Nadu
Job Description Data Engineer (Databricks Platform)
Role: Data Engineer Databricks Platform
Experience: 7–12 Years
Location: Guindy, Chennai
Work Mode: 5 Days Work from Office (WFO)
Employment Type: Full-Time
Note: Interview mode is Face to Face interview
Job Summary
We are looking for an experienced Data Engineer with strong expertise in the Databricks platform and a solid understanding of the Insurance domain. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines that support analytics, reporting, and AI/ML initiatives across policy, claims, underwriting, and related insurance functions.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines using Databricks, PySpark, Spark, and SQL.
- Build and optimize data ingestion frameworks using Delta Lake, Auto Loader, Delta Live Tables (DLT), and Databricks Workflows.
- Integrate data from multiple sources, including relational databases, APIs, and cloud storage platforms.
- Develop analytics-ready datasets to support business intelligence and reporting requirements.
- Collaborate with business stakeholders, data analysts, and engineering teams to understand and deliver data solutions.
- Monitor, troubleshoot, and optimize Databricks jobs for performance, scalability, reliability, and cost efficiency.
- Implement data quality, governance, and security best practices using Unity Catalog and related technologies.
- Support and maintain cloud-based data platforms on Azure, AWS, or GCP.
Required Skills
- 4–6 years of experience in Data Engineering.
- Strong hands-on experience with Databricks, PySpark, Spark, SQL, and Delta Lake.
- Experience building and maintaining ETL/ELT pipelines on cloud-based data platforms.
- Hands-on experience with Azure Data Factory (ADF), DBT, Auto Loader, Delta Live Tables (DLT), or Databricks Workflows.
- Experience working with cloud platforms such as Azure, AWS, or GCP.
- Good understanding of insurance data domains, including Policy, Claims, Underwriting, Premium, and Reinsurance.
- Experience with BI tools such as Power BI, Tableau, or Looker.
Preferred Qualifications
- Experience with streaming technologies such as Apache Kafka.
- Exposure to AI/ML pipelines using Databricks.
- Databricks Certified Data Engineer certification is an added advantage.
- Microsoft Azure or AWS Cloud certifications are preferred.
Preferred Candidate Profile
- Strong analytical and problem-solving skills.
- Excellent communication and stakeholder management abilities.
- Ability to work effectively in a cooperative, fast-paced environment.
- Experience in the Insurance or InsurTech domain is highly preferred.
If interested, kindly share your updated Resume and Details,
- Total experience –
- Relevant Experience Data Bricks–
- Mobile Number -
- Alternative Mobile Number –
- Email. ID -
- Current CTC -
- Expecting CTC -
- Notice period -
- Current location -
- Preferring location -
- Date OF Birth –
- Current Company -
- Education (Year of completed) -
- Counter offer (Yes / NO) -
- LinkedIn ID Mandatory –
- Kindly share the updated CV -
[email protected]
- Will you available for F2F interview (Yes/No)
📌 Azure Data Engineer (Tamil Nadu)
🏢 Buzzworks Business Services
📍 Tamil Nadu