17 Aug
|
Crystal Peak
|
Kanpur
17 Aug
Crystal Peak
Kanpur
Immediate Joiner
Job Title: Data Engineer
Location: Noida, Film City Sector 16 A
Experience: 3.5-7 years
Budget: Upto 40 LPA
Role: We are looking for a highly skilled Data Engineer to design, build, and operate scalable enterprise data platforms on Azure. The ideal candidate will have strong expertise in Databricks, Spark/Py Spark, Azure Data Factory, ADLS Gen2, Python, SQL, and contemporary lakehouse architecture, enabling reliable, high-quality data solutions that power analytics, AI, and business decision-making across the organization.
Key Responsibilities:
Data Platform Engineering
Design and develop scalable data pipelines using Azure Data Factory, Databricks, and Spark/Py Spark
Build and maintain enterprise-grade lakehouse solutions using Delta Lake and Medallion Architecture (Bronze, Silver, Gold)
Data Integration & Transformation
Develop ingestion, transformation, validation, and publishing frameworks for structured and semi-structured data
Implement efficient ETL/ELT processes using Python and SQL
Data Modeling & Architecture
Design conceptual, logical,
and physical data models for lakehouse, warehouse, and analytics platforms
Translate business requirements into scalable and performant data structures
Data Quality & Governance
Implement data quality checks, validation, reconciliation, and monitoring processes
Support metadata management, lineage, governance, and security best practices
Performance & Optimization
Optimize Spark workloads, partitioning strategies, Delta tables, and pipeline performance
Ensure scalability, reliability, and operational excellence of data platforms
Dev Ops & Operations
Support CI/CD, environment promotion, monitoring, logging, and production operations
Collaborate with engineering and analytics teams to deliver robust data solutions
Required Experience:
5–7 years of experience in Data Engineering, Data Warehousing, or Data Platform Engineering IN INSURANCE domain.
Insurance knowledge is must.
Strong hands-on experience with:
Azure C
📌 Data engineer (Kanpur)
🏢 Crystal Peak
📍 Kanpur