- 610 years of overall experience in Data Engineering, with a strong focus on Big Data platforms.
- Mandatory hands-on experience with Azure Databricks - this is a core requirement, not optional.
- Robust experience building and managing Data Lake / Lakehouse architectures using Delta Lake.
- Proven expertise implementing Medallion Architecture (Bronze/Silver/Gold) in production environments.
- Solid programming skills in PySpark, Spark SQL, and Python.
- Solid understanding of distributed computing concepts and Spark internals (partitioning, caching, shuffling, optimization techniques).
- Hands-on experience with Azure Data Factory (ADF) for orchestration and data ingestion.
- Experience with Azure Data Lake Storage Gen2 (ADLS) and related Azure data services (Event Hubs, Key Vault etc.).
- Experience with Unity Catalog
- SQL skills and experience with data modeling (dimensional modeling, star/snowflake schemas)(Preferred)
- Experience with CI/CD practices for data pipelines (Azure DevOps, Git, GitHub Actions).
- Familiarity with streaming data pipelines (Structured Streaming, Auto Loader, Kafka/Event Hubs) is a plus.
- Understanding of data quality frameworks, monitoring, and observability tools.
📌 Senior Data Engineer (Mumbai)
🏢 Trigent Software
📍 Mumbai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.