610 years of overall experience in Data Engineering, with a robust focus on Big Data platforms.
Mandatory hands-on experience with Azure Databricks - this is a core requirement, not optional.
Robust experience building and managing Data Lake / Lakehouse architectures using Delta Lake.
Proven expertise implementing Medallion Architecture (Bronze/Silver/Gold) in production environments.
Solid programming skills in PySpark, Spark SQL, and Python.
Solid understanding of distributed computing concepts and Spark internals (partitioning, caching, shuffling, optimization techniques).
Hands-on experience with Azure Data Factory (ADF) for orchestration and data ingestion.
Experience with Azure Data Lake Storage Gen2 (ADLS) and related Azure data services (Event Hubs, Key Vault etc.).
Experience with Unity Catalog
SQL skills and experience with data modeling (dimensional modeling, star/snowflake schemas)(Preferred)
Experience with CI/CD practices for data pipelines (Azure DevOps, Git, GitHub Actions).
Familiarity with streaming data pipelines (Structured Streaming, Auto Loader, Kafka/Event Hubs) is a plus.
Understanding of data quality frameworks, monitoring, and observability tools.

📌 Senior Data Engineer Mumbai
🏢 Trigent Software
📍 Mumbai