Job Description
Senior Data Engineer
nLocation: Pune
nExperience: 4+ Years
n

nRole Overview
nWe are looking for a seasoned Senior Data Engineer with 4+ years of core data engineering experience using Databricks to design and build scalable, real-time and batch data platforms.
nThe role requires solid expertise in data engineering, data services, Python, advanced SQL, complex data transformations, system integrations, and Medallion Architecture.
n
nKey Responsibilities
n
- n
- Design and build real-time, near-real-time, and batch data ingestion pipelines.n
- Develop Bronze, Silver, and Gold data layers using Medallion Architecture.n
- Build complex data transformation, cleansing, enrichment, and reconciliation workflows.n
- Integrate data from REST APIs, SFTP, databases, files, enterprise systems, and streaming sources.n
- Develop event-driven pipelines using AWS Lambda and DAGs.n
- Build scalable data processing solutions using Azure Databricks, Apache Spark.n
- Develop reusable Python and SQL components for ingestion and transformation.n




- Implement schema evolution, incremental loads, retries, error handling, and data recovery.n
- Optimize pipeline performance, data storage, partitioning, and query execution.n
- Implement data quality checks, monitoring, logging, alerting, and audit controls.n
- Design data models, schemas, and integration mappings across source and target systems.n
- Review technical designs and guide data engineers on implementation standards.n

nRequired Skills
n
- n
- 4+ years of hands-on data engineering PySpark experience.n
- Strong Python and PySpark development skills.n
- Strong hands-on experience with: Apache Spark, Kubernetes and AKS, Docker, Databricks.n
- Advanced SQL skills, including complex joins, window functions, CTEs, and query optimization.n
- Strong experience with real-time and batch ingestion patterns.n
- Experience implementing Medallion Architecture.n
- Strong understanding of Databricks, D

📌 Senior Data Engineer (Pune)
🏢 ORMAE
📍 Pune