Senior Data Engineer

Location: Pune (Hybrid)
Experience: 6+ Years

Job Description

We are hiring a Senior Data Engineer to design, develop, and optimize scalable data pipelines and modern data platform solutions. The ideal candidate should have strong expertise in data engineering, ETL/ELT processes, big data technologies, cloud platforms, and data governance.

Key Skills:

- Python, PySpark, SQL
- Apache Spark, Databricks
- Hive, Hadoop, Cloudera
- Azure, Microsoft Fabric, OneLake
- SSIS, SQL Server, Stored Procedures
- ETL/ELT, Data Warehousing
- Data Quality, Metadata, Governance & Lineage
- Real-time/Streaming Data Pipelines
- Power BI (Preferred)

Responsibilities:

- Build and maintain scalable batch and near real-time data pipelines.
- Develop data ingestion, transformation, and orchestration workflows.
- Support data lake and lakehouse modernization initiatives.
- Implement data quality, governance, and lineage solutions.
- Collaborate with Product, Architecture, Engineering, and Analytics teams.




- Troubleshoot production issues and optimize platform performance.
- Support analytics, reporting, and AI-driven data initiatives.

Requirements:

- 6+ years of experience in Data Engineering or Big Data environments.
- Strong hands-on experience with Spark, Python, SQL, and Databricks.
- Experience building enterprise-scale data pipelines and distributed processing systems.
- Expertise in ETL/ELT frameworks and cloud-based data platforms.
- Robust problem-solving, communication, and stakeholder management skills.

Preferred Qualifications:

- Experience with Microsoft Fabric, OneLake, and cloud-native platforms.
- Exposure to observability/log streaming tools like Cribl.
- Experience supporting Analytics, Reporting, AI, or ML workloads.
- Ability to mentor team members and drive technical initiatives.

📌 Senior Data Engineer (Pune)
🏢 PRI India IT Services
📍 Pune