27 Aug
|
PRI India IT Services
|
Pune
27 Aug
PRI India IT Services
Pune
Senior Data Engineer
Location: Pune (Hybrid)
Experience: 6+ Years
Job Description
We are hiring a Senior Data Engineer to design, develop, and optimize scalable data pipelines and modern data platform solutions. The ideal candidate should have strong expertise in data engineering, ETL/ELT processes, big data technologies, cloud platforms, and data governance.
Key Skills:
Python, PySpark, SQL
Apache Spark, Databricks
Hive, Hadoop, Cloudera
Azure, Microsoft Fabric, OneLake
SSIS, SQL Server, Stored Procedures
ETL/ELT, Data Warehousing
Data Quality, Metadata, Governance & Lineage
Real-time/Streaming Data Pipelines
Power BI (Preferred)
Responsibilities:
Build and maintain scalable batch and near real-time data pipelines.
Develop data ingestion, transformation, and orchestration workflows.
Support data lake and lakehouse modernization initiatives.
Implement data quality, governance, and lineage solutions.
Collaborate with Product, Architecture, Engineering,
and Analytics teams.
Troubleshoot production issues and optimize platform performance.
Support analytics, reporting, and AI-driven data initiatives.
Requirements:
6+ years of experience in Data Engineering or Big Data settings.
Solid hands-on experience with Spark, Python, SQL, and Databricks.
Experience building enterprise-scale data pipelines and distributed processing systems.
Expertise in ETL/ELT frameworks and cloud-based data platforms.
Robust problem-solving, communication, and stakeholder management skills.
Preferred Qualifications:
Experience with Microsoft Fabric, OneLake, and cloud-native platforms.
Exposure to observability/log streaming tools like Cribl.
Experience supporting Analytics, Reporting, AI, or ML workloads.
Ability to mentor team members and drive technical initiatives.
📌 Senior Data Engineer Pune
🏢 PRI India IT Services
📍 Pune