13 Aug
|
Persistent Systems
|
Pune
13 Aug
Persistent Systems
Pune
About Position:
As a Senior Data Engineer, you will play a key role in designing, building, and maintaining the data pipelines, models, and reporting structures that underpin risk-management platform. You will develop cloud-native data solutions that transform operational data into clean, scalable, and analytics-ready datasets that support reporting, dashboards, and cross-team consumption. You bring solid expertise in Python-based data engineering, ELT design, data modeling, and building robust data flows in AWS.
Role: Senior Data Engineer
Location: Pune
Experience: 5 to 10 Years
Job Type: Full-Time Employment
What You'll Do:
Design, build, and maintain Python-based data pipelines to process, transform, and enrich operational and analytical data.
Implement ELT workflows, including ingestion, cleaning, transformation, aggregation, and historical modeling.
Develop and maintain AWS-native data environments using S3, Redshift Spectrum, and related AWS services.
Build Amazon Quick Sight dashboards and reports, delivering actionable insights to customers and internal users.
Integrate data from multiple, heterogeneous sources into unified, well-structured datasets.
Implement and optimize schema designs, partitioning strategies, file formats, and metadata practices (including Apache Avro and Parquet).
Develop or support the development of .NET (C#) microservices that expose curated data via RESTful APIs.
Work with product managers, analysts, and engineers to understand data requirements, ensuring solutions meet performance and reliability needs.
Enhance data quality, governance, and observability through validation, error handling, and lineage best practices.
Troubleshoot and resolve data issues, improving performance and reliability across data pipelines and storage layers.
Participate in code reviews, design discussions, and planning sessions to ensure engineering excellence.
Contribute to continuous improvement of data processes, tooling, and development patterns.
📌 Senior Data Engineer (Pune)
🏢 Persistent Systems
📍 Pune