27 Aug
|
Agile Technology
|
Pune
27 Aug
Agile Technology
Pune
As a Senior Data Engineer, you will play a key role in designing, building, and maintaining the data pipelines, models, and reporting structures that underpin risk-management platform. You will develop cloud-native data solutions that transform operational data into clean, scalable, and analytics-ready datasets that support reporting, dashboards, and cross-team consumption.
You bring solid expertise in Python-based data engineering, ELT design, data modeling, and building robust data flows in AWS. You enjoy solving complex data integration problems, designing efficient data structures, and working closely with product, engineering, and analytics teams to deliver high-quality datasets and reporting solutions.
While your primary focus will be on data engineering, you are comfortable contributing to .NET (C#) microservices when needed particularly services that expose curated data through well-designed APIs. You operate independently on complex tasks while collaborating effectively with senior and staff-level engineers on architectural decisions.
Responsibilities
- Design, build,
and maintain Python-based data pipelines to process, transform, and enrich operational and analytical data.
- Implement ELT workflows, including ingestion, cleaning, transformation, aggregation, and historical modeling.
- Develop and maintain AWS-native data environments using S3, Redshift Spectrum, and related AWS services.
- Build Amazon QuickSight dashboards and reports, delivering actionable insights to customers and internal users.
- Integrate data from multiple, heterogeneous sources into unified, well-structured datasets.
- Implement and optimize schema designs, partitioning strategies, file formats, and metadata practices (including Apache Avro and Parquet).
- Develop or support the development of .NET (C#) microservices that expose curated data via RESTful APIs.
- Work with product managers, analysts, and engineers to understand data requirements, ensuring solutions meet performan
📌 Data Engineer (Pune)
🏢 Agile Technology
📍 Pune