21 Aug
|
Shreem Talent Bridge
|
Pune
21 Aug
Shreem Talent Bridge
Pune
Python Developer – API Data Ingestion
Location: Pune / Hyderabad
Experience: 5–8 Years
Key Responsibilities
- Design, develop, and maintain Python services/jobs to ingest data from REST/GraphQL APIs (and where relevant SOAP).
- Implement secure authentication patterns (OAuth2, JWT, API keys, mTLS) and manage secrets via approved vault tooling.
Build Robust Ingestion Patterns
- Pagination, rate limiting, retries with backoff, idempotency, and checkpointing.
- Incremental loads (watermarks), CDC-like approaches where supported.
- Validate and reconcile data (completeness, duplicates, referential checks) and produce quality metrics.
- Transform and standardise data (JSON/XML to tabular formats), including PII handling and masking where required.
- Orchestrate pipelines using approved schedulers (e.g., Airflow or equivalent) and implement CI/CD for deployments.
- Implement logging, monitoring, alerting, and runbooks to support production operations.
- Collaborate with API providers/consumers, platform teams, and stakeholders to agree SLAs, data contracts, and support models.
- Produce clear technical documentation (designs, data mappings, operational procedures).
Required Skills & Experience
- Solid Python development experience (3+ years).
Solid Understanding of API Integration Concepts
- HTTP semantics, status codes, headers, timeouts.
- Authentication/authorisation (OAuth2 flows, token refresh).
Experience with Data Engineering Fundamentals
- ETL/ELT patterns, incremental ingestion, partitioning.
- Data formats (JSON, CSV, Parquet, Avro), compression.
- SQL proficiency and experience landing data into relational or analytical stores.
- Python Developer (API Data Ingestion)
Production Mindset
- Observability.
- Error handling.
- Performance tuning.
- Operational support.
Preferred / Nice-to-Have
- Cloud experience (GCP) and managed data services.
- Orchestration: Airflow or similar.
- Streaming/event ingestion (Kafka) where applicable.
- Containerisation (Do
📌 Sr. Python Developer (Pune)
🏢 Shreem Talent Bridge
📍 Pune