22 Aug
|
Shreem Talent Bridge
|
Pune
22 Aug
Shreem Talent Bridge
Pune
Python Developer – API Data Ingestion
Location: Pune / Hyderabad
Experience: 5–8 Years
Key Responsibilities
Design, develop, and maintain Python services/jobs to ingest data from REST/GraphQL APIs (and where relevant SOAP).
Implement secure authentication patterns (OAuth2, JWT, API keys, mTLS) and manage secrets via approved vault tooling.
Build Robust Ingestion Patterns
Pagination, rate limiting, retries with backoff, idempotency, and checkpointing.
Incremental loads (watermarks), CDC-like approaches where supported.
Validate and reconcile data (completeness, duplicates, referential checks) and produce quality metrics.
Transform and standardise data (JSON/XML to tabular formats), including PII handling and masking where required.
Orchestrate pipelines using approved schedulers (e.g., Airflow or equivalent) and implement CI/CD for deployments.
Implement logging, monitoring, alerting, and runbooks to support production operations.
Collaborate with API providers/consumers, platform teams, and stakeholders to agree SLAs, data contracts, and support models.
Produce transparent technical documentation (designs, data mappings, operational procedures).
Required Skills & Experience
Solid Python development experience (3+ years).
Solid Understanding of API Integration Concepts
HTTP semantics, status codes, headers, timeouts.
Authentication/authorisation (OAuth2 flows, token refresh).
Experience with Data Engineering Fundamentals
ETL/ELT patterns, incremental ingestion, partitioning.
Data formats (JSON, CSV, Parquet, Avro), compression.
SQL proficiency and experience landing data into relational or analytical stores.
Python Developer (API Data Ingestion)
Production Mindset
Observability.
Error handling.
Performance tuning.
Operational support.
Preferred / Nice-to-Have
Cloud experience (GCP) and managed data services.
Orchestration: Airflow or similar.
Streaming/event ingestion (Kafka) where applicable.
Containerisation (Do
📌 Sr Python Developer Pune
🏢 Shreem Talent Bridge
📍 Pune