Hello All,

Greetings from ZettaMine!!!

Role: Python Developer (API Data Ingestion)

Location: Pune / Hyderabad

Experience: 5 to 8 Years

Notice Period: Immediate Joiners

Role Purpose:

Build and run reliable Python-based data ingestion pipelines that pull data from internal/external APIs, validate and transform it, and land it into GCP with solid controls, monitoring, and documentation.

Key Responsibilities:

- Design, develop, and maintain Python services/jobs to ingest data from REST/GraphQL APIs (and where relevant SOAP).
- Implement secure authentication patterns (OAuth2, JWT, API keys, mTLS) and manage secrets via approved vault tooling.

Build Robust Ingestion Patterns:

- Pagination, rate limiting, retries with backoff, idempotency, and checkpointing.
- Incremental loads (watermarks), CDC-like approaches where supported.
- Validate and reconcile data (completeness, duplicates, referential checks) and produce quality metrics.
- Transform and standardise data (JSON/XML to tabular formats), including PII handling and masking where required.
- Orchestrate pipelines using approved schedulers (e.g., Airflow or equivalent) and implement CI/CD for deployments.
- Implement logging, monitoring, alerting, and runbooks to support production operations.




- Collaborate with API providers/consumers, platform teams, and stakeholders to agree SLAs, data contracts, and support models.
- Produce clear technical documentation (designs, data mappings, operational procedures).

Required Skills & Experience:

- Strong Python development experience (3+ years).

Solid Understanding of API Integration Concepts:

- HTTP semantics, status codes, headers, timeouts.
- Authentication/authorisation (OAuth2 flows, token refresh).

Experience with Data Engineering Fundamentals:

- ETL/ELT patterns, incremental ingestion, partitioning.
- Data formats (JSON, CSV, Parquet, Avro), compression.
- SQL proficiency and experience landing data into relational or analytical stores.

Production Mindset:

- Observability, error handling, performance tuning, and operational support.

Preferred / Nice-to-Have:

- Cloud experience (GCP) and managed data services.
- Orchestration: Airflow or similar.
- Streaming/event ingestion (Kafka) where applicable.
- Containerisation (Docker) and Kubernetes basics.

Interested candidates kindly share your updated CV to [email protected] or WhatsApp to (phone hidden).

Thanks & Regards,

Aruna.M

📌 Python Developer (API Data Ingestion) (Hyderabad)
🏢 ZettaMine Labs
📍 Hyderabad