About the job

Associate - Python Developer

(Data Collection & Pipelines)
2+ years' experience
.

About the Role:

We are building a data collection and storage infrastructure from scratch - and we are looking for a Python Developer to

own it. You will integrate with third-party data APIs, build custom web crawlers where public sources do not offer an API,

design the database structure, and normalise data from multiple sources into a clean, consistent store ready for analysis.

Once the infrastructure is operational, the scope grows. As the platform matures, there is a clear path toward building

lightweight internal tooling on top of the data layer you have built. This is a long-term role with growing ownership.

What You Will Do:

— Integrate with multiple third-party data APIs - handle authentication, rate limiting, pagination, retries, and

inconsistent response schemas

— Build custom web crawlers where public data sources do not offer an API

— Design and manage a relational database to store, organise, and retrieve collected data reliably





— Build standardisation and normalisation logic that transforms raw data from different sources and formats into a

clean, consistent internal structure

— Handle deduplication and data quality management across all sources

— Build scheduled and on-demand data collection pipelines - automated runs on a defined cadence plus manual trigger

capability

— Write clean, well-documented code

— Maintain the data infrastructure on an ongoing basis

Required Skills:

— Python - 2+ years as primary language. Robust, not just familiar.

— REST API integration - real experience consuming multiple third-party APIs and handling practical integration

challenges

— Web crawling / scraping - has built custom crawlers using Scrapy, BeautifulSoup, Playwright, or similar. Understands

dynamic content, anti-bot handling, and responsible crawling

— Relational Database - schema design from scratch, query writing, indexing, and ongoing mana

📌 Associate- Python Developer (Kozhikode)
🏢 MS Holdings
📍 Kozhikode