About the job

Associate - Python Developer
(Data Collection & Pipelines) 2+ years' experience.
About the Role:
We are building a data collection and storage infrastructure from scratch - and we are looking for a Python Developer to
own it. You will integrate with third-party data APIs, build custom web crawlers where public sources do not offer an API,
design the database structure, and normalise data from multiple sources into a clean, consistent store ready for analysis.
Once the infrastructure is operational, the scope grows. As the platform matures, there is a clear path toward building
lightweight internal tooling on top of the data layer you have built. This is a long-term role with growing ownership.
What You Will Do:
— Integrate with multiple third-party data APIs - handle authentication, rate limiting, pagination, retries, and
inconsistent response schemas
— Build custom web crawlers where public data sources do not offer an API
— Design and manage a relational database to store, organise, and retrieve collected data reliably




— Build standardisation and normalisation logic that transforms raw data from different sources and formats into a
clean, consistent internal structure
— Handle deduplication and data quality management across all sources
— Build scheduled and on-demand data collection pipelines - automated runs on a defined cadence plus manual trigger
capability
— Write clean, well-documented code
— Maintain the data infrastructure on an ongoing basis
Required Skills:
— Python - 2+ years as primary language. Solid, not just familiar.
— REST API integration - real experience consuming multiple third-party APIs and handling practical integration
challenges
— Web crawling / scraping - has built custom crawlers using Scrapy, BeautifulSoup, Playwright, or similar. Understands
dynamic content, anti-bot handling, and responsible crawling
— Relational Database - schema design from scratch, query writing, indexing, and ongoing management
— Data normalisation

📌 Associate- Python Developer (Kozhikode)
🏢 MS Holdings
📍 Kozhikode