09 Sep
|
Analogy Group
|
India
09 Sep
Analogy Group
India
Position: Software Engineer, Data Infrastructure and Acquisition
Analogy Group builds cutting-edge AI political intelligence tools. We work with advocacy organizations, researchers, and companies working on the most important problems in the world—from climate to democracy to AI policy. We use LLMs to make sense of messy data, enabling these organizations to move faster with more informed strategy.
We are hiring a Software Engineer focused on Data Infrastructure and Acquisition to help us design the infrastructure and build scrapers for public data. This role is a mix of backend engineering, agentic AI engineering, and web scraping. We want to make government data accessible and practical to help fight corruption, protect democracy, and make citizens able to understand their government, and your work will directly contribute to this mission.
This is a fully remote role for engineers based in India. We offer highly competitive, top-of-market compensation and are looking for candidates with a strong record of technical excellence, whether developed at a top engineering program,
a high-performing technology company, an ambitious startup, or through exceptional independent work.
What You’ll Do:
* Design, build, and maintain our data acquisition infrastructure using technologies such as Prefect, AWS, and Django.
* Develop clear, durable abstractions for scraping patterns and infrastructure, keeping the system manageable as we scale to thousands of data sources.
* Build AI-powered infrastructure for agentic, self-healing scrapers.
* Develop agents capable of creating new scrapers from established templates and validating their output.
* Build and test resilient scrapers for messy, difficult public data sources, including PDFs, videos, forms, and legacy government portals.
* Improve observability, retries, data validation, and failure recovery across our pipelines.
* Open-source selected parts of our work and write about what we learn.
Minimum Requirements:
* Bac
📌 Software Engineer, Data Infrastructure and Acquisition (India)
🏢 Analogy Group
📍 India