Company Description
AIMLEAP is a global AI development and technology consulting company specializing in end-to-end full-stack solutions at the intersection of AI, data engineering, and software development. With over 14 years of industry experience, AIMLEAP has co-created more than 50 successful products and enabled over 750 businesses worldwide in their digital transformation journeys. The organization is CMMI Level 3 apprised and ISO/IEC 27001:2022 certified, underscoring a strong commitment to quality, performance, scalability, and security. Recognized as a Outstanding Place to Work®, AIMLEAP operates global delivery centers in the USA, Canada, India, and Australia, offering services that range from AI-powered data management and web scraping to advanced analytics and automation. The company builds and maintains AI and data platforms such as RADAR, PRICELEAP, and Rapid Extract, providing real-time insights and clean web data for smarter decision-making.
About the Role
We are looking for a hands-on Web Scraping / Crawling Engineer with 3–5 years of experience in web scraping,
browser automation, and scalable data extraction.
The ideal candidate should have strong experience working with dynamic and JavaScript-heavy websites , building reliable crawling workflows, handling crawling failures, and working with distributed processing systems.This is a highly technical, hands-on role. You will be expected to design, develop, debug, optimize, and maintain web crawling and data extraction systems .
Responsibilities
- Design, develop, and maintain scalable web crawling and scraping systems for dynamic and JavaScript-heavy websites.
- Develop browser automation workflows using Playwright, Selenium, Puppeteer, or similar frameworks .
- Investigate and resolve crawling issues such as 403/429 responses, redirects, timeouts, rendering failures, session issues, and anti-bot challenges .
- Develop robust retry, fallback, and failure-handling mechanisms to improve crawler reliabil
📌 Web scraping Engineer (India)
🏢 AIMLEAP
📍 India