Company Description AIMLEAP is an AI-focused technology consulting company that co-creates AI products and end-to-end software solutions with global clients. The organization is CMMI Level 3 and ISO/IEC 27001:2022 certified, emphasizing performance, scalability, and security across its offerings. With over 14 years of experience and more than 50 co-created products, AIMLEAP has supported digital transformation for over 750 businesses worldwide.
The company delivers services in full-stack development, AI-driven data engineering, web and mobile applications, data management and web scraping, BI reporting, and automation. Recognized as a Great Place to Work®, AIMLEAP operates through global delivery centers in the USA, Canada, India, and Australia and maintains a strong focus on client retention and long-term partnerships.
Role Description This is a full time remote role for a Web Scraping Engineer with 4–6 years of experience. The role involves designing, developing, and maintaining scalable web scraping pipelines to extract, clean, and normalize data from diverse websites and web applications.
The Web Scraping
Engineer will build and optimize scraping scripts, handle complex site structures, manage proxies and anti-bot mechanisms, and ensure data accuracy, reliability, and compliance. Daily responsibilities include collaborating with data engineering and AI teams, integrating scraped data into back-end systems and AI platforms such as RapidExtract, monitoring scraping jobs,
troubleshooting issues, and improving performance. The role also includes documenting processes, following secure coding and data handling practices, and contributing to the continuous enhancement of AIMLEAP’s AI and data solutions.
Qualifications
- Candidates should possess strong skills in Back-End Web Development and Software Development for building and maintaining robust scraping services and APIs.
- Candidates should possess practical experience in Web Development and Web Applications to understand site architectures, DOM structures, and client-server interactions.
- Candidates should possess sufficient Front-End Development knowledge to work with JavaScript-heavy websites, dynamic content, and browser automation tools.
- Hands-on experience with web scraping frameworks and tools (e.g., Python, Scrapy, Selenium, Playwright, BeautifulSoup, or similar) and RESTful APIs is strongly preferred.
- Solid understanding of data structures, algorithms, and performance optimization for large-scale data extraction and processing.
- Experience handling proxies, captchas, rate limiting, and anti-scraping mechanisms while adhering to legal and ethical guidelines.
- Familiarity with databases and data pipelines (SQL/NoSQL, ETL tools, message queues) and integration with AI or analytics platforms is beneficial.
- Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent professional experience.
📌 Web Scraping Engineer (4-6 yrs) (India)
🏢 AIMLEAP
📍 India