Job Title: Web Scraping Engineer

Experience: 2 - 5 Years (Immediate Joiner)
Location: Chennai
Employment Type: Full-Time

Job Summary

We are looking for a Web Scraping Engineer with 25 years of hands-on experience in building robust web scraping and data extraction solutions. The ideal candidate should have expertise in scraping dynamic websites, developing scalable crawlers, handling anti-bot mechanisms, and delivering high-quality structured data.

Key Responsibilities
- Design, develop, and maintain scalable web scraping and web crawling solutions.
- Extract, clean, validate, and transform data from websites and web applications.
- Build and maintain crawlers using Scrapy, Selenium, Playwright, BeautifulSoup, Requests, and similar frameworks.
- Handle JavaScript-rendered websites, dynamic content, authentication, and pagination.
- Implement techniques to overcome rate limits, CAPTCHAs, proxies, and anti-bot protections while adhering to legal and ethical standards.
- Develop automated data collection workflows and monitor scraper performance.




- Store and manage scraped data in SQL/NoSQL databases.
- Optimize scraper efficiency, reliability, and scalability.
- Collaborate with product, engineering, and data teams to meet business requirements.
- Troubleshoot and resolve issues related to data extraction and website changes.

Required Skills
- 2–5 years of experience in Web Scraping and Data Extraction.
- Robust proficiency in Python.
- Hands-on experience with Scrapy, Selenium, Playwright, BeautifulSoup, Requests, and lxml.
- Strong understanding of HTML, CSS, JavaScript, DOM, XPath, and CSS Selectors.
- Experience working with REST APIs, JSON, and XML.
- Knowledge of browser automation and dynamic web page scraping.
- Experience with relational or NoSQL databases such as MySQL, PostgreSQL, or MongoDB.
- Familiarity with Git, Linux, and Docker.
- Strong debugging, analytical, and problem-solving skills.

Preferred Skills
- Experience with asynchronous scraping a

📌 Web Scraping Engineer (Chennai)
🏢 India filings
📍 Chennai