Job Title: Web Scraping Engineer

Experience: 2 - 5 Years (Immediate Joiner)
Location: Chennai
Employment Type: Full time

Job Summary

We are looking for a Web Scraping Engineer with 25 years of hands-on experience in building robust web scraping and data extraction solutions. The ideal candidate should have expertise in scraping dynamic websites, developing scalable crawlers, handling anti-bot mechanisms, and delivering high-quality structured data.

Key Responsibilities
Design, develop, and maintain scalable web scraping and web crawling solutions.
Extract, clean, validate, and transform data from websites and web applications.
Build and maintain crawlers using Scrapy, Selenium, Playwright, BeautifulSoup, Requests, and similar frameworks.
Handle JavaScript-rendered websites, agile content, authentication, and pagination.
Implement techniques to overcome rate limits, CAPTCHAs, proxies, and anti-bot protections while adhering to legal and ethical standards.
Develop automated data collection workflows and monitor scraper performance.




Store and manage scraped data in SQL/NoSQL databases.
Optimize scraper efficiency, reliability, and scalability.
Collaborate with product, engineering, and data teams to meet business requirements.
Troubleshoot and resolve issues related to data extraction and website changes.

Required Skills
2–5 years of experience in Web Scraping and Data Extraction.
Robust proficiency in Python.
Hands-on experience with Scrapy, Selenium, Playwright, BeautifulSoup, Requests, and lxml.
Strong understanding of HTML, CSS, JavaScript, DOM, XPath, and CSS Selectors.
Experience working with REST APIs, JSON, and XML.
Knowledge of browser automation and dynamic web page scraping.
Experience with relational or NoSQL databases such as MySQL, PostgreSQL, or MongoDB.
Familiarity with Git, Linux, and Docker.
Strong debugging, analytical, and problem-solving skills.

Preferred Skills
Experience with asynchronous scraping a

📌 Web Scraping Engineer Chennai
🏢 India Filings
📍 Chennai