Job Title: Web Scraping Engineer

Experience: 2 - 5 Years (Immediate Joiner)
Location: Chennai
Employment Type: Full-Time

Job Summary

We are looking for a Web Scraping Engineer with 2 - 5 years of hands-on experience in building robust web scraping and data extraction solutions. The ideal candidate should have expertise in scraping dynamic websites, developing scalable crawlers, handling anti-bot mechanisms, and delivering high-quality structured data.

Key Responsibilities

- Design, develop, and maintain scalable web scraping and web crawling solutions.
- Extract, clean, validate, and transform data from websites and web applications.
- Build and maintain crawlers using Scrapy, Selenium, Playwright, BeautifulSoup, Requests, and similar frameworks.
- Handle JavaScript-rendered websites, dynamic content, authentication, and pagination.
- Implement techniques to overcome rate limits, CAPTCHAs, proxies, and anti-bot protections while adhering to legal and ethical standards.
- Develop automated data collection workflows and monitor scraper performance.
- Store and manage scraped data in SQL/NoSQL databases.
- Optimize scraper efficiency, reliability, and scalability.
- Collaborate with product, engineering,



and data teams to meet business requirements.
- Troubleshoot and resolve issues related to data extraction and website changes.

Required Skills

- 25 years of experience in Web Scraping and Data Extraction.
- Strong proficiency in Python.
- Hands-on experience with Scrapy, Selenium, Playwright, BeautifulSoup, Requests, and lxml.
- Strong understanding of HTML, CSS, JavaScript, DOM, XPath, and CSS Selectors.
- Experience working with REST APIs, JSON, and XML.
- Knowledge of browser automation and dynamic web page scraping.
- Experience with relational or NoSQL databases such as MySQL, PostgreSQL, or MongoDB.
- Familiarity with Git, Linux, and Docker.
- Solid debugging, analytical, and problem-solving skills.

Preferred Skills

- Experience with asynchronous scraping and multithreading.
- Knowledge of cloud platforms (AWS, Azure, or GCP).
- Experience with scheduling and workflow tools such as Cron or Airflow.
- Exposure to data processing using Pandas.
- Understanding of proxy rotation, session management, and large-scale crawling.

Contact - Raja Abraham - (phone hidden)

mail - [email protected]

📌 Web Scraping Engineer (Tamil Nadu)
🏢 India filings
📍 Tamil Nadu