10 Sep
|
Velan Info Services
|
Coimbatore
10 Sep
Velan Info Services
Coimbatore
Research Executive
Python 3.x
Roles and Responsibilities
Develop and maintain robust web scraping and data extraction solutions using Python.
Build scrapers for websites with static and dynamic content.
Work with technologies such as Requests, BeautifulSoup, Scrapy, Selenium, and Playwright.
Handle JavaScript-rendered websites, pagination, authentication, sessions, cookies, and complex website structures.
Extract, clean, transform, validate, and store structured data from various sources.
Develop automation scripts for scheduled data collection and processing.
Implement techniques to handle common scraping challenges such as rate limiting, retries, timeouts, proxy usage, and changing website structures.
Integrate scraped data with REST APIs, databases, and internal applications.
Design productive data pipelines for processing large volumes of scraped data.
Write clean, maintainable, reusable, and well-documented Python code.
Debug and troubleshoot scraping failures and data-quality issues.
Monitor scraper performance and ensure reliable execution.
Collaborate with backend developers, QA engineers, and business teams to understand data requirements.
Follow best practices related to security, performance, logging, and error handling.
Candidate Profile
Bachelors degree in Computer Science, Information Technology, or a related field.
2+ years of professional Python development experience.
Demonstrable experience in web scraping/data extraction projects.
Strong knowledge of Python 3.x.
Strong analytical and problem-solving skills.
Good understanding of OOP, functions, modules, exception handling, and data structures.
Experience writing production-quality Python applications and automation scripts.
Robust hands-on web scraping experience is mandatory.
Understanding of HTML, CSS selectors, XPath, DOM structure, and browser automation.
Experience scraping energetic JavaScript-based websites.
Knowledge of handling pagination, i
📌 Velan Research Executive Coimbatore
🏢 Velan Info Services
📍 Coimbatore