20 Aug
|
Velan Info Services
|
Coimbatore
20 Aug
Velan Info Services
Coimbatore
Research Executive
Python 3.x
Roles and Responsibilities
Develop and maintain robust web scraping and data extraction solutions using Python.
Build scrapers for websites with static and dynamic content.
Work with technologies such as Requests, BeautifulSoup, Scrapy, Selenium, and Playwright.
Handle JavaScript-rendered websites, pagination, authentication, sessions, cookies, and complex website structures.
Extract, clean, transform, validate, and store structured data from various sources.
Develop automation scripts for scheduled data collection and processing.
Implement techniques to handle common scraping challenges such as rate limiting, retries, timeouts, proxy usage, and changing website structures.
Integrate scraped data with REST APIs, databases, and internal applications.
Design efficient data pipelines for processing large volumes of scraped data.
Write clean, maintainable, reusable, and well-documented Python code.
Debug and troubleshoot scraping failures and data-quality issues.
Monitor scraper performance and ensure reliable execution.
Collaborate with backend developers, QA engineers, and business teams to understand data requirements.
Follow best practices related to security, performance, logging, and error handling.
Candidate Profile
Bachelors degree in Computer Science, Information Technology, or a related field.
2+ years of qualified Python development experience.
Demonstrable experience in web scraping/data extraction projects.
Strong knowledge of Python 3.x.
Robust analytical and problem-solving skills.
Good understanding of OOP, functions, modules, exception handling, and data structures.
Experience writing production-quality Python applications and automation scripts.
Strong hands-on web scraping experience is mandatory.
Understanding of HTML, CSS selectors, XPath, DOM structure, and browser automation.
Experience scraping agile JavaScript-based websites.
Knowledge of handling pagination, i
📌 Velan Research Executive Coimbatore
🏢 Velan Info Services
📍 Coimbatore