19 Aug
|
Velan Info Services
|
Coimbatore
19 Aug
Velan Info Services
Coimbatore
Research Executive
Python 3.x
Roles and Responsibilities
- Develop and maintain robust web scraping and data extraction solutions using Python.
- Build scrapers for websites with static and dynamic content.
- Work with technologies such as Requests, BeautifulSoup, Scrapy, Selenium, and Playwright.
- Handle JavaScript-rendered websites, pagination, authentication, sessions, cookies, and complex website structures.
- Extract, clean, transform, validate, and store structured data from various sources.
- Develop automation scripts for scheduled data collection and processing.
- Implement techniques to handle common scraping challenges such as rate limiting, retries, timeouts, proxy usage, and changing website structures.
- Integrate scraped data with REST APIs, databases, and internal applications.
- Design efficient data pipelines for processing large volumes of scraped data.
- Write clean, maintainable, reusable, and well-documented Python code.
- Debug and troubleshoot scraping failures and data-quality issues.
- Monitor scraper performance and ensure reliable execution.
- Collaborate with backend developers, QA engineers, and business teams to understand data requirements.
- Follow best practices related to security, performance, logging, and error handling.
Candidate Profile
- Bachelors degree in Computer Science, Information Technology, or a related field.
- 2+ years of professional Python development experience.
- Demonstrable experience in web scraping/data extraction projects.
- Strong knowledge of Python 3.x.
- Strong analytical and problem-solving skills.
- Good understanding of OOP, functions, modules, exception handling, and data structures.
- Experience writing production-quality Python applications and automation scripts.
- Strong hands-on web scraping experience is mandatory.
- Understanding of HTML, CSS selectors, XPath, DOM structure, and browser automation.
- Experience scraping agile JavaScript-based websites.
- Knowledge of handling pagination, i
📌 Velan | Research Executive (Coimbatore)
🏢 Velan Info Services
📍 Coimbatore