Tech Lead-Web Scrapping and Crawling - W-972

Tech Lead-Web Scrapping and Crawling - W-972

24 Dec
TurboHire Technologies Pvt. Ltd.
Pune Division

24 Dec

TurboHire Technologies Pvt. Ltd.

Pune Division

Job Description

Looking for a Tech Lead role with a strong experience in Web Scraping/ Crawling

Roles & Responsibilities

- Manage individual project priorities, deadlines, and deliverables.

- Gather and process raw data at scale (including writing scripts, web scraping, calling/create APIs, etc.) from the web/internet.

- Develop frameworks for automating and maintaining the constant flow of data from multiple sources.

- Identify, analyze, design, and implement internal process improvements.

- Design and implement tooling upgrades to increase stability and data quality.

- Help team to fix issues that occur in test and production environments.

- Automate software development processes, including build, deploy,

and test.

- Manage and guide the team members.


- 4+ years of web crawling/ scraping experience is a must.

- Strong knowledge of scraping frameworks such as Scrapy, Beautiful Soup, HTQL, Jsoup, Web-Harvest, and others.

- Excellent verbal, written, and interpersonal communication skills in English.

- Good to have Experienced in complex crawling (like captcha, Mobile OTP based crawling, bypassing proxy)

- Sound Knowledge in Bot Management Techniques.

- Experience in various data extraction methods (like data extraction from PDF Files, webpages, etc)

- Good understanding of HTML DOM, CSS, Javascript, and RESTful web services.

- Good to have an understanding of AWS.

- Experience with Linux.

- Experience with Java / Python.

The original job offer can be found in Kit Job:

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:
Enter Your E-mail address to receive the latest job offers for: tech lead-web scrapping and crawling - w-972
Publish a new Free Offer
Need to publish an offer? With more than 1 million unique users per month, you will find the ideal candidate for your company instantly, what are you waiting for!
Publish Now

Subscribe to this job alert