Experience
4+ years of skilled experience as a Python Developer
Robust experience building production-grade web scraping systems
Key Responsibilities
Design, develop, and maintain scalable web scraping and data extraction pipelines.
Build robust scrapers capable of handling agile websites, anti-bot protections, CAPTCHAs, and rate limiting.
Develop high-performance distributed scraping infrastructure using Docker and Kubernetes.
Optimize scraper performance, reliability, and fault tolerance for large-scale deployments.
Build and maintain APIs using Python web frameworks such as FastAPI or Django.
Develop asynchronous and distributed task processing pipelines using Celery.
Monitor production systems using observability tools such as Grafana and Prometheus.
Collaborate with engineering teams to build resilient, maintainable, and scalable data collection platforms.
Continuously research and adopt new scraping techniques, browser automation methods, and AI-powered extraction technologies.
Learn and contribute to AI/ML and Agentic AI initiatives for intelligent web automation.
Required Skills:
Solid Python programming skills with solid understanding of:
Object-Oriented Programming (OOP)
Python best practices
Clean code principles
Extensive experience with:
Selenium
Undetected ChromeDriver (UC)
Requests
CAPTCHA solving techniques
Browser automation
Strong understanding of modern anti-bot mechanisms and bypass strategies.
Experience working with Docker.
Hands-on experience with Celery.
Experience with at least one Python web framework:
FastAPI
Django
Familiarity with monitoring and observability tools such as Grafana and Prometheus.
Experience with Git and Linux environments.
Preferred Qualifications
Building large-scale distributed scraping infrastructure.
Kubernetes administration and orchestration.
Social media scraping or automation/bot development.
AI-assisted or agentic web scraping systems.
-