Profile 3: Lead Python Developer

​Job Title: Lead Python Developer

Company: iCapital

Location: IN - Jaipur

​About the Role:

iCapital is looking to hire an experienced Python Developer with expertise in web scraping, automated portal interactions, and cloud-native deployment using AWS. You will architect and build secure, scalable scraping solutions that interface with complex web applications and secured portals.

​Key Responsibilities:

​Assist with the design and implementation of advanced scraping solutions using Python, Playwright, and AWS services.

​Automate interactions with authentication-secured and JavaScript-heavy websites.

​Handle CAPTCHAs, MFA, and session or token-based login flows.

​Architect serverless scraping pipelines utilizing AWS components like Lambda, Step Functions, S3, CloudWatch, and Secrets Manager.

​Build systems that scale to support high volumes of data extraction with intelligent logging, retries, and fault tolerance.

​Integrate and manage complex workflows across multiple portals, APIs, and data sources.

​Contribute to architectural decisions, tooling, and best practices.

​Take responsibility for code reviews and deployments.

​Qualifications:

​Bachelor's or Master's degree in Computer Science, Software Engineering, a related field, or equivalent professional experience.

​10+ years of Python development experience with a strong focus on automation and data extraction.

​Proven web scraping expertise using tools like Playwright, Selenium, Scrapy, BeautifulSoup, and requests.





​In-depth experience handling multi-step authentication flows, including MFA, CAPTCHA solving, and cookie or session management.

​Proficient in deploying and managing scraping workloads in AWS, particularly Lambda, S3, IAM, CloudWatch, and Secrets Manager.

​Experience with asynchronous programming, headless browsers, and JavaScript-rendered content.

​Solid understanding of web protocols (HTTP, HTTPS, cookies, headers).

​Ability to reverse-engineer network calls and authentication mechanisms.

​Comfortable working with APIs, JSON/XML, and data transformation.

​Experience with CI/CD pipelines, Docker, and infrastructure as code (i.e., CloudFormation, Terraform).

​Familiar with data pipeline orchestration tools such as Apache Airflow or AWS Step Functions.

​Prior experience scraping from enterprise-level or secure portals (e.g., financial, healthcare, legal).

​Exposure to Python testing frameworks and writing integration or unit tests.

​Preferred: A background in data engineering or ETL workflows is a plus.

​Work Arrangement & Benefits:

​Work Schedule: In-office work is required four days a week, with Friday available for remote work.

​Benefits: Comprehensive benefits package including a market-competitive salary, annual performance bonus, and equity for full-time employees.

​100% employer-paid dental and health insurance, alongside generous paid time off (PTO).

Pay: ₹1,000,000.00 - ₹3,700,000.00 per year

Work Location: In person

📌 Lead Python developer (Jaipur)
🏢 Eventrics Multi Tasking Solutions
📍 Jaipur