This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Data Engineer - Web Scraping based in India.
This is a fully remote chance for a data engineering professional specializing in web scraping, data processing, and automation.
You’ll design and maintain sophisticated scrapers that transform diverse web-based sources into reliable, high-quality datasets.
Your work will directly support analytical and investment-related decisions by delivering timely data, alerts, and production-ready data products.
The role combines hands-on Python development, data transformation, database engineering, and workflow orchestration.
You’ll collaborate closely with analysts, engineers, and cross-functional teams to understand requirements and build scalable solutions.
With significant ownership and autonomy, you’ll have the opportunity to improve platforms, automate processes, and solve challenging data problems.
The environment is entrepreneurial and team-oriented, with a strong focus on engineering quality,



operational reliability, and continuous innovation.
n

Accountabilities:
Design, develop, deploy, and maintain web scrapers using a range of scraping techniques and tools to collect alternative datasets from diverse sources.
Use Python and Pandas to clean, explore, transform, manipulate, and prepare large datasets for downstream consumption.
Build and maintain efficient data pipelines that ingest scraped data into databases and data warehouses.
Develop and manage scheduled workflows using Apache Airflow and other orchestration tools to ensure reliable and timely data delivery.
Collaborate with analysts and cross-functional stakeholders to understand current and anticipated data requirements and translate them into effective technical solutions.
Develop quality-control checks to validate data availability, accuracy, consistency, and integrity.
Maintain alerting systems, investigate time-sensiti

📌 Senior Data Engineer (India)
🏢 Jobgether
📍 India