This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Data Engineer - Web Scraping based in India.

This role is an exciting opportunity to build scalable web scraping solutions and data pipelines that power business-critical insights. You will work closely with analysts, engineers, and cross-functional teams to develop reliable datasets that support strategic decision-making. With significant ownership over your projects, you'll design, automate, and optimize data collection workflows while ensuring data quality and reliability. The workplace encourages innovation, collaboration, and continuous learning, giving you the freedom to experiment with new technologies and improve existing processes. If you enjoy solving complex data challenges and building automation at scale, this role offers an excellent platform to make a meaningful impact.

Accountabilities:

As a Data Engineer specializing in web scraping, you will design, develop, and maintain automated data collection systems while ensuring the quality,



accuracy, and availability of large-scale datasets. You will collaborate across teams to build efficient, reliable, and scalable data solutions.
- Collaborate with analysts and stakeholders to understand data requirements and deliver tailored data solutions.
- Design, develop, and maintain web scrapers for a wide range of structured and unstructured data sources.
- Clean, transform, validate, and manipulate large datasets using Python and Pandas.
- Build and maintain data ingestion pipelines into databases or data warehouses.
- Schedule, monitor, and optimize scraping workflows using orchestration tools such as Apache Airflow.
- Develop quality control checks to ensure data integrity, consistency, and availability.
- Investigate and resolve data pipeline issues and time-sensitive production incidents.
- Design and enhance internal tools, automation frameworks, and platform capabilities to

📌 Data Engineer (India)
🏢 Jobgether
📍 India