About the Role

We are looking for an AI Data Engineer to design, build, and operate large-scale data ingestion and enrichment pipelines.

This is a hands-on technical role focused on:

- Large-scale web data extraction and normalization
- Development, Monitoring data pipelines,
- Anvestigating data issues, and fixing web data extraction logic at the source and
- Apply Generative AI techniques to improve text quality, structure, deduplication, and enrichment before data is consumed by ML models

The ideal candidate debugging, reverse-engineering websites, and working deeply with HTML, JSON, and web scraping logic using AI based Techniques

Key Responsibilities:

- Develop ETL and data parsing pipelines to ensure data quality and availability
- Act as first-level responder for data quality alerts and failed jobs
- Investigate data anomalies by comparing system data with live websites
- Perform root cause analysis to identify parsing issues, site changes, or source data errors
- Implement monitoring, logging, and validation checks across pipelines
- Data Extraction & Fixes
- Develop, modify, and debug web data extraction logic
- Write and maintain parsing rules using CSS Selectors, Regex, and JQ
- Parse complex and nested HTML and JSON structures




- Optimize extraction logic for performance and scalability
- Implement fallback and validation strategies to ensure data reliability
- Development & Expansion
- Handle ad-hoc requests for adding new data fields
- Onboard large portals in building extraction logic from scratch

Required Skills (Must-Have):

- Robust experience in AI based Web Scraping / Data Extraction / Data Parsing
- Hands-on experience with HTML and JSON
- Strong knowledge of CSS Selectors and Regular Expressions (Regex)
- Experience using JQ / JSON Query / Jackson JQ
- Experience with ETL pipelines and data quality monitoring
- Ability to debug production data issues and perform root cause analysis
- Good to Have Python for web scraping or data handling
- XPath, REST APIs

Good to Have:

- Experience applying LLMs / GenAI for text processing or enrichment
- Familiarity with multilingual text handling and normalization
- Experience with REST APIs and asynchronous data ingestion

Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 Junior Data Engineer (India)
🏢 Flexm
📍 India