Location: Bangalore (Hybrid 3 Days Work from Office)
Experience: 5+ Years
Notice Period: Immediate to 15 Days Preferred
About the Role
We are looking for a highly skilled Data Engineer to join our Data & Innovation team. The ideal candidate should have robust expertise in Python, Web Crawling, API Development, MongoDB, and experience building data pipelines for AI/ML applications.
You will be responsible for designing, developing, and maintaining scalable data pipelines, integrating data from multiple sources, and supporting AI-driven applications in a production environment.
Key Responsibilities
- Develop and maintain robust data pipelines for structured and unstructured data.
- Build web crawlers and scraping solutions to extract data from websites and real-time sources.
- Develop and integrate REST APIs for data ingestion and processing.
- Design, develop, and optimize ETL workflows.
- Work with MongoDB and other databases to store and manage large datasets.
- Collaborate with Data Scientists to support AI/ML model training, deployment,
and optimization.
- Develop scalable Python applications with a focus on performance and maintainability.
- Deploy and manage production-grade data solutions.
- Ensure data quality, security, and availability.
- Work closely with cross-functional teams across global locations.
Mandatory Skills
- Strong hands-on experience in Python
- Experience in Web Crawling/Web Scraping (Scrapy, Selenium, BeautifulSoup, Playwright, etc.)
- Experience in API Development and API Integration
- Strong experience with MongoDB
- Experience building ETL/Data Pipelines
- Hands-on experience in AI/ML projects
- Strong SQL skills