Dear Connections!
We are Hiring.......
Position: Python Developer
Experience: 2+ Years
-
We are looking for a Python Developer with 2+ years of experience in web scraping, data processing, ETL, automation, APIs, and databases.
The candidate should have hands-on experience with Python, Selenium, BeautifulSoup, Requests, REST APIs, JSON/XML/CSV, PostgreSQL, Pandas, and preferably PySpark and AWS.
The role involves extracting data from tender/procurement websites and external sources, processing and validating data, storing it in PostgreSQL, and delivering client-specific data through automated workflows.
Key Responsibilities-
· Develop and maintain web scraping solutions using Python, Selenium, BeautifulSoup, Requests, etc.
· Extract and process data from websites, APIs, JSON, XML, CSV, and HTML sources.
· Develop and maintain ETL/data processing pipelines using Python and PySpark.
· Perform data cleansing, validation, transformation, and large-scale data processing.
· Work with PostgreSQL and write efficient SQL queries.
· Generate client-specific JSON, XML, and CSV outputs and automate FTP/SFTP delivery.
· Develop automation for scheduling, reporting, notifications, and data processing.
· Monitor production scraping/ETL jobs and troubleshoot failures and data-quality issues.
· Work with AWS S3, Glue, Athena, and EC2.
· Contribute to GenAI/LLM-based projects for data classification, automation, and intelligent data processing.
Required Skills-
Python | Selenium | BeautifulSoup | Requests | Web Scraping | ETL | PostgreSQL | Pandas | REST APIs | Git/GitHub
Positive to have: PySpark, AWS (S3, Glue, Athena, EC2), Django/Flask, Azure, GenAI/LLM.
Interested candidates, please send your CV to
[email protected].
📌 Python Developer (Mumbai)
🏢 dgMarket India Private
📍 Mumbai