Experience: 7-8 Years

Location: Noida, Gurugram, Pune

Job Responsibilities / Requirements

1. Develop and maintain scalable data pipelines using Python and PySpark for batch and real-time data processing.

2. Design, build, and optimize ETL/ELT workflows to ingest, transform, and load data from multiple source systems.

3. Work with large-scale datasets using Apache Spark/PySpark to ensure high-performance data processing and transformation.

4. Design and implement robust data models, data lakes, and data warehouse solutions to support reporting and analytics requirements.

5. Collaborate with business stakeholders, analysts, and data scientists to understand data requirements and deliver reliable data solutions.

6. Implement and manage CI/CD pipelines for data engineering projects using tools such as Azure DevOps, Jenkins,



GitHub Actions, or GitLab CI.

7. Apply DevOps best practices including version control, automated testing, code reviews, and deployment automation.

8. Monitor, troubleshoot, and optimize data pipelines to ensure data quality, performance, scalability, and reliability.

9. Experience working with cloud platforms such as Azure, AWS, or GCP, including data integration and storage services.

10. Ensure adherence to data governance, security, and compliance standards while managing enterprise data assets.

Mandatory Skills :

- Python
- Pyspark
- CICD Pipeline/DevOps
- ETL Pipeline
- SQL

📌 Urgent Hiring:: Data Engineers:: Delhi NCR/Pune/Chennai
🏢 IRIS SOFTWARE
📍 Pune