Roles and Responsibilities :
- Design, develop, test, deploy and maintain large-scale data processing pipelines using Python.
- Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
- Develop scalable data models and algorithms for big data processing using machine learning techniques.
- Troubleshoot issues related to pipeline deployment in production environments.
Job Requirements :
- 5-10 years of experience in IT Services & Consulting industry.
- Solid proficiency in Python programming language with expertise in machine learning libraries such as scikit-learn or TensorFlow.
- Experience with big data technologies like Hadoop, Spark, Kafka etc. .
- Proven track record of successfully deploying complex software systems in production environments.