Job Description:
Job purpose

Key responsibilities
- Build and manage data orchestration workflows using Apache Airflow.
- Develop high-quality, production-ready solutions using Python.
- Implement and maintain CI/CD pipelines leveraging GitHub Actions.
- Manage source control, branching strategies, and code reviews through GitHub repositories.
- Develop and maintain containerized solutions using Docker.
- Integrate and support Generative AI solutions utilizing OpenAI and Anthropic Claude models.
- Collaborate with data scientists, ML engineers, and business stakeholders to deliver reliable data products.
- Ensure data quality, monitoring, observability, security, and governance standards are met.
- Troubleshoot production issues and drive continuous improvement across data engineering platforms.
- Document architecture, processes, and best practices for enterprise data solutions.

Key competencies

Essential skills
- Bachelor’s or master’s degree in computer science, Engineering, Information Technology, or a related field.
- 7-10 years of experience in data engineering,



software engineering, or related technical disciplines.
- Strong hands-on experience with:
- Python
- GitHub and Git-based development workflows
- GitHub Actions CI/CD
- Azure Kubernetes Service (AKS)
- Apache Airflow
- Docker
- Building and maintaining enterprise-scale ETL processes and data pipelines
- Experience designing and operating cloud-native, distributed data platforms.
- Strong understanding of software engineering best practices, testing frameworks, and deployment automation.
- Experience working with OpenAI and Claude (Anthropic) models in production environments.
- Experience working with REST APIs and external data integrations.
- Excellent problem-solving, debugging, and performance optimization skills.
- Robust communication and stakeholder management capabilities.

Nice to Have
- Experience with S&P; Xpressfeed data platforms.
- Experience with Snowflake data warehousing and analyti

📌 Senior Data Engineer (Kharadi)
🏢 Acuity Knowledge Partners
📍 Kharadi