14 Nov
|
Opvia.in
|
India
About the job : Data & AI Engineer - Python | SQL | Azure | Data Engineering | AI/LLM | AutomationLocation : Remote, IndiaWorking Hours : UK Business HoursExperience : 3 - 5 YearsJoining Preference : Immediate or up to 30 days' noticeAbout the Opportunity : Opvia is hiring a Data & AI Engineer to work with a UK-based client on building, maintaining and improving data infrastructure, AI-powered solutions and automated workflows. You will work across data pipelines, cloud-based data systems, API integrations and AI-driven applications. The role involves developing reliable data processing solutions, integrating multiple data sources, building intelligent automation and preparing data infrastructure for scalable AI and analytics use cases. This is a hands-on engineering role suited to someone who enjoys solving technical problems, building practical solutions and taking ownership of projects from development through deployment.What You Will Do : - Design, develop and maintain scalable data pipelines using Python and SQL.- Build and manage ETL/ELT workflows to extract, transform, validate and load data from multiple sources.- Develop Python-based applications, scripts and backend services for data processing and automation.- Work with Azure services, including Azure Functions, App Services, Key Vault and cloud-based data infrastructure.- Build and integrate REST APIs, third-party platforms and external data sources.- Develop AI-powered applications using Large Language Models (LLMs) for data extraction, processing, classification and intelligent automation.- Build AI workflows, document-processing solutions, chatbots and retrieval-augmented generation (RAG) applications.- Work with vector databases,
embeddings and AI frameworks to develop practical AI solutions.- Implement data validation, quality checks, error handling, monitoring and logging to ensure pipeline reliability.- Optimise SQL queries, database performance and data processing workflows.- Work with Snowflake and modern data warehouse technologies, supporting data migration and integration.- Use Git and GitHub for version control, code management and deployment workflows.- Explore and implement AI-assisted development tools such as Claude Code, Codex and Cursor to improve engineering productivity.- Maintain technical documentation and ensure solutions are scalable, maintainable and secure.What We Are Looking For : - Strong hands-on experience with Python and SQL.- Experience building and maintaining ETL/ELT pipelines and data processing workflows.- Good understanding of data engineering concepts, database design and data modelling.- Practical experience working with REST APIs, integrations and structured/unstructured data.- Experience with cloud platforms, preferably Microsoft Azure.- Understanding of Azure Functions, cloud deployments, storage services and Key Vault.- Hands-on experience or practical project exposure to LLMs and generative AI applications.- Understanding of prompt engineering, embeddings,
vector databases and RAG architectures.- Experience building AI-powered automation, data extraction or intelligent applications.- Familiarity with frameworks and libraries such as LangChain, LlamaIndex, OpenAI APIs or similar.- Experience with Git/GitHub, code debugging, testing and deployment practices.- Understanding of data quality, validation, monitoring and error-handling mechanisms.- Ability to independently develop, troubleshoot and deliver technical solutions.- Valuable written and verbal English communication skills.Good to Have : - Experience with Snowflake, Databricks or other cloud data platforms.- Familiarity with dbt, Apache Airflow or similar orchestration tools.- Experience with Azure OpenAI, OpenAI API, Anthropic Claude or other LLM providers.- Knowledge of machine learning fundamentals and model integration.- Experience with vector databases such as Pinecone, ChromaDB, Weaviate or FAISS.- Familiarity with Docker, CI/CD pipelines and cloud deployment practices.- Experience with Power BI, Looker or other data visualisation tools.- Exposure to agentic AI, AI agents and multi-step workflow automation.- Azure, AWS or relevant AI/cloud certifications.Why Join Us? : - Work on real-world data engineering and AI implementation projects.- Build practical AI-powered applications and intelligent automation solutions.- Gain exposure to modern cloud infrastructure and scalable data platforms.- Work with experienced technical teams and contribute to end-to-end engineering projects.- Enjoy a remote working environment with regular collaboration across UK teams. (ref:hirist.tech)
📌 Data & AI Engineer - Python/SQL (India)
🏢 Opvia.in
📍 India