Role description
Who we are
At UST, we help the world’s best organizations grow and succeed through transformation. Bringing together the right talent, tools, and ideas, we work with our client to co-create lasting change. Together, with over 30,000 employees in 30+ countries, we build for boundless impact—touching billions of lives in the process. Visit us at UST.com.
Summary
UST is looking for a Cloud Data Engineer with strong experience in Data Engineering, Cloud Technologies, Python, Spark, SQL, and AWS. The ideal candidate will have hands-on experience designing and developing scalable data pipelines and cloud-based data solutions, along with exposure to Generative AI, Agentic AI, LLMs, RAG, FastAPI, and REST APIs.
The candidate should have strong programming skills and experience working with Big Data technologies, cloud platforms, databases, APIs, and microservices.
The Opportunity
We are seeking a Cloud Data Engineer responsible for designing, implementing, and maintaining scalable data solutions on cloud platforms. The role will involve hands-on development, programming, testing, validation, and implementation of Big Data Engineering pipelines and cloud technologies.
Key Roles & Responsibilities
- Design, develop, implement, and maintain scalable data architectures and data solutions on cloud platforms.
- Build, maintain, and optimize Big Data Engineering pipelines for data ingestion, transformation, processing, and delivery.
- Perform hands-on development, programming, testing, and validation of data engineering pipelines.
- Develop scalable data pipelines using Python, Scala, Spark, SQL, and other Big Data technologies.
- Implement cloud-based data engineering solutions using AWS and other cloud technologies.
- Work with Snowflake for data warehousing, data processing, and analytics requirements.
- Design and optimize data workflows to ensure scalability, reliability, performance, and data quality.
- Work with SQL and NoSQL databases for data storage, processing, and integration.
- Develop and integrate REST APIs and microservices using Python frameworks such as FastAPI or Flask.
- Apply data engineering best practices for data ingestion, transformation, validation, reconciliation, and error handling.
- Work with Unix/Linux environments and scripting as required for data engineering activities.
- Leverage Jupyter Notebook, IntelliJ, and Anaconda environments for development, testing, and data analysis.
- Support implementation and integration of Generative AI, LLM, Agentic AI, and RAG capabilities within data engineering solutions.
- Develop or integrate AI-enabled services and APIs using Python and FastAPI.
- Collaborate with data scientists, AI/ML engineers, application developers, and business stakeholders to deliver end-to-end solutions.
- Participate in code reviews, testing, debugging, performance optimization, and production support.
- Follow Agile/SDLC processes, coding standards, documentation practices, and engineering best practices.
- Stay current with emerging cloud, Big Data, AI/ML, and data engineering technologies.
What you need
Required Skills
- 3+ years of professional experience in Data Engineering with a strong focus on Cloud Technologies.
- Strong hands-on experience with Python, Spark, Scala, SQL, and Big Data technologies.
- Experience designing and developing scalable data pipelines and data architectures.
- Hands-on experience with AWS Cloud and cloud computing fundamentals.
- Strong experience with Apache Spark and Big Data processing.
- Experience with Snowflake and Data Warehouse concepts.
- Strong programming expertise in Python / Scala / Java.
- Experience with Python Flask / FastAPI for backend development and API services.
- Hands-on experience developing REST APIs and microservices.
- Valuable understanding of SQL and NoSQL databases.
- Experience with Unix/Linux environments and scripting.
- Strong understanding of Data Engineering fundamentals, ETL/ELT, data pipelines, and data processing.
- Hands-on experience with development environments such as Jupyter Notebook, IntelliJ, and Anaconda.
- Strong testing, validation, debugging, and problem-solving skills.
- Good written and verbal communication skills in English.
Desired Skills
- Exposure to Generative AI (GenAI), Large Language Models (LLMs), Agentic AI, and Retrieval-Augmented Generation (RAG).
- Experience integrating LLM/GenAI capabilities with data engineering platforms and applications.
- Experience with FastAPI for AI/ML and microservice-based applications.
- Knowledge of AI/ML data pipelines and data preparation workflows.
- Experience with additional cloud platforms such as Azure or GCP.
- Knowledge of cloud-native data engineering services and architectures.
- Experience with containerization, CI/CD, and DevOps practices.
- Additional certifications or programs in AWS, Azure, or GCP are preferred.
Qualification
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
- B.E./B.Tech in Computer Science, IT, Engineering, or equivalent qualification preferred.
- Additional certifications/programs in Cloud Technologies (AWS/Azure/GCP) are an advantage.
Key Competencies
Cloud Data Engineering | Python | Spark | Scala | Java | AWS | Snowflake | SQL | NoSQL | Big Data | Data Pipelines | Data Architecture | ETL/ELT | FastAPI | Flask | REST APIs | Microservices | Unix/Linux | Data Warehousing | Generative AI | GenAI | LLM | Agentic AI | RAG | Jupyter Notebook | IntelliJ | Anaconda | Cloud Computing
What we believe
UST values Humility, Humanity, and Integrity. We believe in creating an environment where people can collaborate, innovate, learn, and deliver meaningful impact for our clients and communities.
Equal Employment Opportunity Statement
UST is an Equal Opportunity Employer. We are committed to providing equal employment opportunities to all qualified individuals without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or any other legally protected status. We believe diversity and inclusion strengthen our organization and enable us to deliver better outcomes for our clients.
Skills
Agentic AI, LLMs, Generative AI, Python, FastAPI, RAG, Cloud Infrastructure, Scala, Data Engineering, AWS
About UST
UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact—touching billions of lives in the process.
📌 ML Engineer II (Karnataka)
🏢 UST
📍 Karnataka