Job Description:

Responsibilities Develop and maintain real-time data pipelines using Apache Kafka (MSK or Confluent) and AWS services. Configure and manage Kafka connectors, ensuring seamless data flow and integration across systems. Demonstrate a robust understanding of the Kafka ecosystem, including producers, consumers, brokers, topics, and schema registry. Design and implement scalable ETL/ELT workflows to process large volumes of data efficiently. Optimize data lake and data warehouse solutions using AWS services such as Lambda, S3, and Glue. Implement robust monitoring, testing, and observability practices to ensure data platform reliability and performance. Uphold data security, governance, and compliance standards across all data operations. Requirements Minimum of 5 years of experience in data engineering or related roles. Proven expertise with Apache Kafka and the AWS data stack (MSK, Glue, Lambda, S3, etc.). Proficient in coding with Python, SQL, and Java (Java strongly preferred).



Person needs to adaptable to write code in Python/Java Experience with infrastructure-as-code tools (e.g. CloudFormation) and CI/CD pipelines. Excellent problem-solving skills and solid communication and collaboration abilities.

Skills:

Python, SQL, AWS CloudFormation, CI/CD

About Company:

UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact—touching billions of lives in the process.

📌 Lead Ii Data Engineering Pune
🏢 UST
📍 Pune