- Design, develop, test, deploy and maintain large-scale data pipelines using Data Bricks, Snowflake, Spark Streaming and other technologies.
- Collaborate with cross-functional teams to gather requirements and design scalable data architectures that meet business needs.
- Develop complex SQL queries to extract insights from massive datasets stored in Snowflake database.
- Troubleshoot issues related to data processing pipeline failures and optimize performance for improved efficiency.
Job Requirements :
- 6-13 years of experience in Data Engineering with expertise in Data Bricks, Snowflake, Spark Streaming.
- Robust understanding of generative AI models such as Vertex AI's retrieval augmented generation (RAG) technology.
- Experience working with large language models like Neo4J or similar tools is an added advantage.
- Proficiency in PySpark programming language.
📌 Data Engineer (Hyderabad)
🏢 The Hartford
📍 Hyderabad
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.