Required Skills:

- Robust experience in Data Engineering and ETL/ELT processes
- Proficiency in Python
- Hands-on experience with Apache Spark (PySpark and Spark SQL)
- Experience with Azure Databricks (Unity Catalog), Snowflake, Azure Functions, and Service Bus
- Strong SQL development and optimization skills
- Experience with Infrastructure as Code using Terraform
- Hands-on experience with CI/CD tools such as GitHub Actions, Git, Artifactory, and SonarQube
- Experience with AI/ML concepts and Large Language Models (LLMs)

Key Responsibilities

- Design, develop, and maintain scalable data pipelines and ETL/ELT solutions
- Build and optimize data processing workflows using Python and Spark
- Develop cloud-based data solutions using Azure Databricks and Snowflake
- Implement and manage infrastructure using Terraform
- Develop and maintain CI/CD pipelines for data engineering projects
- Collaborate with cross-functional teams to deliver high-quality data solutions
- Support AI/ML and LLM-based initiatives as required

📌 Azure Data Engineer (Hyderabad)
🏢 Prophecy Technologies
📍 Hyderabad