Job Description Data Engineer (Databricks | Snowflake | Python)

Position: Senior Data Engineer – Databricks, Snowflake & Python

Experience: 5–10 Years

Location: Hyderabad, India

Employment Type: Full time

About the Role

We are seeking a highly skilled Data Engineer with robust expertise in Databricks, Snowflake, and Python to design, build, and optimize scalable data platforms and up-to-date data pipelines. The ideal candidate should have hands-on experience working with cloud-based data engineering solutions, data lakes, ETL/ELT frameworks, and large-scale analytics platforms.

This role requires close collaboration with data architects, analysts, AI/ML engineers, and business stakeholders to deliver reliable, high-performance data solutions.

Key Responsibilities
Design and develop scalable data pipelines using Databricks and Python.
Build and optimize ETL/ELT workflows for structured and semi-structured data.
Develop and maintain data models in Snowflake.
Implement Delta Lake architecture and data lakehouse solutions.




Create high-performance Spark applications using PySpark.
Develop reusable data ingestion frameworks.
Optimize Snowflake warehouses for performance and cost.
Integrate multiple data sources including APIs, databases, files, and streaming platforms.
Implement data quality, validation, and monitoring frameworks.
Build orchestration workflows using Azure Data Factory, Airflow, or similar tools.
Collaborate with BI teams to support reporting and analytics.
Implement CI/CD pipelines for data engineering projects.
Ensure security, governance, and compliance of enterprise data.
Troubleshoot production issues and optimize existing data pipelines.
Mentor junior engineers and participate in design reviews.

Required Skills

Databricks
Azure Databricks / AWS Databricks
Delta Lake
Unity Catalog
Databricks Workflows
Databricks SQL
Delta Live Tables (DLT)
MLflow (preferred)
Lakehouse Architecture

Snowflake
Snowfl

📌 Senior Data Engineer Snowflake,databricks,python Hyderabad
🏢 Avirasoft Digital Technologies
📍 Hyderabad