Job Description Data Engineer (Databricks | Snowflake | Python)

Position: Senior Data Engineer – Databricks, Snowflake & Python

Experience: 5–10 Years

Location: Hyderabad, India

Employment Type: Full-Time

About the Role

We are seeking a highly skilled Data Engineer with strong expertise in Databricks, Snowflake, and Python to design, build, and optimize scalable data platforms and up-to-date data pipelines. The ideal candidate should have hands-on experience working with cloud-based data engineering solutions, data lakes, ETL/ELT frameworks, and large-scale analytics platforms.

This role requires close collaboration with data architects, analysts, AI/ML engineers, and business stakeholders to deliver reliable, high-performance data solutions.

Key Responsibilities
- Design and develop scalable data pipelines using Databricks and Python.
- Build and optimize ETL/ELT workflows for structured and semi-structured data.
- Develop and maintain data models in Snowflake.
- Implement Delta Lake architecture and data lakehouse solutions.




- Create high-performance Spark applications using PySpark.
- Develop reusable data ingestion frameworks.
- Optimize Snowflake warehouses for performance and cost.
- Integrate multiple data sources including APIs, databases, files, and streaming platforms.
- Implement data quality, validation, and monitoring frameworks.
- Build orchestration workflows using Azure Data Factory, Airflow, or similar tools.
- Collaborate with BI teams to support reporting and analytics.
- Implement CI/CD pipelines for data engineering projects.
- Ensure security, governance, and compliance of enterprise data.
- Troubleshoot production issues and optimize existing data pipelines.
- Mentor junior engineers and participate in design reviews.

Required Skills

Databricks
- Azure Databricks / AWS Databricks
- Delta Lake
- Unity Catalog
- Databricks Workflows
- Databricks SQL
- Delta Live Tables (DLT)
- MLflow (preferred)
- Lakehouse Architecture

Snowflake
- Snowfl

📌 Senior Data Engineer-Snowflake,Databricks,Python (Hyderabad)
🏢 Avirasoft Digital Technologies
📍 Hyderabad