Role: ETL Data Engineer – AI/ML & LLM
Experience: 7-8 Years
Location: Hybrid PAN India
Timing -IST
Employment Type : C2C (Contractual)

Job Summary:

We are looking for an experienced ETL Data Engineer with solid expertise in Azure Databricks, Python, Apache Spark, and AI/ML/LLM technologies. The candidate should be capable of independently designing, developing, deploying, and optimizing large-scale ETL/ELT data pipelines to support analytics, machine learning, and enterprise data solutions.

Key Responsibilities

Design and develop scalable ETL/ELT pipelines using Azure Databricks, Lakebase, Python, and Apache Spark.

Build and optimize data pipelines for analytics, BI reporting, machine learning, and predictive modelling.

Integrate data from multiple sources, including databases, APIs, FTP, and cloud storage.

Write complex SQL queries and perform performance tuning and optimization.

Ensure data quality, integrity, reliability, and pipeline efficiency.

Work on data architecture, modelling, and cloud-based data engineering solutions.





Implement CI/CD and DevOps automation using Terraform and GitHub Actions.

Collaborate with AI/ML teams and integrate LLM-based solutions.

Mentor junior data engineers and provide technical guidance.

Required Skills

Data Engineering & ETL/ELT: 7+ years of experience.

Python: 5+ years of hands-on experience.

Apache Spark: 2+ years of experience with PySpark/Spark SQL.

Azure Databricks: 2+ years of experience, including Unity Catalog.

AI/ML & LLM: Practical experience working with AI/ML and LLM technologies.

Additional Technical Skills:

Azure Functions, Service Bus, Snowflake, and Lakebase.

Advanced SQL and data modelling.

Terraform and DevOps automation.

CI/CD: GitHub Actions, Git, Artifactory, and Sonar.

Delta Lake, Data Lake, and Data Warehousing.

Pay: ₹80,000.00 - ₹100,000.00 per month

Experience:

- LLM: 6 years (Required)

Work Location: Remote

📌 ETL Data Engineer (India)
🏢 Technology next
📍 India