24 Oct
|
Codians.ai
|
Mumbai
We’re Hiring: Data Engineer – Azure Databricks | Location Mumabi
Experience: 4–6 Years
Technology: Azure Databricks | PySpark | Python | SQL | Delta Lake
We’re looking for an experienced Data Engineer to build, deploy, and operate contemporary, scalable data platforms on Azure Databricks.
In this role, you’ll collaborate with a Senior Architect and take end-to-end ownership of data engineering solutions—from ingestion and transformation to CI/CD, deployment, monitoring, and production support.
We’re building for an AI-native world and are looking for engineers who can leverage AI coding assistants, AI agents, reusable workflows, and automation to improve engineering productivity and reliability.
Key Responsibilities
- Build scalable batch and real-time data pipelines using Databricks, PySpark, SQL, and Delta Lake.
- Implement Medallion Architecture (Bronze/Silver/Gold) and governed data products using Unity Catalog.
- Develop streaming pipelines using Structured Streaming and Azure Event Hubs.
- Work with ADLS Gen2, Azure Key Vault, and Azure DevOps.
- Own CI/CD pipelines, deployment automation, monitoring, and production troubleshooting.
- Optimize pipeline performance, reliability, and cloud costs.
- Develop analytical datasets and dashboards using BI and visualization tools.
- Build data products that support analytics, ML, GenAI, and agentic applications.
- Use AI coding assistants and agents for development, testing, documentation,
troubleshooting, and automation.
Required Skills & Experience
- 4–6 years of experience in Data Engineering or Data Platforms.
- Strong hands-on skills in Python, PySpark, and SQL.
- Experience with Azure Databricks, Delta Lake, and Medallion Architecture.
- Hands-on experience with batch and real-time data pipelines.
- Knowledge of Unity Catalog, Databricks Workflows/Jobs, and Structured Streaming.
- Experience with ADLS Gen2, Azure Event Hubs, Azure DevOps/Git, and Key Vault.
- Understanding of CI/CD, cloud security, and production operations.
- Experience with BI/dashboarding tools.
- Strong problem-solving skills and an ownership mindset.
- Comfortable working with AI coding assistants, AI agents, and AI-native engineering practices.
Good to Have
- Azure or Databricks certifications.• Experience with Lakeflow/DLT, Terraform/IaC, or Kafka.
- Exposure to AWS/GCP and Databricks.• Knowledge of GenAI, RAG, or agentic applications.• Experience in Telecom, Media, Advertising, or AdTech.
Interested?
If you’re passionate about building production-grade data platforms and using AI to make engineering faster, smarter, and more reliable, we’d love to connect!
Apply now or share your profile: [Add Email/Contact Details]
#Hiring #DataEngineer #AzureDatabricks #PySpark #Python #SQL #DeltaLake #Azure #DataEngineering #GenAI #AIEngineering #DataJobs
📌 Data Engineer – Azure Databricks | 4–6 Years | Mumabi | Onsite | Immediate Joiner (Mumbai)
🏢 Codians.ai
📍 Mumbai