20 Sep
|
ATCON GLOBAL
|
India
20 Sep
ATCON GLOBAL
India
? Role: Senior Data Engineer - Databricks & Azure
? Location: India – Remote
? Working model: Remote
We are looking for an experienced Data Engineer to help design, build, and evolve a modern data platform based on Databricks and Microsoft Azure.
This is not only a pipeline-development role. You will work across data ingestion, platform engineering, governance, and Data & AI readiness, collaborating with Cloud, Infrastructure, Security, Networking, Architecture, and Data teams.
What you’ll do
Data Ingestion Engineering
- Design, develop, and maintain scalable Databricks ingestion frameworks
- Build and support Azure Data Factory (ADF) pipelines
- Design reusable ingestion patterns for file-based and other data sources
- Onboard new data sources and ingestion patterns
- Improve reliability, observability, performance, and maintainability of data pipelines
Data Platform Engineering
- Help define and implement capabilities for a scalable, secure, and governed analytical platform
- Collaborate with Cloud, Infrastructure, Security, Networking, and Enterprise Architecture teams
- Support platform architecture and foundational components for analytics, data products, and AI initiatives
- Define and promote engineering standards, reusable components,
and best practices
- Automate platform and data-governance processes where possible
Platform Evolution & Innovation
- Evaluate and implement recent Databricks capabilities
- Explore and enhance Unity Catalog and data-governance capabilities
- Assess Data Quality Monitoring and data-classification capabilities
- Evaluate data-retention and lifecycle-management approaches
- Prototype new platform, automation, and AI-related capabilities
- Contribute to improving the platform's overall Data & AI readiness
What we look for
✓ Strong hands-on Databricks experience
✓ Strong Microsoft Azure experience
✓ Python / PySpark
✓ SQL
✓ Azure Data Factory
✓ Git and modern development practices
✓ Strong understanding of data engineering best practices
✓ Experience designing production-grade data pipelines and reusable frameworks
✓ Ability to collaborate effectively with cross-functional technical teams
Nice to have
- Unity Catalog and Data Governance experience
- Lakehouse architecture
- Data Quality / Observability
- Data readiness for AI
- Snowflake
- Microsoft Fabric
- Data Mesh concepts
- Data Product operating models
📌 Senior Data Engineer (India)
🏢 ATCON GLOBAL
📍 India