Azure Platform Engineering (Data Analytics Focus)
- Design and manage cloud infrastructure for enterprise data platforms including:
- Azure Data Lake Storage (ADLS)
- Azure Databricks
- Collibra Data Intelligence Cloud integrations
- Enable high-performance, scalable environments for MDM and Data Quality solutions
DevOps CI/CD Enablement
- Build and manage CI/CD pipelines for data products, MDM platforms, and data quality rules
- Automate deployments for:
- Collibra workflows, DQ rules, and integrations
- Databricks notebooks, jobs, and clusters
- Leverage:
- Azure DevOps (Pipelines, Repos)
- Git-based version control and branching strategies
- Enable release governance, environment promotion, and rollback strategies
- Implement data security controls aligned with BD s compliance and governance standards
- Collaborate with security teams to enforce Zero Trust and least privilege access
Automation Scripting
- Develop robust automation using PowerShell, Python, Bash
- Automate:
- Data pipeline deployments
- Data quality rule execution workflows
- Monitoring alerts and issue remediation
- Integrate APIs across systems (Collibra, ServiceNow, Azure services)
Required Skills Qualifications
Core Technical Expertise
- Strong Azure experience with focus on data platforms (ADLS, Databricks)
- Strong Knowledge in Collibra platform installation Maintenance.
- Expertise in CI/CD pipelines (Azure DevOps) for data engineering workloads
- Good knowledge in Terraform / Bicep / ARM templates
- Valuable knowledge of Azure networking (Private Link, VNets, NSG, Firewall)
- Basic scripting skills (PowerShell, Python, Bash)
Data Platform Governance Experience
- Experience working with:
- Collibra (Data Quality, Data Catalog, Workflows) highly preferred
- Databricks (job orchestration, notebook deployment)
- Understanding of:
- Data Quality frameworks and rule execution lifecycle
- MDM ecosystems and domain-based data products