Our client RibbitZ is looking for Data Engineer (AI/BI) | Databricks-Centric to work remotely.
Availability: Must be available until 4:30 PM ET (USA)
We are looking for an experienced Data Engineer with robust AI Platform Engineering expertise to build and scale modern data and AI solutions in a Databricks-centric environment.
Key Responsibilities:
- Build and scale Databricks AI/BI solutions (dashboards, Genie experiences, data pipelines)
- Develop ETL/ELT pipelines using Apache Spark and Delta Lake (Medallion Architecture)
- Integrate data from enterprise systems like PeopleSoft, Salesforce, and D2L
- Ensure data quality, governance, and security (Unity Catalog, encryption, access control)
- Enable AI/ML teams with high-quality datasets and feature stores
- Design and architect cloud data lakes and data marts (ADLS, S3)
- Document and enable teams on Databricks, governance, and architecture best practices
- Support AIOps/MLOps workflows using MLflow (experiment tracking, model registry, deployment)
Required Skills & Experience:
- Strong hands-on experience with Databricks (Delta Lake, Apache Spark)
- Experience building ELT pipelines and Medallion Architecture
- Proficiency in SQL, Python, or Scala
- Experience integrating enterprise platforms and systems
- Strong knowledge of data governance and metadata management
- Must have experience in AI Platform Engineering
Preferred Qualifications:
- Experience with Databricks Unity Catalog
- Experience in AI/ML model deployment (MLflow)
- Exposure to AIOps lifecycle workflows
- Cloud experience with Azure or AWS
- Knowledge of data warehouse design