Data Engineer (AI/BI) | Databricks-Centric - RibbitZ

Our client RibbitZ is looking for Data Engineer (AI/BI) | Databricks-Centric to work remotely.


Job Description:

Availability: Must be available until 4:30 PM ET (USA)

We are looking for an experienced Data Engineer with strong AI Platform Engineering expertise to build and scale modern data and AI solutions in a Databricks-centric environment.

Key Responsibilities:

• Build and scale Databricks AI/BI solutions (dashboards, Genie experiences, data pipelines)
• Develop ETL/ELT pipelines using Apache Spark and Delta Lake (Medallion Architecture)
• Integrate data from enterprise systems like PeopleSoft, Salesforce, and D2L
• Ensure data quality, governance, and security (Unity Catalog, encryption, access control)
• Enable AI/ML teams with high-quality datasets and feature stores
• Design and architect cloud data lakes and data marts (ADLS, S3)
• Document and enable teams on Databricks, governance, and architecture best practices
• Support AIOps/MLOps workflows using MLflow (experiment tracking, model registry, deployment)

Required Skills & Experience:

• Strong hands-on experience with Databricks (Delta Lake, Apache Spark)
• Experience building ELT pipelines and Medallion Architecture
• Proficiency in SQL, Python, or Scala
• Experience integrating enterprise platforms and systems
• Strong knowledge of data governance and metadata management
• Must have experience in AI Platform Engineering

Preferred Qualifications:

• Experience with Databricks Unity Catalog
• Experience in AI/ML model deployment (MLflow)
• Exposure to AIOps lifecycle workflows
• Cloud experience with Azure or AWS
• Knowledge of data warehouse design