databrickslabs

Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform

Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test,...

Databricks framework to validate Data Quality of pySpark DataFrames and Tables

Transforms Databricks Unity Catalog tables into a dynamic knowledge graph, with ontology design and reasoning exposed as tools via MCP.

🧱 Databricks CLI eXtensions - aka dbx is a CLI tool for development and advanced Databricks workflows management.

Open-source Databricks cost estimator for workload sizing, DBU pricing, cloud costs, and exportable estimates.

API for manipulating time series on top of Apache Spark: lagged time values, rolling statistics (mean, avg, sum, count, etc), AS OF joins, downsampling, and interpolation

An extension to the Apache Spark framework that allows easy and fast processing of very large geospatial datasets.

Automated migrations to Unity Catalog

Metadata driven Spark Declarative Pipelines framework for bronze/silver pipelines

THIS PROJECT IS DEPRECATED. Capture deep metrics on one or all assets within a Databricks workspace

A Business Catalog for Unity Catalog

Tools to migrate Databricks assets between environments

Manage your Databricks deployments and CI with code.

Toolkit for Apache Spark ML for Feature clean-up, feature Importance calculation suite, Information Gain selection, Distributed SMOTE, Model selection and training, Hyper parameter optimization...

Accelerates migrations to Databricks by automating key migration activities

Python Testing for Databricks

A Swiss-Army-knife for your Data Intelligence platform administration.

Extensible Rules Engine for custom Dataframe / Dataset validation

Geospatial clustering at massive scale

R Toolkit for Databricks

Experimental labs projects

Baseline for Databricks Labs projects written in Python

DEPRECATED: Integrating Jupyter with Databricks via SSH

Accelerator to rapidly deploy customized features for your business

An experimental tool to synchronize source Databricks deployment with a target Databricks deployment.