Computer science and AI
Computer science and AI labs run experiments that can be rerun, because every run says how it was made. Train and evaluate models in notebooks, keep the code commit, parameters and metrics of every run, and work under quotas and a monthly cost ceiling.
LabSpace for computer scientists
Train and evaluate a classifier
Split the data, train a model with scikit-learn and read the held-out accuracy and confusion matrix, all in one notebook cell you can run again.
- Load the dataset
- Train a gradient-boosted classifier
- Score it on held-out data
- Plot the confusion matrix
Compare runs across seeds
Run the same training with several seeds and plot the spread, so a result in the paper is not a lucky run.
- Train the model with five seeds
- Collect validation accuracy per epoch
- Plot the mean and spread
- Report the final accuracy with its range
Keep the experiment in one place
An experiment holds its notebooks, statistics, reports and notes on one canvas, so the lab can see what was tried and what came of it.
- Open the experiment from the lab
- Add a notebook to the canvas
- Add Stats and a report beside it
- Switch to the view the lab shares
The tools behind it
- Notebooks: Colab-style notebooks with a browser runtime or your own computer
- Results ledger: Code commit, parameters, metrics, dataset version and environment image per run
- Compute: Cloud resources under quotas and a monthly ceiling
- GitHub: Connect repositories so runs point at real commits