Dask job submission on Slurm

The demo can be view on nbviewer: https://nbviewer.org/github/rendeirolab/dask-cluster/blob/main/job-submission.ipynb

Setup

We use uv to handle environment, install uv on cluser

curl -LsSf https://astral.sh/uv/install.sh | sh

Clone this repository

git clone https://github.com/rendeirolab/dask-cluster.git

Launch the jupyter server

port=$(shuf -i8000-9999 -n1)
uv run --with jupyter jupyter lab --no-browser --port $port --ip=$(hostname).int.cemm.at