How to start a spark engine interactively

salloc -p compute_partners --qos short -N 2 --ntasks-per-node 2 -t 60:00 --constraint=ib --switches=1@00:30:00

Important: Wait for the prompt above to change to a compute node before typing the next commands.

module load spark4/4.2.0-stack
slurm-spark shell

Last modified: November 04 2026 12:29:47.