- How to start a Spark engine and submit an application
- How to start a spark engine interactively
- How to start a spark engine only, then submit subsequent batch applications against that engine
- How to start a spark engine only, then submit subsequent interactive applications against that engine
Big Data Analytics with APACHE Spark
General info on Sponsored Applications
These applications are not officially maintained, that is, HPC does not update this software or provide official support or documentation.
Sponsored applications are sponsored by users who have volunteered to share their software installations with users outside of their project group and to field basic questions about usage. There is no expectation that applications will be updated to the latest version, or that the installations have been rigorously tested, or that the person volunteering to field questions will have the capacity to provide extensive or time sensitive troubleshooting or training for the applications.
How to Request Access
Send an email to help@ncsu.edu to be added to the spark software group. Instructions for both SLURM and LSF exist, however, because the cluster is transitioning to SLURM, only those instructions will be in our on-line documentation.
APACHE Spark examples
To learn more about APACHE Spark on the Hazel HPC
The Data Science Academy (DSA) offers a spring course, DSA440, that is an Introduction to Big Data Analytics with APACHE Spark on the Hazel HPC.
Last modified: July 01 2026 10:44:32.