Elastic HPC Jobs - OFS

Example HPC jobs with CCQ and OrangeFS

Setup to Launch a Sample Job

To setup the sample job, first ssh into the login instance and copy the sample jobs directroy to the shared file system:

$ copy -r /software/samplejobs/ /mnt/orangefs/                          

Edit the sample job you would like to run. Remove the extra comment (#) from the scheduler you are running. In this example the Slurm scheduler is used. Uncomment the sharedFS option you selected. Here we are using OrangeFS as an example.


Launch the job by running the ccqsub command. Check the status with ccqstat:

$ ccqstat
ccqsub -js mpi_prime.sh

You can edit the file, save some other node configurations and launch them as well.

ccqsub -js mpi_prime4-1.sh

You can also run preemptible instance jobs by adding directives to the job script.

#CC -up yes (use preemptible)
#CC -gcpit n1-highcpu-32 (the instance type)
ccqsub preemptible job

When the job is in the:

ccqs job status

The completed status is displayed when the job is done.

ccq job status complete

The Job Status Output is sent to the home directory or the directory the job was launched from.

ccq job status output in homedir

When there are no more jobs for that instance type, the instances are then terminated.

ccq instances terminating when there are no more jobs

Now you can pause your HPC Environment if you do not have any more jobs to run. Once everything is paused, you can also stop the control node from the GCP Console and restart it when you are ready to run jobs again.

To assist researchers, a wide variety of common open HPC tools and libraries are pre-installed and configured, ready to run and ready to scale.