Singularity Container

Quickstart:

Go through Joe's installation process.

Install the mpich mpi library, see e.g. here

Load the singularity module:

module load singularity

Get the singularity image:

PATH_TO_IMAGE="/set/your/path/here"
cp /nfs/turbo/cjablono2/owhughes/e3sm.sif ${PATH_TO_IMAGE}

Clone this repo into ~/.cime.

Modify ~/.cime/bash.source to match your setup.

Run:

singularity shell ${PATH_TO_IMAGE} 
source ~/.cime/bash.source

Modify the case creation script ~/.cime/singularity_create_aquaplanet.sh (you can ctrl-f "fail" to see where to change things)

From within the singularity container, run the case script. After it finishes navigate to the case_scripts directory in our aquaplanet case and run ./case.build again, because the build script seems to not install all the files that need to be placed somewhere.

Once this is done, copy ~/.cime/submit.sh to the case_scripts directory.

Modify this verison of submit.sh to match your filesystem.

Run sbatch submit.sh. See if it works.

Step 0:

  • If you're on Mac, install Docker and create an Ubuntu image.
  • Install an Ubuntu 18.04 image.
  • Install singularity within this image.

The e3sm.def file for building the e3sm.sif file is given here

Look up a tutorial for how to build this image using singularity within ubuntu.