Docs
Search…
Software on Lawrence
The Lawrence HPC uses modules for the use of pre-installed software applications on the HPC. Modules allow various versions of software to be available. This document provides a brief overview of module commands as they pertain to USD's Lawrence HPC.
Once you are logged into Lawrence, the module commands will be available to you. Following is a brief overview of the basic module commands:
Modules are for software that have been installed on Lawrence as a whole. If you have installed software in your own account (e.g. through Anaconda/Bioconda), it will be ready without being loaded.
Command
Description
module avail
show all modules that are available on the system
module load SOME.APP
load the listed application (as long as it is available)
module unload SOME.APP
unload a previously loaded module
module list
list the modules you have loaded
module help
gives you information regarding the module command
The following example uses module commands to load R version 3.4.1 and then open R for command line use on Lawrence:
1
[[email protected]@login ~]$ module avail
2
r/3.4.1
3
[[email protected]@login ~]$ module load r/3.4.1
4
[[email protected]@login ~]$ R
5
6
R version 3.4.1 (2017-06-30) -- "Single Candle"
7
Copyright (C) 2017 The R Foundation for Statistical Computing
8
Platform: x86_64-pc-linux-gnu (64-bit)
9
10
>
Copied!

Anaconda

Anaconda is a channel software manager of conda which can be used for installing various applications. Anaconda is recommended for those wishing to install software that is not readily available as a module. More information on using Anaconda can be found on the Anaconda documentation page here. Packages currently available on Anaconda can be found here. Anaconda provides python by default. R may be installed using the command "conda install R".
To install Anaconda in your home directory on Lawrence, connect to a node, then run the install-anaconda script as follows:
1
[[email protected]@login ~]$ srun --pty bash
2
[[email protected]@node10 ~]$ /apps/install-anaconda.sh
3
Downloading installer
4
Running installer
5
...
6
Done!
7
[[email protected]@node10 ~]$
8
Copied!
Then run the installer. Make sure to select "yes" when asked about prepending the Anaconda3 install location to PATH.
1
[[email protected]@node10 ~]$ bash Miniconda3-latest-Linux-x86_64.sh
2
3
Welcome to Miniconda3 4.7.10
4
5
In order to continue the installation process, please review the license
6
agreement.
7
Please, press ENTER to continue
8
>>>
Copied!
Click "enter" to continue through the license. (You may need to click "enter" multiple times.)
Accept the terms:
1
....
2
Do you accept the license terms? [yes|no]
3
[no] >>> yes
4
....
Copied!
Then click "enter" to accept the installation location when asked.
1
Miniconda3 will now be installed into this location:
2
/home/usd.local/user.name/miniconda3
3
4
- Press ENTER to confirm the location
5
- Press CTRL-C to abort the installation
6
- Or specify a different location below
7
[/home/usd.local/user.name/anaconda3] >>>
8
PREFIX=/home/usd.local/user.name/anaconda3
9
...
Copied!
Let the installer initialize Miniconda3.
Do you wish the installer to initialize Miniconda3 by running conda init? [yes|no] [no] >>>yes
You may need to re-open your terminal for changes to take effect, before continuing
1
==> For changes to take effect, close and re-open your current shell. <==
2
3
If you'd prefer that conda's base environment not be activated on startup,
4
set the auto_activate_base parameter to false:
5
6
conda config --set auto_activate_base false
7
8
Thank you for installing Miniconda3!
9
[[email protected]@node10 ~]$
Copied!
Check to make sure that conda is installed:
1
[[email protected]@login ~]$ which conda
2
~/miniconda3/bin/conda
Copied!
Then update your Miniconda to the latest version of Anaconda3:
1
[[email protected]@node10 ~]$ conda update conda && conda update anaconda
Copied!
Note: conda update conda may also be used to update Anaconda/Bioconda later.

Packages

Packages that do not automatically come with Anaconda may be installed using the "conda install package-name" command. Package options are available here. R language package options are available here (see the "R" section for installation details for R packages).
1
[[email protected]@node10 ~]$ conda install mpi4py
Copied!

R

After Anaconda is installed, to install R, use "conda install R":
1
[[email protected]@node10 ~]$ conda install R
2
Solving environment: done
3
...
4
xorg-xproto 7.0.31: ########################################################### | 100%
5
Preparing transaction: done
6
Verifying transaction: done
7
Executing transaction: done
8
[[email protected]@node10 ~]$ which R
9
Copied!
MRO (Microsoft R Open) is also available, and provides threading.
Anaconda may also be used to install R packages. One popular package at USD is R-essentials. To install this, use the conda install command "conda install -c r r-essentials":
1
[[email protected]@node10 ~]$ conda install -c r r-essentials
2
Solving environment: done
3
4
## Package Plan ##
5
6
environment location: /home/usd.local/user.name/anaconda3
7
8
added / updated specs:
9
- r-essentials
10
...
11
Preparing transaction: done
12
Verifying transaction: done
13
Executing transaction: done
14
[[email protected]@node10 ~]$
Copied!

Bioconda

Bioconda is a version of Anaconda (a channel software manager of conda) that is designed especially for use in the biological sciences. It can be used for installing various bioinformatics applications. Bioconda is recommended for those wishing to install software that is not readily available as a module, especially in the biological sciences. More information on using Bioconda can be found on the Bioconda documentation page here. Packages currently available on Bioconda can be found here.
To install Bioconda in your home directory on Lawrence, connect to a node, then run the install-bioconda script as follows:
1
[[email protected]@login ~]$ srun --pty bash
2
[[email protected]@node10 ~]$ /apps/install-bioconda.sh
3
Downloading installer
4
Running installer
5
PREFIX=/home/usd.local/user.name/anaconda3
6
Installing...
7
...
8
Done!
Copied!
There will be a .sh file in your home directory. Run this using bash.
1
[[email protected]@node10 ~]$ ls
2
anaconda3 Miniconda3-latest-Linux-x86_64.sh perl5
3
[[email protected]@node10 ~]$ bash Miniconda3-latest-Linux-x86_64.sh
4
5
Welcome to Miniconda3 4.7.10
6
7
In order to continue the installation process, please review the license
8
agreement.
9
Please, press ENTER to continue
10
Copied!
Press enter to continue, and to scroll through the license, then type "yes" to accept the license.
1
Do you accept the license terms? [yes|no]
2
[no] >>> yes
3
4
Miniconda3 will now be installed into this location:
5
/home/usd.local/user.name/miniconda3
Copied!
Press enter to confirm the installation location.
1
- Press ENTER to confirm the location
2
- Press CTRL-C to abort the installation
3
- Or specify a different location below
4
5
[/home/usd.local/user.name/miniconda3] >>>
Copied!
Type "yes" to allow the installer to run conda init
1
Do you wish the installer to initialize Miniconda3
2
by running conda init? [yes|no]
3
[no] >>> yes
Copied!
Wait for the installation to finish. Your command prompt will reappear to show that the computer is ready.
1
Thank you for installing Miniconda3!
2
[[email protected]@node10 ~]$
Copied!
Log out of the node and Lawrence, then back into Lawrence for the changes to take effect.
1
[[email protected]@node10 ~]$ exit
2
[[email protected]@login ~]$ exit
3
exit
4
[MyName.NI1111] ➤ ssh [email protected]
5
...
6
[[email protected]@login ~]$ which conda
7
~/miniconda3/bin/conda
Copied!
Bioconda will now be available through your home directory to install software. It will appear as "Anaconda"
After Bioconda is installed, to install R, use "conda install R" (see instructions above: Anaconda - R)

Math Libraries

Intel Math Kernel Library (MKL)

The Intel MKL library is available on Lawrence and is the recommended math library for most applications. This library is configurable to various compilers and languages. Functions provided by Intel MKL include BLAS, LAPACK, and FFTW. For more information on Intel MKL, please visit the developer documentation webpage.
Intel also provides a tool to generate appropriate command line options for your particular compiler, integer size, and threading model which can be found here.
Example command line options for C and GCC compilers can be found below. These commands would be added after running "module load intel":
Intel C compiler:
1
-DMKL_ILP64 -I${MKLROOT}/include -L${MKLROOT}/lib/intel64 -lmkl_intel_ilp64 -lmkl_sequential -lmkl_core -lpthread -lm -ldl
Copied!
GCC C compiler:
1
-DMKL_ILP64 -m64 -I${MKLROOT}/include -L${MKLROOT}/lib/intel64 -Wl,--no-as-needed -lmkl_intel_ilp64 -lmkl_sequential -lmkl_core -lpthread -lm -ldl
Copied!
Last modified 1yr ago