Software

From FarmShare

(Difference between revisions)
Jump to: navigation, search
 
(29 intermediate revisions not shown)
Line 1: Line 1:
-
There is a lot of software available on the FarmShare systems.  The systems run Ubuntu, so a lot of [[Packages | Ubuntu packages]] are installed.
+
==Packaged Software==
-
There is also some licensed software installed: https://itservices.stanford.edu/service/sharedcomputing/software
+
FarmShare systems run Ubuntu, and most software is installed using [[Packaged Software | packages]] available from the standard Ubuntu repositories. Select external repositories are used to provide more frequently updated versions of very commonly used software (''e.g.'', [[R]]).
-
Notice: /usr/pubsw, /usr/sweet/bin, and /mnt/glusterfs/software have been deprecated.  All have been replaced by /farmshare/software.
+
==Commercial Software==
-
/farmshare/software can be accessed as follows:
+
A selection of commercial software is also available, but '''please note''' that this software is licensed for use on FarmShare ''only'' in coursework, and ''not'' for research. Licensed software is made available using environment modules, and can be accessed using the <code>module</code> command.
-
===using latest version of matlab===
+
==Software Modules==
-
<source lang="sh">
+
-
bishopj@scorn:~$ module avail
+
Software not installed from packages is managed using [https://lmod.readthedocs.io/en/latest/010_user.html Lmod] environment modules. Use the <code>module avail</code> and <code>module spider</code> commands to list available software, and <code>module load</code> to load desired modules. You can unload modules and restore a previous environment using the <code>module unload</code> and <code>module purge</code> commands.
-
--------------------- /farmshare/software/free/lmod-5.0-install/lmod/lmod/modulefiles/Core ----------------------
+
===An Example: Using MATLAB===
-
  lmod/lmod    settarg/settarg
+
-
 
+
-
----------------------------------------- /farmshare/software/mf/raring -----------------------------------------
+
-
  cplex/12.4    gaussian/g09gview50    matlab/r2013a  (D)    statase/12.1
+
-
  cuda/5.5      mathematica/9.0        sas/9.2                stattransfer/12
+
-
  gams/24.1    matlab/r2012b          statamp/12.1
+
-
 
+
-
------------------------------------- /farmshare/software/mf/raring-compat --------------------------------------
+
-
  CPLEX-12.4    MATLAB-R2012b    Mathematica-9.0    StatTransfer-v12    StataSE-12.1
+
-
  GAMS-24.1    MATLAB-R2013a    SAS-v9.2          StataMP-12.1
+
-
 
+
-
  Where:
+
-
  (D):  Default Module
+
-
 
+
-
See https://www.stanford.edu/group/farmshare/cgi-bin/wiki/index.php/FarmShare_software for description of how to
+
-
use modules.
+
-
 
+
-
To load latest version of matlab: module load matlab
+
-
You can load a specific version by: module load matlab/r2012b or module load MATLAB-R2012b
+
-
 
+
-
or to find out more information for a package: module spider matlab
+
-
 
+
-
bishopj@scorn:~$ module load matlab
+
-
bishopj@scorn:~$ module list
+
-
 
+
-
Currently Loaded Modules:
+
-
  1) matlab/r2013a
+
-
 
+
-
$ matlab -nodesktop
+
-
</source>
+
-
 
+
-
===using a specific version of software (StatTransfer version 12 in this case)===
+
<source lang="sh">
<source lang="sh">
-
$ module load StatTransfer-v12
+
which matlab
-
 
+
module avail
-
$ st --version
+
module spider matlab
-
Stat/Transfer (c) 1986-2013 Circle Systems, Inc.
+
module load matlab
-
www.stattransfer.com
+
module list
-
Version 12.0.56.0613 - 64 Bit Linux
+
which matlab
-
 
+
matlab
-
Serial: B2CNR-FZAS7-LPHI
+
module unload matlab
-
User: Software Licensing - Stanford University
+
which matlab
-
License Type: 25 User Workgroup / Lease
+
-
Status: License OK - Expires April 30, 2014
+
-
 
+
-
$ module spider stattransfer
+
-
bishopj@scorn:~$ module spider stattransfer
+
-
 
+
-
  -------------------------------------------------------------------------------------------------------------
+
-
  stattransfer: stattransfer/12
+
-
  -------------------------------------------------------------------------------------------------------------
+
-
    Description:
+
-
      File conversion utility
+
-
 
+
-
    This module can be loaded directly: module load stattransfer/12
+
-
 
+
-
    Help:
+
-
      This is Stat/Transfer version 12
+
-
     
+
-
      call 'st' for CLI
+
-
+
</source>
</source>
-
==modules==
+
== User-installed Software ==
-
We use 'modules', a commonly used software package in HPC environments: http://modules.sourceforge.net/
+
-
The 'module' command has been added to your environment, but if you have modified your environment away from the defaults, you may need to source the module env vars for your shell.
+
New or updated software can often be built and/or installed by users in their own home directories, and local package managers like [http://linuxbrew.sh Linuxbrew] and [https://spack.io Spack] can help. Local package managers are also available for many programming languages (e.g., [https://pip.pypa.io <code>pip</code>], [https://virtualenv.pypa.io <code>virtualenv</code>], and [https://conda.io Conda] for [https://www.python.org Python], <code>local::lib</code> and [https://perlbrew.pl Perlbrew] for [https://www.perl.org Perl], and [https://luarocks.org Luarocks] for [https://www.lua.org Lua]), and some of these provide tools for managing entire local programming environments.
-
 
+
-
For example, you may need to try something like this at the end of your .bashrc:
+
-
<source lang="sh">
+
-
HOSTNAME=$(hostname)
+
-
if [ "${HOSTNAME:0:4}" = "corn" ]; then
+
-
  #source farmshare modules
+
-
  echo "on a corn! try module avail"
+
-
  eval `tclsh /mnt/glusterfs/software/free/modules/tcl/modulecmd.tcl sh autoinit`
+
-
fi
+
-
</source>
+
-
 
+
-
Then you can do something like:
+
-
<source lang="sh">
+
-
module avail
+
-
module load stata
+
-
stata
+
-
</source>
+
 +
== Containers ==
-
Link: https://www.stanford.edu/group/hpcc/cgi-bin/mediawiki/index.php/Modules
+
[http://singularity.lbl.gov Singularity] containers are supported, but bootstrapping an image requires <code>root</code> access, so you'll need to create your containers elsewhere and copy them to FarmShare to run.

Latest revision as of 09:39, 4 September 2018

Contents

Packaged Software

FarmShare systems run Ubuntu, and most software is installed using packages available from the standard Ubuntu repositories. Select external repositories are used to provide more frequently updated versions of very commonly used software (e.g., R).

Commercial Software

A selection of commercial software is also available, but please note that this software is licensed for use on FarmShare only in coursework, and not for research. Licensed software is made available using environment modules, and can be accessed using the module command.

Software Modules

Software not installed from packages is managed using Lmod environment modules. Use the module avail and module spider commands to list available software, and module load to load desired modules. You can unload modules and restore a previous environment using the module unload and module purge commands.

An Example: Using MATLAB

which matlab
module avail
module spider matlab
module load matlab
module list
which matlab
matlab
module unload matlab
which matlab

User-installed Software

New or updated software can often be built and/or installed by users in their own home directories, and local package managers like Linuxbrew and Spack can help. Local package managers are also available for many programming languages (e.g., pip, virtualenv, and Conda for Python, local::lib and Perlbrew for Perl, and Luarocks for Lua), and some of these provide tools for managing entire local programming environments.

Containers

Singularity containers are supported, but bootstrapping an image requires root access, so you'll need to create your containers elsewhere and copy them to FarmShare to run.

Personal tools
Toolbox
LANGUAGES