Main Page

From FarmShare

(Difference between revisions)
Jump to: navigation, search
Line 1: Line 1:
-
<seo metadescription="FarmShare shared computing and HPC resource for Stanford faculty, staff, and students, provided at no cost" metakeywords="farmshare, hpc, free, linux, ubuntu, cluster, matlab, R, Julia, MPI, SGE, grid engine, slurm, rice, oat, wheat, barley, corn, cardinal, timeshares, shared computing"/>
+
FarmShare is Stanford’s community computing environment. It is intended for use in coursework and unsponsored research; users participating in sponsored research should investigate the Sherlock service, instead. FarmShare is ''not'' approved for use with [https://dataclass.stanford.edu high-risk] data, including protected health information and personally identifiable information.
-
== FarmShare ==
+
-
This wiki is intended for the users of FarmShare, one of the Stanford shared research computing environments. The current FarmShare environment, [[FarmShare 2]], comprises the <code>rice</code>, <code>wheat</code>, and <code>oat</code> systems; the legacy FarmShare environment includes the <code>corn</code>, <code>barley</code>, and <code>rye</code> machines. <code>cardinal</code> systems can be used for light-duty, interactive work (e.g., e-mail, web browsing and development, file editing, and AFS access or file transfers). For a general description of this service and Stanford's shared computing policies, see the [https://farmshare2.stanford.edu FarmShare 2] and [https://itservices.stanford.edu/service/sharedcomputing legacy FarmShare] service documentation.
+
-
 
+
-
FarmShare is intended for use in coursework and unsponsored research; users participating in sponsored research should investigate the [https://sherlock.stanford.edu Sherlock] service, instead. FarmShare is ''not'' approved for use with high-risk data, including PHI and PII.
+
-
 
+
-
Also, if you are a course instructor recommending that your students use FarmShare for assignments, any additional open source software requests for your class should be made at least three weeks in advance of the start of the quarter.  Requests should be sent by the instructor to srcc-support@stanford.edu. We are not staffed to accommodate students' requests for new versions of software and libraries, nor new tools, during the quarter.  FarmShare users can install their own tools, of course.
+
 +
For a description of the current environment, see [[FarmShare 2]]. More information can be found in the [https://srcc.stanford.edu/farmshare2 service documentation].
__NOTOC__
__NOTOC__
-
 
-
'''Most useful pages:
 
-
* [[Special:AllPages]]
 
-
* [[Special:RecentChanges]]
 
-
* [[User Guide]] and [[FAQ]]
 
-
* [[FarmShare tutorial]]
 
-
* [[FarmVNC]]'''
 
-
 
-
 
{| width="100%" cellpadding="20"
{| width="100%" cellpadding="20"
-
|
+
|-
-
| Last 10 messages on Farmshare-Discuss mail list (this month)
+
| style="width: 30%;" | __TOC__
-
|-
+
| style="width: 40%;" | '''Recent messages on farmshare-discuss'''
-
| style="width: 30%;" | __TOC__
+
| <rss>http://web.stanford.edu/group/farmshare/wiki/rss/farmshare-discuss.rss</rss>
-
| style="width: 40%;" | <rss>http://stanford.edu/group/farmshare/wiki/rss/farmshare-discuss.rss</rss>
+
  |}
-
|}
+
-
 
+
-
= System Status =
+
-
System is currently fully operational; next maintenance is scheduled for September 21, 2017 from 8am-5pm.
+
-
 
+
-
= How to connect  =
+
-
 
+
-
The machines are available for anyone with a fully sponsored SUNetID (which includes email and AFS space). Simply <code>ssh</code> to login nodes <code>rice.stanford.edu</code or <code>corn.stanford.edu</code> and authenticate with your SUNetID credentials. The DNS names <code>rice</code> and <code>corn</code> actually go to a load balancer and will connect you to a particular machine (e.g. <code>rice05</code>) that has relatively low load. '''Do not connect to farm.stanford.edu.''' While there is such a system, it is not part of the FarmShare service.
+
-
 
+
-
rice SSH fingerprints are:
+
-
256 SHA256:rdOi2irXvc0RXGp0D1/fEo+A4vSLUC7k1ArtQTOD+V4 (Ed25519)
+
-
3072 SHA256:vsNgw9dGLWNWQVpWKtl8WxJpKH7yWQEB1vUq76LF4R8 (RSA)
+
-
 
+
-
corn SSH fingerprint is:
+
-
2048 0b:e7:b4:95:03:c1:1e:07:df:04:ca:a2:3d:8e:e3:37 (RSA)
+
-
 
+
-
The <code>wheat</code>, <code>oat</code>, and <code>barley</code> machines are designed to be used for high performance computing (HPC) and are only accessible via a resource manager (Slurm on FarmShare 2, and Open Grid Engine on the legacy environment). You cannot log in directly, but you can submit jobs from any login node. Storage dedicated for jobs running on the cluster is available via <code>/farmshare/user_data/</code> on all nodes; it is considered scratch storage and is not backed up. Sign up and email the [https://mailman.stanford.edu/mailman/listinfo/farmshare-discuss farmshare-discuss] mailing list if you have any questions or would like any info not listed here.
+
-
 
+
-
= Two-step Authentication =
+
-
 
+
-
Since FarmShare is open to the world, for extra security Stanford two-step authentication is required. You will still need to have a valid Kerberos credential or password in addition to the second factor to authenticate. Once your Kerberos ticket or password is accepted, you will see a second authentication prompt from Duo. It will list device options regarding how to authenticate and you can either choose one, or just enter a passcode generated via the Duo mobile app at the prompt. After a successful second factor authentication you will be greeted with the FarmShare message of the day.
+
-
 
+
-
In order to avoid having to 'Duo' every time you want to open a new session we have a work around for non-Windows users. Add the following lines to your <code>~/.ssh/config</code> file on your local machine (''not'' on FarmShare) to enable <code>ControlMaster</code>, which will create a tunnel on your first login, and will re-use the same tunnel on subsequent connections, thus avoiding Duo after the initial connection. This will only work if you are logging into the same node to which the tunnel was established.
+
-
+
-
Host rice rice?? rice.stanford.edu rice?? rice??.stanford.edu corn corn?? corn.stanford.edu corn??.stanford.edu
+
-
  ControlMaster auto
+
-
  ControlPath ~/.ssh/%r@%h:%p
+
-
  ControlPersist yes
+
-
 
+
-
* [https://web.stanford.edu/group/farmshare/cgi-bin/wiki/index.php/Duo_and_3rd_Party_Clients#SFTP More 3rd Party App information]
+
-
* [[Advanced Connection Options]]
+
-
 
+
-
= SSH Tunnel Sharing on Windows =
+
-
See 'More 3rd Party App Information' link above.
+
-
 
+
-
= How to get help =
+
-
 
+
-
== email support ==
+
-
[[Image:huangsmacc.png|frame]]
+
-
*You can e-mail srcc-support@stanford.edu 
+
-
**If you're e-mailing about a batch job, please mention the job number.
+
-
 
+
-
 
+
-
== SMACC office hours ==
+
-
[[Image:smacctable.jpg|frame]]
+
-
 
+
-
*Office hours are normally at [http://campus-map.stanford.edu/?id=&lat=37.43476699967559&lng=-122.17429865&zoom=15&srch=Huang%20Engineering%20Center Huang] basement in front of ICME door, but are not held during the Summer quarter. They will resume again in Autumn.
+
-
**Have a computational or statistical problem that you need help with? Or maybe you have an account on Farmshare or Proclus, and so now what? You have a boatload of data to make sense of, but how? Wonder where you can do your research project, and who can help you? You know what you want to do – but how best to do it, you just aren’t sure. Help is here in the form of SMACC – Stat, Math, Algorithmic and Computational Consulting!  Technical consultants from ICME, Research Computing, Statistics and IRiSS will be available to work with youin the basement of Huang (in front of ICME). One stop shopping for your scientific computing needs.  Rather than poke around web sites and send mail to multiple groups, drop by to catch all of us at once.
+
-
**Details are at [https://www.stanford.edu/group/su-hpc/cgi-bin/mediawiki/index.php/SMACC SMACC]
+
-
 
+
-
Alternatively, the [https://ssds.stanford.edu/ SSDS] campus group can provide one on one guidance for R, SAS and Stata.  Please [mailto:consult-ssds-software@stanford.edu contact them directly] if you have any questions about using those particular software packages.
+
-
 
+
-
== FAQ ==
+
-
 
+
-
*[[FAQ]]
+
-
*[[FarmShare tutorial]]
+
-
*VNC information: [[FarmVNC]]
+
-
*[[Dotfiles|The official new-user bash/tcsh/zsh setup files]]
+
-
 
+
-
 
+
-
= Hardware Resources =
+
-
 
+
-
== cardinal info  ==
+
-
 
+
-
The "cardinal" machines are small VMs intended for long-running processes (on the order of days) that are not resource intensive, e.g. mail/chat clients. You could log in to a cardinal and run a screen/tmux session there to do things on other machines.
+
-
 
+
-
Simply "ssh cardinal.stanford.edu" with your SUNetID credentials.
+
-
 
+
-
There are currently 3 cardinal machines: cardinal1, cardinal2 and cardinal3, load-balanced via cardinal.stanford.edu.
+
-
 
+
-
Things you can do on cardinal:
+
-
* text based email clients
+
-
* transfer files to and from AFS and your desktop
+
-
* access command line utilities
+
-
 
+
-
== corn info  ==
+
-
 
+
-
The "corn" machines are general-purpose Ubuntu boxes for research and education, and you can run whatever you want on them (so long as you don't negatively impact other users and the work you are doing is directly connected to the university's academic or research mission). Please read the policies and the motd first.
+
-
 
+
-
Simply "ssh corn.stanford.edu" with your SUNetID credentials.
+
-
 
+
-
There are 10 newer corn machines (128G RAM), 20 older corn machines (32G RAM), and 10 oldest corn machines (24G RAM).
+
-
 
+
-
Things you can do on corn:
+
-
* email to stanford addresses only.  for general text based email please use the cardinal
+
-
* access command line utilities
+
-
* access desktop environment via [[FarmVNC|VNC]]
+
-
* access developer toolchains (c/c++/java/python/go/julia/etc)
+
-
* run licensed software (mathematica/stata/matlab/gaussian/sas/etc) as described [[FarmShare_software|here]]
+
-
* submit jobs to the Barley cluster
+
-
* basically anything you would do on a desktop Ubuntu system
+
-
 
+
-
other info:
+
-
*Policies: http://itservices.stanford.edu/service/sharedcomputing/policies
+
-
*IT services page: https://itservices.stanford.edu/service/sharedcomputing
+
-
*Q? E-mail research-computing-support@stanford.edu or file a HelpSU: http://helpsu.stanford.edu/?pcat=farmshare
+
-
*Future vision as of summer 2010: http://itservices.stanford.edu/strategy/sysadmin/timeshare
+
-
 
+
-
== rye info ==
+
-
 
+
-
[[Image:pymolgiffy.gif|frame]]
+
-
 
+
-
The "rye" machines are general purpose Ubuntu (same as corn) but have Nvidia GPU's.
+
-
 
+
-
Things you can do on rye:
+
-
* anything you can do on a corn
+
-
* run CUDA 6.0/OpenCL programs (text based or GUI)
+
-
* run 3D graphics programs such as PyMOL    ------>
+
-
 
+
-
 
+
-
 
+
-
*Detailed [[Rye-GPU|Rye info]]
+
-
 
+
-
 
+
-
 
+
-
 
+
-
== barley info ==
+
-
 
+
-
The "barley" machines are general-purpose newer Ubuntu boxes that can run jobs that you submit via the resource manager software. You should not log in to any barley directly, but can do so to troubleshoot your jobs.
+
-
 
+
-
Things you can do on barley:
+
-
* cpu intensive jobs
+
-
* large memory jobs (up to 192GB)
+
-
* lots of cpu intensive jobs
+
-
* thousands of cpu intensive jobs
+
-
 
+
-
 
+
-
*Detailed [[Barley info]]
+
-
 
+
-
 
+
-
= Examples of using the barley cluster  =
+
-
 
+
-
#Introductory examples:
+
-
##[[FlacLikeABoss|Flac Like a Boss]]
+
-
##[[CheapFlights|Cheap Flights]]
+
-
##[[SFOtoHKGin5min|San Francisco to Hong Kong in 5 minutes]]
+
-
##[[MatCarlo|Monte Carlo Simulations in Matlab]]
+
-
#[[R]]
+
== System Status ==
-
#[[MATLAB]]
+
FarmShare is currently fully operational. The next maintenance period is scheduled for September 21, 2017 from 8am–5pm.
-
#[[MatlabMysql|Access Mysql from Matlab]]
+
-
#[[Abinit|MPI Abinit]]
+
-
#[[Rmpi]]
+
-
#[[Gaussian]]
+
-
#[[Jupyter]] notebook (formerly IPython)
+
-
#[[ANSYS]]
+
-
#[[OpenFOAM]]
+
-
#Gaussview:&nbsp;[[Automated Submission Script Creation & Submission]]
+
-
= FarmShare software  =
+
== Getting Started ==
-
== questions or requests about installed software ==
+
Any user with a [https://uit.stanford.edu/service/accounts/sunetids#eligibility full-service] SUNet ID can access FarmShare.
-
If you have a question or request about the installed software on FarmShare please email us: research-computing-support@stanford.edu .  Also, if you are a course instructor recommending that your students use Farmshare for assignments, any additional open source software requests for your class should be made at least three weeks in advance of the start of the quarter.  Requests should be sent by the instructor to research-computing-support@stanford.edu .  We are not staffed to accommodate students' requests for new versions of software and libraries, nor new tools, during the quarter.  Farmshare users can install their own tools, of course.
+
=== Connecting ===
-
== questions about how to use installed software ==
+
'''Do not connect to farm.stanford.edu.''' While there is such a system, it is ''not'' part of the FarmShare service.
-
If you need help on usage we would suggest:
+
Log into <code>rice.stanford.edu</code>. Authentication is by SUNet ID and password (or GSSAPI), and [https://uit.stanford.edu/service/webauth/twostep two-step] authentication is required.
-
* FarmShare mail list. FarmShare maillist has hundreds of other FarmShare users.  It is quite likely somebody will be able to help.  Please [mailto:farmshare-discuss@lists.stanford.edu e-mail] the [https://mailman.stanford.edu/mailman/listinfo/farmshare-discuss FarmShare user community]
+
  ssh sunetid@rice.stanford.edu
-
*SMACC.  SMACC office hours is an excellent place to start if you would like to discuss or ask a question in-person.  see [[Main_Page#SMACC_office_hours|SMACC]]
+
-
== stock software  ==
+
SSH [https://srcc.stanford.edu/farmshare2/connecting-keys host keys and fingerprints] are available for verification.
-
The FarmShare machines are running Ubuntu 14.04, and the software is from the Ubuntu repositories, e.g. run '''dpkg -l | grep ^i''' to see the list of installed packages.
+
-
*[[R]]
+
For light-duty, interactive work (e.g., e-mail, web browsing and development, file editing, and AFS access or file transfers), log into <code>cardinal.stanford.edu</code>, instead.
-
*[[OpenMPI]]
+
-
*[[AFS]] / [https://itservices.stanford.edu/service/kerberos Kerberos]
+
-
*[[GridEngine]]
+
-
If the package you're looking for isn't installed, search the [http://packages.ubuntu.com/ Ubuntu Packages] page and email us at research-computing-support@stanford.edu .  Also, if you are a course instructor recommending that your students use Farmshare for assignments, any additional open source software requests for your class should be made at least three weeks in advance of the start of the quarter.  Requests should be sent by the instructor to research-computing-support@stanford.edu .  We are not staffed to accommodate students' requests for new versions of software and libraries, nor new tools, on short notice.  We will do our best to accommondate new installations within three weeks of request.  Farmshare users can install their own tools, of course.
+
ssh sunetid@cardinal.stanford.edu
-
== licensed software  ==
+
<code>cardinal</code> systems should ''not'' be used for long-running or compute- and/or memory-intensive work.
-
In addition to Ubuntu packages, the following packages are installed and are available via the "module" command:
+
For more information, see [https://srcc.stanford.edu/farmshare2/connecting Getting Connected] and [[Advanced Connection Options]].
-
See [[FarmShare_software]] for detailed examples.
+
== Support ==
 +
SRCC staff can be reached by e-mail at: [mailto:srcc-support@stanford.edu srcc-support@stanford.edu]. When reporting a problem, please let us know that you're running on FarmShare and report any relevant details, including the full text of any error message you're receiving, and the job ID and contents of your batch script (if applicable).
-
<source lang="sh">
+
=== Course Instructors ===
-
$ module avail
+
-
------------------------------------------------------------------------ /farmshare/software/free/lmod-5.0-install/lmod/lmod/modulefiles/Core ------------------------------------------------------------------------
+
If you are a course instructor using FarmShare for classwork and have any special requests or requirements please contact SRCC at least 30 days before the start of the academic quarter in which the class will be held. We try to accommodate reasonable requests but staff time is limited.
-
  lmod/lmod    settarg/settarg
+
-
------------------------------------------------------------------------------------------- /farmshare/software/mf/trusty --------------------------------------------------------------------------------------------
+
=== Discussion List ===
-
  R/3.1.2                ansys/17.1        (D)    cuda/7.5                  (D)    gurobi/6.5          (D)    matlab/r2014b                relion/1.4                      statamp/12.1
+
-
  R/3.2.1                biopython/1.6.5          cudasamples/6.0                  hisat2/2.0.2                matlab/r2015a                rosetta/3.5                      statamp/13
+
-
  R/3.3.0        (D)    bowtie2/2.2.6            cudnn/6.0                        intel/XE_2013sp1            matlab/r2015b                rstudio/0.98.953                statamp/14        (D)
+
-
  abinit/7.10.4          bowtie2/2.2.7    (D)    cufflinks/2.2.1                  intel/2016          (D)    matlab/r2016a        (D)    sagemath/5.11                    statase/12.1
+
-
  acml/5.3.1            caffe/cpu        (D)    farmvnc/0.3.1                    java/1.8                    meep/1.2.1                  sas/9.4                          statase/13
+
-
  allinea/5.0            caffe/gpu                fiji/fiji                        lemon/1.7.9                meep/1.3              (D)    seaborn/0.7.0            (D)    statase/14        (D)
+
-
  ampl/20120629          celltool/1.5            gams/24.1                        lifelines/0.9.0.0          meta/1.6                    sentaurus/H_2013.03-SP1          stattransfer/12
+
-
  ampl/20150630  (D)    cplex/cplex.log          gams/24.4                        maple/maple2016            openfoam/2.4.0              sentaurus/I-2013.12-SP2          stattransfer/13  (D)
+
-
  amplgurobi            cplex/12.4              gams/24.7                (D)    mathematica/9.0            parallel/20150322            sentaurus/J-2014.09-SP2          tophat/2.1.1
+
-
  ansys/HFSS            cplex/12.6.1      (D)    gaussian/g09D.01gview50  (D)    mathematica/10.0            pyrosetta/release24          sentaurus/K-2015.06-SP2  (D)    torch/7
+
-
  ansys/14.5            cuda/6.0                gaussian/g09gview50              mathematica/10.0.2  (D)    r/3.1.2                      sicstus/4.0.7                    xmipp/3.1
+
-
  ansys/16.0            cuda/6.5                gaussian/g09sse4gview50          matlab/r2013b              r/3.2.1                      spectra/4.4
+
-
  ansys/16.2            cuda/7.0                gurobi/5.6                      matlab/r2014a              r/3.3.0              (D)    sratoolkit/2.4.5
+
-
  Where:
+
Subscribe to the community mailing list, [https://mailman.stanford.edu/mailman/listinfo/farmshare-discuss farmshare-discuss], post questions and concerns to: [mailto:farmshare-discuss@lists.stanford.edu farmshare-discuss@lists.stanford.edu], or browse the [https://mailman.stanford.edu/pipermail/farmshare-discuss/ archives].
-
  (D): Default Module
+
 +
=== Office Hours ===
-
See https://www.stanford.edu/group/farmshare/cgi-bin/wiki/index.php/FarmShare_software for description of how to use modules.
+
SRCC participates in [https://web.stanford.edu/group/su-hpc/cgi-bin/mediawiki/index.php/SMACC SMACC] office hours, held weekly in the basement of [https://campus-map.stanford.edu/?id=04-080&lat=37.42787956&lng=-122.17429865&zoom=17&srch=Huang%20Engineering%20Center Huang Engineering Center], near the [https://icme.stanford.edu ICME] offices.
-
A few commands to get you started:
+
SMACC office hours are not held during the Summer Quarter, but will resume in Autumn.
-
To load latest version of matlab: module load matlab
+
=== SSDS Consulting ===
-
You can load a specific version by: module load matlab/r2012b or module load MATLAB-R2012b
+
-
or to find out more information for a package: module spider matlab
+
The [https://ssds.stanford.edu SSDS] group supports statistical software, including R, Stata, and SAS. They are located in the Velma Denning Room in the Bing Wing of [https://campus-map.stanford.edu/?id=03-200&lat=37.42690686&lng=-122.16759602&zoom=17&srch=Green%20Library Green Library] and hold office hours Monday–Thursday, 2–5 PM, starting in the second week of each quarter and ending the last week of classes.
-
</source>
+
SSDS office hours are not held during the Summer Quarter, but will resume in Autumn.
-
= Monitoring / Status =
+
== Software ==
-
You probably want to try these commands:
+
A variety of useful software, including some popular commercial software, is provided as part of the FarmShare environment. If something is missing, or a particular application, library, or utility needs updating, please let us know. We try to accommodate reasonable requests but staff time is limited.
-
  qstat -g c #cluster slots summary by queue
+
-
  qhost -F mem_free #show available memory on each host
+
-
  qstat -f -u \* #show all jobs in the system
+
-
*Current status of farmshare machines: http://barley-monitor.stanford.edu/ganglia/  
+
More information, see [https://srcc.stanford.edu/farmshare2/software Software].
-
*More detailed graphs: http://barley-monitor.stanford.edu/munin/
+
-
For important announcements, we plan to:
+
=== Packaged Software ===
-
*add it to this wiki
+
FarmShare systems run Ubuntu 16.04 LTS, and most software is sourced from standard repositories.
-
*modify /etc/motd on the corn machines
+
-
*send a mail to farmshare-discuss
+
-
= Mailing Lists  =
+
=== Modules and Licensed Software ===
-
We have mailing lists, @lists.stanford.edu - https://itservices.stanford.edu/service/mailinglists/tools
+
Some software, including all licensed software, is built and/or installed manually and organized using the [http://lmod.readthedocs.io Lmod] environment module system.
-
*[https://mailman.stanford.edu/mailman/listinfo/farmshare-announce farmshare-announce] - announcements list - [https://mailman.stanford.edu/pipermail/farmshare-announce/ Archives]
+
module help
-
*[https://mailman.stanford.edu/mailman/listinfo/farmshare-discuss farmshare-discuss] - user discussion - [https://mailman.stanford.edu/pipermail/farmshare-discuss/ Archives]
+
module avail
 +
module load
-
= Links  =
+
=== User-installed Software ===
-
Want to learn HPC? Free education materials available:  
+
New or updated software can often be built and/or installed by users in their own home directories, and local package managers like [http://linuxbrew.sh Linuxbrew] and [https://spack.io Spack] can help. Local package managers are also available for many programming languages, and some provide tools for managing entire local programming environments (e.g., [https://pip.pypa.io <code>pip</code>], [https://virtualenv.pypa.io <code>virtualenv</code>], and [https://conda.io Conda] for [https://www.python.org Python], local::lib and [https://perlbrew.pl Perlbrew] for [https://www.perl.org Perl], and [https://luarocks.org Luarocks] for [http://www.lua.org Lua].
-
*http://shodor.org/petascale/materials/modules/
+
=== Containers ===
-
*http://hpcuniversity.org/roadmap/
+
-
*https://portal.xsede.org/online-training
+
-
FarmShare has GPUs, but if you need to scale up to a cluster ICME is an excellent resource:
+
[http://singularity.lbl.gov Singularity] containers are supported, but bootstrapping an image requires <code>root</code> access, so you'll need to create your containers elsewhere, and copy them to FarmShare to run.
-
*https://icme.stanford.edu/computer-resources/gpu-cluster
+
== Legacy FarmShare Environment ==
-
Other GPU resources are:
+
'''The legacy environment will eventually be retired.''' FarmShare 2 should be used for all new work.
-
*http://classx.stanford.edu/ClassX/system/users/web/pg/view_subject.php?subject=NVIDIA_ICME_SPRING_2010_2011
+
=== Connecting ===
-
*Engineering / Computer Science computer labs: myth20 through myth32 have nVidia GPU modules for development: http://cs.stanford.edu/computing-guide/overview
+
-
Other similar wikis/clusters on campus (you might not have access to these):
+
Log into <code>corn.stanford.edu</code>. Authentication is by SUNet ID and password (or GSSAPI), and two-step authentication is required.
-
*Engineering / Computer Science computer labs (myth.stanford.edu), open to all fully sponsored SunetIDs: http://cs.stanford.edu/computing-guide/overview/computer-systems/myth
+
  ssh sunetid@corn.stanford.edu
-
*Stanford Research Computing cluster: http://sherlock.stanford.edu
+
-
*Genetics/bionformatics service center cluster: https://www.stanford.edu/group/scgpm/cgi-bin/informatics/wiki/index.php/Main_Page
+
-
*SU-HPC group: https://www.stanford.edu/group/su-hpc/cgi-bin/mediawiki/index.php/Special:Recentchanges
+
-
*Proclus (H&S cluster): https://www.stanford.edu/group/proclus/cgi-bin/mediawiki/index.php/Main_Page
+
-
= Vision =
+
For work requiring access to a GPU, log into <code>rye.stanford.edu</code>, instead.
-
The Farmshare resources are being made available to students, faculty and staff with fully sponsored SunetIDs to facilitate research at Stanford University.&nbsp; This resource is designed so that those doing research will have a place to experiment and learn about technical solutions to assist in reaching their research goals without needing to write a grant for a cluster.&nbsp; The Farmshare resources are focused on making it easier to learn how to parallelize research computing tasks and use research software including a "scheduler"&nbsp;or "distributed resource management system" to submit compute jobs.<br>
+
ssh sunetid@rye.stanford.edu
-
By using Farmshare, new researchers can more easily adapt to using larger clusters when they have big projects that involve using federally funded resources, shared Stanford clusters, or on a small grant funded cluster.<br>
+
More information is available in the [https://itservices.stanford.edu/service/sharedcomputing legacy service documentation].

Revision as of 14:02, 24 August 2017

FarmShare is Stanford’s community computing environment. It is intended for use in coursework and unsponsored research; users participating in sponsored research should investigate the Sherlock service, instead. FarmShare is not approved for use with high-risk data, including protected health information and personally identifiable information.

For a description of the current environment, see FarmShare 2. More information can be found in the service documentation.


Contents

 Recent messages on farmshare-discuss

    System Status

    FarmShare is currently fully operational. The next maintenance period is scheduled for September 21, 2017 from 8am–5pm.

    Getting Started

    Any user with a full-service SUNet ID can access FarmShare.

    Connecting

    Do not connect to farm.stanford.edu. While there is such a system, it is not part of the FarmShare service.

    Log into rice.stanford.edu. Authentication is by SUNet ID and password (or GSSAPI), and two-step authentication is required. 

    ssh sunetid@rice.stanford.edu

    SSH host keys and fingerprints are available for verification.

    For light-duty, interactive work (e.g., e-mail, web browsing and development, file editing, and AFS access or file transfers), log into cardinal.stanford.edu, instead. 

    ssh sunetid@cardinal.stanford.edu

    cardinal systems should not be used for long-running or compute- and/or memory-intensive work.

    For more information, see Getting Connected and Advanced Connection Options.

    Support

    SRCC staff can be reached by e-mail at: srcc-support@stanford.edu. When reporting a problem, please let us know that you're running on FarmShare and report any relevant details, including the full text of any error message you're receiving, and the job ID and contents of your batch script (if applicable).

    Course Instructors

    If you are a course instructor using FarmShare for classwork and have any special requests or requirements please contact SRCC at least 30 days before the start of the academic quarter in which the class will be held. We try to accommodate reasonable requests but staff time is limited.

    Discussion List

    Subscribe to the community mailing list, farmshare-discuss, post questions and concerns to: farmshare-discuss@lists.stanford.edu, or browse the archives.

    Office Hours

    SRCC participates in SMACC office hours, held weekly in the basement of Huang Engineering Center, near the ICME offices.

    SMACC office hours are not held during the Summer Quarter, but will resume in Autumn.

    SSDS Consulting

    The SSDS group supports statistical software, including R, Stata, and SAS. They are located in the Velma Denning Room in the Bing Wing of Green Library and hold office hours Monday–Thursday, 2–5 PM, starting in the second week of each quarter and ending the last week of classes.

    SSDS office hours are not held during the Summer Quarter, but will resume in Autumn.

    Software

    A variety of useful software, including some popular commercial software, is provided as part of the FarmShare environment. If something is missing, or a particular application, library, or utility needs updating, please let us know. We try to accommodate reasonable requests but staff time is limited.

    More information, see Software.

    Packaged Software

    FarmShare systems run Ubuntu 16.04 LTS, and most software is sourced from standard repositories.

    Modules and Licensed Software

    Some software, including all licensed software, is built and/or installed manually and organized using the Lmod environment module system. 

    module help
module avail
module load

    User-installed Software

    New or updated software can often be built and/or installed by users in their own home directories, and local package managers like Linuxbrew and Spack can help. Local package managers are also available for many programming languages, and some provide tools for managing entire local programming environments (e.g., pip, virtualenv, and Conda for Python, local::lib and Perlbrew for Perl, and Luarocks for Lua.

    Containers

    Singularity containers are supported, but bootstrapping an image requires root access, so you'll need to create your containers elsewhere, and copy them to FarmShare to run.

    Legacy FarmShare Environment

    The legacy environment will eventually be retired. FarmShare 2 should be used for all new work.

    Connecting

    Log into corn.stanford.edu. Authentication is by SUNet ID and password (or GSSAPI), and two-step authentication is required. 

    ssh sunetid@corn.stanford.edu

    For work requiring access to a GPU, log into rye.stanford.edu, instead. 

    ssh sunetid@rye.stanford.edu

    More information is available in the legacy service documentation.

    Retrieved from "https://web.stanford.edu/group/farmshare/cgi-bin/wiki/index.php/Main_Page"
    Personal tools
    Toolbox
    LANGUAGES