Main Page

From FarmShare

(Difference between revisions)
Jump to: navigation, search
(System Status)
(196 intermediate revisions not shown)
Line 1: Line 1:
-
<seo metadescription="FarmShare shared computing and HPC resource for Stanford faculty, staff, and students, provided at no cost" metakeywords="farmshare, hpc, free, linux, ubuntu, cluster, matlab, R, MPI, SGE, grid engine, barley, corn, cardinal, timeshares, shared computing"/>
+
FarmShare is Stanford’s community computing environment. It is primarily intended for use in coursework and unsponsored research (note that some software tools, like ANSYS, are only licensed for use on Farmshare for academic course use, not research); users participating in sponsored or departmental research should investigate the [https://sherlock.stanford.edu Sherlock] service or other, local alternatives, instead. FarmShare is ''not'' approved for use with [https://dataclass.stanford.edu high-risk] data, including protected health information and personally identifiable information, and is subject to University [[Policy | policies]] on acceptable use.
-
 
+
-
== FarmShare ==
+
-
 
+
-
This wiki is intended for the users of FarmShare, the Stanford shared research computing environment: the "'''cardinal'''",  "'''corn'''", and "'''barley'''" machines. For a general description of this service, and Stanford's shared computing policies, see the main [https://itservices.stanford.edu/service/sharedcomputing service catalog page].  
+
-
 
+
-
 
+
-
 
+
-
'''Most useful pages: [[Special:AllPages]] and [[Special:RecentChanges]] and [[User Guide]] and [[FAQ]] and [[FarmShare tutorial]]'''
+
-
 
+
-
 
+
-
 
+
 +
For a description of the current environment, see [[FarmShare 2]]. More information can be found in the [https://srcc.stanford.edu/farmshare2 service documentation].
 +
__NOTOC__
{| width="100%" cellpadding="20"
{| width="100%" cellpadding="20"
-
|
+
|-
-
| Last 10 messages on Farmshare-Discuss mail list (this month)
+
| style="width: 30%;" | __TOC__
-
|-
+
| style="width: 70%;" | <h3>Recent Messages on [https://mailman.stanford.edu/mailman/listinfo/farmshare-discuss/ farmshare-discuss]</h3><rss>http://web.stanford.edu/group/farmshare/wiki/rss/farmshare-discuss.rss</rss>
-
| style="width: 30%;" | __TOC__
+
|}
-
| style="width: 40%;" | <rss>http://stanford.edu/group/farmshare/wiki/rss/farmshare-discuss.rss</rss>
+
-
|}
+
-
== FarmShare is in a rolling upgrade to Ubuntu 13.04 ==
+
== System Status ==
 +
FarmShare is operational.
-
Details and status can be found here: [[Ubuntu13TransitionGuide]]
+
== Getting Started ==
 +
Any person with a [https://uit.stanford.edu/service/accounts/sunetids#eligibility full-service] SUNet ID can access FarmShare.
 +
=== Connecting ===
 +
'''Do not connect to <code>farm.stanford.edu</code>.''' While there is such a system, it is ''not'' part of the FarmShare service.
-
= How to connect  =
+
Log into <code>rice.stanford.edu</code>. Authentication is by SUNet ID and password (or GSSAPI), and [https://uit.stanford.edu/service/webauth/twostep two-step] authentication is required.
-
The machines are available for anyone with a SUNetID. Simply "ssh corn.stanford.edu" with your SUNetID credentials. The DNS name "corn.stanford.edu" actually goes to a load balancer and it will connect you to a particular corn machine (e.g. corn21) that has relatively low load.
+
<source lang="sh">ssh sunetid@rice.stanford.edu</source>
-
The "barley" machines are designed to be used for high performance computing (HPC) and only accessible via a resource manager (currently Open Grid Scheduler). You cannot log in directly, but you can submit jobs from any corn. Storage dedicated for jobs running on the barley cluster is available via /farmshare/user_data/ on all corn and barley nodes. Sign up and email the farmshare-discuss mailing list if you have any questions or would like any info not listed here.  
+
SSH [https://srcc.stanford.edu/farmshare2/connecting-keys host keys and fingerprints] are available for verification.
-
corn SSH fingerprint is:
+
For light-duty, interactive work (e.g., e-mail, web browsing and development, file editing, and AFS access or file transfers), log into <code>cardinal.stanford.edu</code>, instead.
-
  RSA key fingerprint is 0b:e7:b4:95:03:c1:1e:07:df:04:ca:a2:3d:8e:e3:37.
+
-
= How to get help =
+
<source lang="sh">ssh sunetid@cardinal.stanford.edu</source>
-
== email support ==
+
<code>cardinal</code> systems should ''not'' be used for long-running or compute- and/or memory-intensive work.
-
[[Image:huangsmacc.png|frame]]
+
-
*You can e-mail research-computing-support@stanford.edu 
+
-
**If you're e-mailing about a barley job, please mention that it's on barley and the job number.
+
 +
For more information, see [https://srcc.stanford.edu/farmshare2/connecting Getting Connected] and [[Advanced Connection Options]].
-
== SMACC office hours ==
+
=== User Guide ===
-
[[Image:smacctable.jpg|frame]]
+
-
*You can come to office hours.  Every Wednesday from 1-3PM in [http://campus-map.stanford.edu/?id=&lat=37.43476699967559&lng=-122.17429865&zoom=15&srch=Huang%20Engineering%20Center Huang] basement in front of ICME door:
+
The [[User Guide]] has information regarding storage, file-transfer, and cluster configuration. See the [[FAQ]] for common issues, and tips and tricks.
-
**Have a computational or statistical problem that you need help with? Or maybe you have an account on Farmshare or Proclus, and so now what? You have a boatload of data to make sense of, but how? Wonder where you can do your research project, and who can help you? You know what you want to do – but how best to do it, you just aren’t sure. Help is here in the form of SMACC – Stat, Math, Algorithmic and Computational Consulting!  Technical consultants from ICME, Research Computing, Statistics and IRiSS will be available to work with you each Wednesday, from 1-3 pm, in the basement of Huang (in front of ICME). One stop shopping for your scientific computing needs.  Rather than poke around web sites and send mail to multiple groups, drop by to catch all of us at once.
+
-
**Details are at [https://www.stanford.edu/group/su-hpc/cgi-bin/mediawiki/index.php/SMACC SMACC]
+
 +
== Support ==
-
== Hardware Resources ==
+
SRCC staff can be reached by e-mail at: [mailto:srcc-support@stanford.edu srcc-support@stanford.edu]. When reporting a problem, please let us know that you're running on FarmShare and report any relevant details, including the full text of any error message you're receiving, and the job ID and contents of your batch script (if applicable).
-
= cardinal info  =
+
=== Course Instructors ===
-
The "cardinal" machines are small VMs intended for long-running processes (on the order of days) that are not resource intensive, e.g. mail/chat clients. You could log in to a cardinal and run a screen/tmux session there to do things on other machines.  
+
If you are a course instructor using FarmShare for classwork and have any special requests or requirements please contact SRCC at least 30 days before the start of the academic quarter in which the class will be held. We try to accommodate reasonable requests but staff time is limited.
-
Simply "ssh cardinal.stanford.edu" with your SUNetID credentials.
+
=== Discussion List ===
-
There are currently 3 cardinal machines: cardinal1, cardinal2 and cardinal3, load-balanced via cardinal.stanford.edu.  
+
Subscribe to the community discussion list, [https://mailman.stanford.edu/mailman/listinfo/farmshare-discuss farmshare-discuss], post questions and concerns to: [mailto:farmshare-discuss@lists.stanford.edu farmshare-discuss@lists.stanford.edu], or browse the [https://mailman.stanford.edu/pipermail/farmshare-discuss/ archives].
-
= corn info  =
+
=== Office Hours ===
-
The "corn" machines are general-purpose Ubuntu boxes and you can run whatever you want on them (so long as you don't negatively impact other users). Please read the policies and the motd first.  
+
<span style="color: red">In accordance with guidance from the University regarding COVID-19, SMACC office hours have been suspended until further notice.</span> If you need assistance with FarmShare please contact us at srcc-support@stanford.edu.
-
*Policies: http://itservices.stanford.edu/service/sharedcomputing/policies
+
SRCC participates in [https://web.stanford.edu/group/su-hpc/cgi-bin/mediawiki/index.php/SMACC SMACC] (C2) office hours, held weekly in the basement of [https://campus-map.stanford.edu/?id=04-080&lat=37.42787956&lng=-122.17429865&zoom=17&srch=Huang%20Engineering%20Center Huang Engineering Center], near the [https://icme.stanford.edu ICME] offices.
-
*IT services page: https://itservices.stanford.edu/service/sharedcomputing
+
-
*VNC help: https://itservices.stanford.edu/service/sharedcomputing/vnc
+
-
*Q? E-mail research-computing-support@stanford.edu or file a HelpSU: http://helpsu.stanford.edu/?pcat=farmshare
+
-
*Future vision as of summer 2010: http://itservices.stanford.edu/strategy/sysadmin/timeshare
+
-
Each of the 30 corn machines has 8 cores, 32GB RAM and ~70GB of local disk in /tmp.
+
SMACC office hours are not held during the Summer Quarter, or during inter-quarter periods.
-
= rye info =
+
=== SSDS Consulting ===
-
The "rye" machines are general purpose Ubuntu (same as corn) but have 8 Nvidia GPU's each.
+
The [https://ssds.stanford.edu SSDS] group supports statistical software, including R, Stata, and SAS. They are located in the Velma Denning Room in the Bing Wing of [https://campus-map.stanford.edu/?id=03-200&lat=37.42690686&lng=-122.16759602&zoom=17&srch=Green%20Library Green Library] and hold office hours Monday–Thursday, 2–5 PM, starting in the second week of each quarter and ending the last week of classes. SRCC staff are present on the third Tuesday of each month, from 2–4 PM. SSDS office hours are not held during the Summer Quarter.
-
*Detailed [[Rye-GPU|Rye info]]
+
== Software  ==
-
= barley info  =
+
A variety of useful [[Software | software]], including some popular commercial software, is provided as part of the FarmShare environment. If something is missing, or a particular application, library, or utility needs updating, please let us know. We try to accommodate reasonable requests but staff time is limited.
-
The "barley" machines are general-purpose newer Ubuntu boxes that can run jobs that you submit via the resource manager software. You should not log in to any barley directly, but can do so to troubleshoot your jobs.
+
For more information, see [https://srcc.stanford.edu/farmshare2/software Software].
-
*Detailed [[Barley info]]
+
=== Packaged Software ===
 +
FarmShare systems run Ubuntu 16.04 LTS, and most software is sourced from standard repositories.
-
= Examples of using the barley cluster  =
+
=== Modules and Licensed Software ===
-
 
+
-
#Introductory examples:
+
-
##[[FlacLikeABoss|Flac Like a Boss]]
+
-
##[[CheapFlights|Cheap Flights]]
+
-
##[[SFOtoHKGin5min|San Francisco to Hong Kong in 5 minutes]]
+
-
##[[MatCarlo|Monte Carlo Simulations in Matlab]]
+
-
 
+
-
#[[R]]
+
-
#[[MATLAB]]
+
-
#[[MatlabMysql|Access Mysql from Matlab]]
+
-
#[[Rmpi]]
+
-
#[[Gaussian]]
+
-
#[[Ipython]]
+
-
#[[ANSYS]]
+
-
 
+
-
#Gaussview:&nbsp;[[Automated Submission Script Creation & Submission]]
+
-
 
+
-
== FarmShare software  ==
+
-
 
+
-
=== questions or requests about installed software ===
+
-
 
+
-
If you have a question or request about the installed software on FarmShare please email us: research-computing-support@stanford.edu
+
-
 
+
-
=== questions about how to use installed software ===
+
-
 
+
-
If you need help on usage we would suggest:
+
-
 
+
-
* FarmShare mail list.  FarmShare maillist has hundreds of other FarmShare users.  It is quite likely somebody will be able to help.  Please [mailto:farmshare-discuss@lists.stanford.edu e-mail] the [https://mailman.stanford.edu/mailman/listinfo/farmshare-discuss FarmShare user community]
+
-
*SMACC.  SMACC office hours is an excellent place to start if you would like to discuss or ask a question in-person.  see [[Main_Page#SMACC_office_hours|SMACC]]
+
-
 
+
-
== stock software  ==
+
-
The FarmShare machines are running Ubuntu 13.04, and the software is from the Ubuntu repositories, e.g. run '''dpkg -l | grep ^i''' to see the list of installed packages.
+
-
 
+
-
*[[R]]
+
-
*[[OpenMPI]]
+
-
*[[AFS]] / [https://itservices.stanford.edu/service/kerberos Kerberos]
+
-
*[[GridEngine]]
+
-
 
+
-
If the package you're looking for isn't installed, search the [http://packages.ubuntu.com/ Ubuntu Packages] page and submit a [http://helpsu.stanford.edu/?pcat=farmshare HelpSU] with the package name(s) you want.
+
-
 
+
-
== licensed software  ==
+
-
 
+
-
In addition to Ubuntu packages, the following packages are installed and are available via the "module" command:
+
-
 
+
-
See [[FarmShare_software]] for detailed examples.
+
 +
Some software, including all licensed software, is built and/or installed manually and organized using the [https://lmod.readthedocs.io Lmod] environment module system.
<source lang="sh">
<source lang="sh">
-
$ module avail
+
module help
-
 
+
module avail
-
--------------------- /farmshare/software/free/lmod-5.0-install/lmod/lmod/modulefiles/Core ----------------------
+
module load
-
  lmod/lmod    settarg/settarg
+
-
 
+
-
----------------------------------------- /farmshare/software/mf/raring -----------------------------------------
+
-
  cplex/12.4    gaussian/g09gview50    matlab/r2013a  (D)    statase/12.1
+
-
  cuda/5.5      mathematica/9.0        sas/9.2                stattransfer/12
+
-
  gams/24.1    matlab/r2012b          statamp/12.1
+
-
 
+
-
------------------------------------- /farmshare/software/mf/raring-compat --------------------------------------
+
-
  CPLEX-12.4    MATLAB-R2012b    Mathematica-9.0    StatTransfer-v12    StataSE-12.1
+
-
  GAMS-24.1    MATLAB-R2013a    SAS-v9.2          StataMP-12.1
+
-
 
+
-
  Where:
+
-
  (D):  Default Module
+
-
 
+
-
See https://www.stanford.edu/group/farmshare/cgi-bin/wiki/index.php/FarmShare_software for description of how to
+
-
use modules.
+
-
 
+
-
To load latest version of matlab: module load matlab
+
-
You can load a specific version by: module load matlab/r2012b or module load MATLAB-R2012b
+
-
 
+
-
or to find out more information for a package: module spider matlab
+
-
 
+
</source>
</source>
-
= Monitoring / Status  =
+
'''Please note''' that commercial software is licensed for use on FarmShare ''only'' in coursework, and ''not'' for research.
-
 
+
-
You probably want to try these commands:
+
-
  qstat -g c #cluster slots summary by queue
+
-
  qhost -F mem_free #show available memory on each host
+
-
  qstat -f -u \* #show all jobs in the system
+
-
 
+
-
*Current status of farmshare machines: http://barley-monitor.stanford.edu/ganglia/
+
-
*More detailed graphs: http://barley-monitor.stanford.edu/munin/
+
-
 
+
-
For important announcements, we plan to:
+
-
 
+
-
*add it to this wiki
+
-
*modify /etc/motd on the corn machines
+
-
*send a mail to farmshare-discuss
+
-
 
+
-
= Mailing Lists  =
+
-
 
+
-
We have mailing lists, @lists.stanford.edu - https://itservices.stanford.edu/service/mailinglists/tools
+
-
 
+
-
*[https://mailman.stanford.edu/mailman/listinfo/farmshare-announce farmshare-announce] - announcements list - [https://mailman.stanford.edu/pipermail/farmshare-announce/ Archives]
+
-
*[https://mailman.stanford.edu/mailman/listinfo/farmshare-discuss farmshare-discuss] - user discussion - [https://mailman.stanford.edu/pipermail/farmshare-discuss/ Archives]
+
-
 
+
-
= Links  =
+
-
 
+
-
Want to learn HPC? Free education materials available:
+
-
 
+
-
*http://shodor.org/petascale/materials/modules/
+
-
*http://hpcuniversity.org/roadmap/
+
-
 
+
-
 
+
-
GPUs! We don't have any GPUs as part of FarmShare, but there are other campus resources available:
+
-
 
+
-
*http://icme.stanford.edu/Computer%20Resources/gpu.php
+
-
*http://classx.stanford.edu/ClassX/system/users/web/pg/view_subject.php?subject=NVIDIA_ICME_SPRING_2010_2011
+
-
*Engineering / Computer Science computer labs: myth20 through myth32 have nVidia GPU modules for development: http://cs.stanford.edu/computing-guide/overview/computer-systems/myth
+
-
 
+
-
 
+
-
Other similar wikis/clusters on campus (you might not have access to these):
+
-
*Engineering / Computer Science computer labs (myth.stanford.edu), open to all fully sponsored SunetIDs: http://cs.stanford.edu/computing-guide/overview/computer-systems/myth
+
=== User-installed Software ===
-
*Statistics cluster: https://www.stanford.edu/dept/statistics/cgi-bin/projects/stat-sysadminwiki/index.php/Cluster_Help
+
-
*Genetics cluster: https://www.stanford.edu/group/scgpm/cgi-bin/informatics/wiki/index.php/Main_Page
+
-
*SU-HPC group: https://www.stanford.edu/group/su-hpc/cgi-bin/mediawiki/index.php/Special:Recentchanges
+
-
*HPCC wiki: https://www.stanford.edu/group/hpcc/cgi-bin/mediawiki/index.php/Main_Page
+
-
*Proclus (H&S cluster): https://www.stanford.edu/group/proclus/cgi-bin/mediawiki/index.php/Main_Page
+
-
= Vision =
+
New or updated software can often be built and/or installed by users in their own home directories, and local package managers like [http://linuxbrew.sh Linuxbrew] and [https://spack.io Spack] can help. Local package managers are also available for many programming languages (e.g., [https://pip.pypa.io <code>pip</code>], [https://virtualenv.pypa.io <code>virtualenv</code>], and [https://conda.io Conda] for [https://www.python.org Python], <code>local::lib</code> and [https://perlbrew.pl Perlbrew] for [https://www.perl.org Perl], and [https://luarocks.org Luarocks] for [https://www.lua.org Lua]), and some of these provide tools for managing entire local programming environments.
-
The Farmshare resources are being made available to students, faculty and staff with fully sponsored SunetIDs to facilitate research at Stanford University.&nbsp; This resource is designed so that those doing research will have a place to experiment and learn about technical solutions to assist in reaching their research goals without needing to write a grant for a cluster.&nbsp; The Farmshare resources are focused on making it easier to learn how to parallelize research computing tasks and use research software including a "scheduler"&nbsp;or "distributed resource management system" to submit compute jobs.<br>
+
=== Containers ===
-
By using Farmshare, new researchers can more easily adapt to using larger clusters when they have big projects that involve using federally funded resources, shared Stanford clusters, or on a small grant funded cluster.<br>
+
[http://singularity.lbl.gov Singularity] containers are supported, but bootstrapping an image requires <code>root</code> access, so you'll need to create your containers elsewhere and copy them to FarmShare to run.

Revision as of 16:49, 15 July 2020

FarmShare is Stanford’s community computing environment. It is primarily intended for use in coursework and unsponsored research (note that some software tools, like ANSYS, are only licensed for use on Farmshare for academic course use, not research); users participating in sponsored or departmental research should investigate the Sherlock service or other, local alternatives, instead. FarmShare is not approved for use with high-risk data, including protected health information and personally identifiable information, and is subject to University policies on acceptable use.

For a description of the current environment, see FarmShare 2. More information can be found in the service documentation.


Contents

Recent Messages on farmshare-discuss

    System Status

    FarmShare is operational.

    Getting Started

    Any person with a full-service SUNet ID can access FarmShare.

    Connecting

    Do not connect to farm.stanford.edu. While there is such a system, it is not part of the FarmShare service.

    Log into rice.stanford.edu. Authentication is by SUNet ID and password (or GSSAPI), and two-step authentication is required.

    ssh sunetid@rice.stanford.edu
    

    SSH host keys and fingerprints are available for verification.

    For light-duty, interactive work (e.g., e-mail, web browsing and development, file editing, and AFS access or file transfers), log into cardinal.stanford.edu, instead.

    ssh sunetid@cardinal.stanford.edu
    

    cardinal systems should not be used for long-running or compute- and/or memory-intensive work.

    For more information, see Getting Connected and Advanced Connection Options.

    User Guide

    The User Guide has information regarding storage, file-transfer, and cluster configuration. See the FAQ for common issues, and tips and tricks.

    Support

    SRCC staff can be reached by e-mail at: srcc-support@stanford.edu. When reporting a problem, please let us know that you're running on FarmShare and report any relevant details, including the full text of any error message you're receiving, and the job ID and contents of your batch script (if applicable).

    Course Instructors

    If you are a course instructor using FarmShare for classwork and have any special requests or requirements please contact SRCC at least 30 days before the start of the academic quarter in which the class will be held. We try to accommodate reasonable requests but staff time is limited.

    Discussion List

    Subscribe to the community discussion list, farmshare-discuss, post questions and concerns to: farmshare-discuss@lists.stanford.edu, or browse the archives.

    Office Hours

    In accordance with guidance from the University regarding COVID-19, SMACC office hours have been suspended until further notice. If you need assistance with FarmShare please contact us at srcc-support@stanford.edu.

    SRCC participates in SMACC (C2) office hours, held weekly in the basement of Huang Engineering Center, near the ICME offices.

    SMACC office hours are not held during the Summer Quarter, or during inter-quarter periods.

    SSDS Consulting

    The SSDS group supports statistical software, including R, Stata, and SAS. They are located in the Velma Denning Room in the Bing Wing of Green Library and hold office hours Monday–Thursday, 2–5 PM, starting in the second week of each quarter and ending the last week of classes. SRCC staff are present on the third Tuesday of each month, from 2–4 PM. SSDS office hours are not held during the Summer Quarter.

    Software

    A variety of useful software, including some popular commercial software, is provided as part of the FarmShare environment. If something is missing, or a particular application, library, or utility needs updating, please let us know. We try to accommodate reasonable requests but staff time is limited.

    For more information, see Software.

    Packaged Software

    FarmShare systems run Ubuntu 16.04 LTS, and most software is sourced from standard repositories.

    Modules and Licensed Software

    Some software, including all licensed software, is built and/or installed manually and organized using the Lmod environment module system.

    module help
    module avail
    module load
    

    Please note that commercial software is licensed for use on FarmShare only in coursework, and not for research.

    User-installed Software

    New or updated software can often be built and/or installed by users in their own home directories, and local package managers like Linuxbrew and Spack can help. Local package managers are also available for many programming languages (e.g., pip, virtualenv, and Conda for Python, local::lib and Perlbrew for Perl, and Luarocks for Lua), and some of these provide tools for managing entire local programming environments.

    Containers

    Singularity containers are supported, but bootstrapping an image requires root access, so you'll need to create your containers elsewhere and copy them to FarmShare to run.

    Personal tools
    Toolbox
    LANGUAGES