Main Page

From FarmShare

(Difference between revisions)
Jump to: navigation, search
(cardinal info)
(System Status)
(322 intermediate revisions not shown)
Line 1: Line 1:
-
<pre>+-+-+-+-+-+-+-+-+-+
+
FarmShare is Stanford’s community computing environment. It is primarily intended for use in coursework and unsponsored research (note that some software tools, like ANSYS, are only licensed for use on Farmshare for academic course use, not research); users participating in sponsored or departmental research should investigate the [https://sherlock.stanford.edu Sherlock] service or other, local alternatives, instead. FarmShare is ''not'' approved for use with [https://dataclass.stanford.edu high-risk] data, including protected health information and personally identifiable information, and is subject to University [[Policy | policies]] on acceptable use.
-
|F|a|r|m|S|h|a|r|e|
+
-
+-+-+-+-+-+-+-+-+-+
+
-
</pre>
+
-
This wiki is intended for the users of FarmShare, the Stanford shared research computing environment: the "cardinal" and "corn" and "barley" machines.  
+
-
Most useful pages: [[Special:AllPages]] and [[Special:RecentChanges]]  
+
For a description of the current environment, see [[FarmShare 2]]. More information can be found in the [https://srcc.stanford.edu/farmshare2 service documentation].
-
= How to connect =
+
__NOTOC__
 +
{| width="100%" cellpadding="20"
 +
  |-
 +
| style="width: 30%;" | __TOC__
 +
| style="width: 70%;" | <h3>Recent Messages on [https://mailman.stanford.edu/mailman/listinfo/farmshare-discuss/ farmshare-discuss]</h3><rss>http://web.stanford.edu/group/farmshare/wiki/rss/farmshare-discuss.rss</rss>
 +
|}
-
The machines are available for anyone with a SUNetID. Simply "ssh corn.stanford.edu" with your SUNetID credentials. The DNS name "corn.stanford.edu" actually goes to a load balancer and it will connect you to a particular corn machine (e.g. corn21) that has relatively low load.  
+
== System Status ==
 +
Major FarmShare maintenance is scheduled for 8:00 a.m. Wednesday, December 9–5:00 p.m. Tuesday, December 15.
-
The "barley" machines are only accessible via a resource manager (currently Open Grid Engine). You can submit jobs from any corn.&nbsp; Storage dedicated for jobs running on the barley cluster is available via /mnt/glusterfs on all corn and barley nodes.&nbsp; Login to corn-image-new.stanford.edu and a directory will be created for you as /mnt/glusterfs/&lt;your user name&gt; (can take up to 5 minutes).&nbsp; Sign up and email the farmshare-discuss mailing list if you have any questions or would like any info not listed here.  
+
Please note that planned work will require an unusually extended downtime, during which we will be performing deferred hardware maintenance and physically moving FarmShare systems to a new location. All systems will be inaccessible during the maintenance period; please make sure you have completed and saved results from any running jobs, refrain from starting any long-running jobs that might not finish, and log out before the beginning of the maintenance window.
-
= cardinal info  =
+
We understand that the long maintenance period may inconvenience some users and ask for your patience while we complete this necessary work.
-
The "cardinal" machines are small VMs intended for long-running processes (on the order of days) that are not resource intensive, e.g. mail/chat clients. You could log in to a cardinal and run a screen/tmux session there to do things on other machines...
+
== Getting Started ==
-
There are currently 3 cardinal machines: cardinal1, cardinal2 and cardinal3, load-balanced via cardinal.stanford.edu.
+
Any person with a [https://uit.stanford.edu/service/accounts/sunetids#eligibility full-service] SUNet ID can access FarmShare.
-
= corn info  =
+
=== Connecting ===
-
The "corn" machines are general-purpose Ubuntu boxes and you can run whatever you want on them (so long as you don't negatively impact other users). Please read the policies and the motd first.  
+
'''Do not connect to <code>farm.stanford.edu</code>.''' While there is such a system, it is ''not'' part of the FarmShare service.
-
*Policies: http://lelandpolicy.stanford.edu  
+
Log into <code>rice.stanford.edu</code>. Authentication is by SUNet ID and password (or GSSAPI), and [https://uit.stanford.edu/service/webauth/twostep two-step] authentication is required.
-
*IT services page: https://itservices.stanford.edu/service/unixcomputing
+
-
*VNC help: https://itservices.stanford.edu/service/unixcomputing/unix/vnc
+
-
*Q? File HelpSU: http://helpsu.stanford.edu/
+
-
*Future vision as of summer 2010: http://itservices.stanford.edu/strategy/sysadmin/timeshare
+
-
Each of the 30 corn machines has 8 cores, 32GB RAM and ~70GB of local disk in /tmp.  
+
<source lang="sh">ssh sunetid@rice.stanford.edu</source>
-
= barley info  =
+
SSH [https://srcc.stanford.edu/farmshare2/connecting-keys host keys and fingerprints] are available for verification.
-
The "barley" machines are general-purpose newer Ubuntu boxes that can run jobs that you submit via the resource manager software.  
+
For light-duty, interactive work (e.g., e-mail, web browsing and development, file editing, and AFS access or file transfers), log into <code>cardinal.stanford.edu</code>, instead.
-
=== current barley policies  ===
+
<source lang="sh">ssh sunetid@cardinal.stanford.edu</source>
-
*3000 max jobs per user (look for max_ujobs in output of 'qconf -sconf')
+
<code>cardinal</code> systems should ''not'' be used for long-running or compute- and/or memory-intensive work.
-
*3000 max jobs in the system (look for max_jobs in output of 'qconf -sconf')
+
-
*48hr max runtime for any job in regular queue (look for h_rt in output of 'qconf -sq main.q')
+
-
*one week max runtime for the long queue (look for h_rt in output of 'qconf -sq long.q')
+
-
*no memory/CPU limits yet
+
-
=== Technical details  ===
+
For more information, see [https://srcc.stanford.edu/farmshare2/connecting Getting Connected] and [[Advanced Connection Options]].
-
*19 new machines, 24 cores each, 96GB RAM
+
=== User Guide ===
-
*1 new machine, 24 cores, 192GB RAM
+
-
*~450GB local scratch on each
+
-
*~3TB in /mnt/glusterfs
+
-
*Grid Engine v6.2u5 (via standard Debian package)
+
-
*10GbE interconnect (Juniper QFX3500 switch)
+
-
=== how to use the barley machines  ===
+
The [[User Guide]] has information regarding storage, file-transfer, and cluster configuration. See the [[FAQ]] for common issues, and tips and tricks.
-
To start using these new machines, you can check out the man page for 'sge_intro' or the 'qhost', 'qstat', 'qsub' and 'qdel' commands.
+
== Support ==
-
Initial issues:  
+
SRCC staff can be reached by e-mail at: [mailto:srcc-support@stanford.edu srcc-support@stanford.edu]. When reporting a problem, please let us know that you're running on FarmShare and report any relevant details, including the full text of any error message you're receiving, and the job ID and contents of your batch script (if applicable).
-
*You are limited in space to your AFS homedir ($HOME) and local scratch disk on each node ($TMPDIR)
+
=== Course Instructors ===
-
*The execution hosts don't accept interactive jobs, only batch jobs for now.
+
-
*You'll want to make sure you have your Kerberos TGT and your [[AFS]] token.
+
-
If you want to use the newer bigger storage:
+
If you are a course instructor using FarmShare for classwork and have any special requests or requirements please contact SRCC at least 30 days before the start of the academic quarter in which the class will be held. We try to accommodate reasonable requests but staff time is limited.
-
#log into corn-image-new: "ssh sunetid@corn-image-new.stanford.edu"
+
=== Discussion List ===
-
#cd to /mnt/glusterfs/&lt;your username&gt; (or wait 5mins if it doesn't exist yet)
+
-
#write a job script: "$EDITOR test_job.script"
+
-
##see 'man qsub' for more info
+
-
##use env var $TMPDIR for local scratch
+
-
##use /mnt/glusterfs/&lt;your username&gt; for shared data directory
+
-
#submit the job for processing: "qsub -cwd test_job.script"
+
-
#monitor the jobs with "qstat -f -j JOBID"
+
-
##see 'man qstat' for more info
+
-
#check the output files that you specified in your job script (the input and output files must be in /mnt/glusterfs/)
+
-
Any questions, please email 'farmshare-discuss@lists.stanford.edu'
+
Subscribe to the community discussion list, [https://mailman.stanford.edu/mailman/listinfo/farmshare-discuss farmshare-discuss], post questions and concerns to: [mailto:farmshare-discuss@lists.stanford.edu farmshare-discuss@lists.stanford.edu], or browse the [https://mailman.stanford.edu/pipermail/farmshare-discuss/ archives].
-
We plan to roll out to the full Stanford community on Jan 20.
+
=== Office Hours ===
-
=== Examples of using the barley cluster  ===
+
<span style="color: red">In accordance with guidance from the University regarding COVID-19, SMACC office hours have been suspended until further notice.</span> If you need assistance with FarmShare please contact us at srcc-support@stanford.edu.
-
#. [[ERM|Examples Ready to Make]]
+
SRCC participates in [https://web.stanford.edu/group/su-hpc/cgi-bin/mediawiki/index.php/SMACC SMACC] (C2) office hours, held weekly in the basement of [https://campus-map.stanford.edu/?id=04-080&lat=37.42787956&lng=-122.17429865&zoom=17&srch=Huang%20Engineering%20Center Huang Engineering Center], near the [https://icme.stanford.edu ICME] offices.
 +
SMACC office hours are not held during the Summer Quarter, or during inter-quarter periods.
-
== barley software  ==
+
=== SSDS Consulting ===
-
=== stock software  ===
+
The [https://ssds.stanford.edu SSDS] group supports statistical software, including R, Stata, and SAS. They are located in the Velma Denning Room in the Bing Wing of [https://campus-map.stanford.edu/?id=03-200&lat=37.42690686&lng=-122.16759602&zoom=17&srch=Green%20Library Green Library] and hold office hours Monday–Thursday, 2–5 PM, starting in the second week of each quarter and ending the last week of classes. SRCC staff are present on the third Tuesday of each month, from 2–4 PM. SSDS office hours are not held during the Summer Quarter.
-
The barley machines are running Ubuntu 11.04, and the software is from the Ubuntu repositories, e.g. do 'dpkg -l' to see the list of installed packages.
+
== Software  ==
-
*[[R]]
+
A variety of useful [[Software | software]], including some popular commercial software, is provided as part of the FarmShare environment. If something is missing, or a particular application, library, or utility needs updating, please let us know. We try to accommodate reasonable requests but staff time is limited.
-
*[[OpenMPI]]
+
-
*[[AFS]] / Kerberos
+
-
*[[GridEngine]]
+
-
=== licensed software ===
+
For more information, see [https://srcc.stanford.edu/farmshare2/software Software].
-
*/usr/sweet/bin - [[MATLAB]], SAS, [[Stata]], [[StataMP]], etc
+
=== Packaged Software ===
-
There is a group on campus called "SSDS" that can provide support for SAS and stata: http://www.stanford.edu/group/ssds/cgi-bin/drupal/content/who-we-are-what-we-do
+
FarmShare systems run Ubuntu 16.04 LTS, and most software is sourced from standard repositories.
-
= Monitoring / Status  =
+
=== Modules and Licensed Software ===
-
*Current status of farmshare machines: http://barley-monitor.stanford.edu/ganglia/
+
Some software, including all licensed software, is built and/or installed manually and organized using the [https://lmod.readthedocs.io Lmod] environment module system.
-
*More detailed graphs: http://barley-monitor.stanford.edu/munin/
+
-
For important announcements, we plan to:
+
<source lang="sh">
 +
module help
 +
module avail
 +
module load
 +
</source>
-
*add it to this wiki
+
'''Please note''' that commercial software is licensed for use on FarmShare ''only'' in coursework, and ''not'' for research.
-
*modify /etc/motd on the corn machines
+
-
*send a mail to farmshare-announce
+
-
*duplicate that mail also to the farmshare "blog"
+
-
= Mailing Lists  =
+
=== User-installed Software ===
-
We have mailing lists, @lists.stanford.edu
+
-
*farmshare-announce - announcements list
+
-
*farmshare-discuss - user discussion
+
-
= Links  =
+
New or updated software can often be built and/or installed by users in their own home directories, and local package managers like [http://linuxbrew.sh Linuxbrew] and [https://spack.io Spack] can help. Local package managers are also available for many programming languages (e.g., [https://pip.pypa.io <code>pip</code>], [https://virtualenv.pypa.io <code>virtualenv</code>], and [https://conda.io Conda] for [https://www.python.org Python], <code>local::lib</code> and [https://perlbrew.pl Perlbrew] for [https://www.perl.org Perl], and [https://luarocks.org Luarocks] for [https://www.lua.org Lua]), and some of these provide tools for managing entire local programming environments.
-
Want to learn HPC? Free education materials available:  
+
-
*http://shodor.org/petascale/materials/modules/  
+
-
*http://hpcuniversity.org/roadmap/
+
-
= Getting started with MediaWiki  =
+
=== Containers ===
-
Consult the [http://meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.
+
 
-
*[http://www.mediawiki.org/wiki/Manual:Configuration_settings Configuration settings list]  
+
[http://singularity.lbl.gov Singularity] containers are supported, but bootstrapping an image requires <code>root</code> access, so you'll need to create your containers elsewhere and copy them to FarmShare to run.
-
*[http://www.mediawiki.org/wiki/Manual:FAQ MediaWiki FAQ]
+
-
*[http://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]
+

Revision as of 15:00, 11 November 2020

FarmShare is Stanford’s community computing environment. It is primarily intended for use in coursework and unsponsored research (note that some software tools, like ANSYS, are only licensed for use on Farmshare for academic course use, not research); users participating in sponsored or departmental research should investigate the Sherlock service or other, local alternatives, instead. FarmShare is not approved for use with high-risk data, including protected health information and personally identifiable information, and is subject to University policies on acceptable use.

For a description of the current environment, see FarmShare 2. More information can be found in the service documentation.


Contents

Recent Messages on farmshare-discuss

    System Status

    Major FarmShare maintenance is scheduled for 8:00 a.m. Wednesday, December 9–5:00 p.m. Tuesday, December 15.

    Please note that planned work will require an unusually extended downtime, during which we will be performing deferred hardware maintenance and physically moving FarmShare systems to a new location. All systems will be inaccessible during the maintenance period; please make sure you have completed and saved results from any running jobs, refrain from starting any long-running jobs that might not finish, and log out before the beginning of the maintenance window.

    We understand that the long maintenance period may inconvenience some users and ask for your patience while we complete this necessary work.

    Getting Started

    Any person with a full-service SUNet ID can access FarmShare.

    Connecting

    Do not connect to farm.stanford.edu. While there is such a system, it is not part of the FarmShare service.

    Log into rice.stanford.edu. Authentication is by SUNet ID and password (or GSSAPI), and two-step authentication is required.

    ssh sunetid@rice.stanford.edu
    

    SSH host keys and fingerprints are available for verification.

    For light-duty, interactive work (e.g., e-mail, web browsing and development, file editing, and AFS access or file transfers), log into cardinal.stanford.edu, instead.

    ssh sunetid@cardinal.stanford.edu
    

    cardinal systems should not be used for long-running or compute- and/or memory-intensive work.

    For more information, see Getting Connected and Advanced Connection Options.

    User Guide

    The User Guide has information regarding storage, file-transfer, and cluster configuration. See the FAQ for common issues, and tips and tricks.

    Support

    SRCC staff can be reached by e-mail at: srcc-support@stanford.edu. When reporting a problem, please let us know that you're running on FarmShare and report any relevant details, including the full text of any error message you're receiving, and the job ID and contents of your batch script (if applicable).

    Course Instructors

    If you are a course instructor using FarmShare for classwork and have any special requests or requirements please contact SRCC at least 30 days before the start of the academic quarter in which the class will be held. We try to accommodate reasonable requests but staff time is limited.

    Discussion List

    Subscribe to the community discussion list, farmshare-discuss, post questions and concerns to: farmshare-discuss@lists.stanford.edu, or browse the archives.

    Office Hours

    In accordance with guidance from the University regarding COVID-19, SMACC office hours have been suspended until further notice. If you need assistance with FarmShare please contact us at srcc-support@stanford.edu.

    SRCC participates in SMACC (C2) office hours, held weekly in the basement of Huang Engineering Center, near the ICME offices.

    SMACC office hours are not held during the Summer Quarter, or during inter-quarter periods.

    SSDS Consulting

    The SSDS group supports statistical software, including R, Stata, and SAS. They are located in the Velma Denning Room in the Bing Wing of Green Library and hold office hours Monday–Thursday, 2–5 PM, starting in the second week of each quarter and ending the last week of classes. SRCC staff are present on the third Tuesday of each month, from 2–4 PM. SSDS office hours are not held during the Summer Quarter.

    Software

    A variety of useful software, including some popular commercial software, is provided as part of the FarmShare environment. If something is missing, or a particular application, library, or utility needs updating, please let us know. We try to accommodate reasonable requests but staff time is limited.

    For more information, see Software.

    Packaged Software

    FarmShare systems run Ubuntu 16.04 LTS, and most software is sourced from standard repositories.

    Modules and Licensed Software

    Some software, including all licensed software, is built and/or installed manually and organized using the Lmod environment module system.

    module help
    module avail
    module load
    

    Please note that commercial software is licensed for use on FarmShare only in coursework, and not for research.

    User-installed Software

    New or updated software can often be built and/or installed by users in their own home directories, and local package managers like Linuxbrew and Spack can help. Local package managers are also available for many programming languages (e.g., pip, virtualenv, and Conda for Python, local::lib and Perlbrew for Perl, and Luarocks for Lua), and some of these provide tools for managing entire local programming environments.

    Containers

    Singularity containers are supported, but bootstrapping an image requires root access, so you'll need to create your containers elsewhere and copy them to FarmShare to run.

    Personal tools
    Toolbox
    LANGUAGES