Main Page

From FarmShare

(Difference between revisions)
Jump to: navigation, search
m
(System Status)
(47 intermediate revisions not shown)
Line 1: Line 1:
-
FarmShare is Stanford’s community computing environment. It is intended for use in coursework and unsponsored research; users participating in sponsored research should investigate the [https://sherlock.stanford.edu Sherlock] service, instead. FarmShare is ''not'' approved for use with [https://dataclass.stanford.edu high-risk] data, including protected health information and personally identifiable information.
+
FarmShare is Stanford’s community computing environment. It is primarily intended for use in coursework and unsponsored research (note that some software tools, like ANSYS, are only licensed for use on Farmshare for academic course use, not research); users participating in sponsored or departmental research should investigate the [https://sherlock.stanford.edu Sherlock] service or other, local alternatives, instead. FarmShare is ''not'' approved for use with [https://dataclass.stanford.edu high-risk] data, including protected health information and personally identifiable information, and is subject to University [[Policy | policies]] on acceptable use.
For a description of the current environment, see [[FarmShare 2]]. More information can be found in the [https://srcc.stanford.edu/farmshare2 service documentation].
For a description of the current environment, see [[FarmShare 2]]. More information can be found in the [https://srcc.stanford.edu/farmshare2 service documentation].
Line 7: Line 7:
  |-
  |-
  | style="width: 30%;" | __TOC__
  | style="width: 30%;" | __TOC__
-
  | style="width: 70%;" | <h3>Recent Messages on farmshare-discuss</h3><rss>http://web.stanford.edu/group/farmshare/wiki/rss/farmshare-discuss.rss</rss>
+
  | style="width: 70%;" | <h3>Recent Messages on [https://mailman.stanford.edu/mailman/listinfo/farmshare-discuss/ farmshare-discuss]</h3><rss>http://web.stanford.edu/group/farmshare/wiki/rss/farmshare-discuss.rss</rss>
  |}
  |}
== System Status ==
== System Status ==
-
FarmShare is currently fully operational. The next maintenance period is scheduled for September 21, 2017, from 8am–5pm.
+
FarmShare is fully operational.
 +
 
 +
'''Special downtime''' is planned for Labor Day weekend, '''Saturday, September 1–Monday, September 3''', to accommodate a shutdown of the Stanford Research Computing Facility (SRCF), where FarmShare systems are located, for necessary power systems maintenance. During this period all FarmShare systems will be down; you will not be able to login, submit jobs, or access files in your FarmShare home directory. See [https://srcc.stanford.edu/events/srcf-reboot-planned-3-day-electrical-outage SRCF Reboot] for more information.
== Getting Started ==
== Getting Started ==
-
Any user with a [https://uit.stanford.edu/service/accounts/sunetids#eligibility full-service] SUNet ID can access FarmShare.
+
Any person with a [https://uit.stanford.edu/service/accounts/sunetids#eligibility full-service] SUNet ID can access FarmShare.
=== Connecting ===
=== Connecting ===
-
'''Do not connect to farm.stanford.edu.''' While there is such a system, it is ''not'' part of the FarmShare service.
+
'''Do not connect to <code>farm.stanford.edu</code>.''' While there is such a system, it is ''not'' part of the FarmShare service.
Log into <code>rice.stanford.edu</code>. Authentication is by SUNet ID and password (or GSSAPI), and [https://uit.stanford.edu/service/webauth/twostep two-step] authentication is required.
Log into <code>rice.stanford.edu</code>. Authentication is by SUNet ID and password (or GSSAPI), and [https://uit.stanford.edu/service/webauth/twostep two-step] authentication is required.
-
ssh sunetid@rice.stanford.edu
+
<source lang="sh">ssh sunetid@rice.stanford.edu</source>
SSH [https://srcc.stanford.edu/farmshare2/connecting-keys host keys and fingerprints] are available for verification.
SSH [https://srcc.stanford.edu/farmshare2/connecting-keys host keys and fingerprints] are available for verification.
Line 29: Line 31:
For light-duty, interactive work (e.g., e-mail, web browsing and development, file editing, and AFS access or file transfers), log into <code>cardinal.stanford.edu</code>, instead.
For light-duty, interactive work (e.g., e-mail, web browsing and development, file editing, and AFS access or file transfers), log into <code>cardinal.stanford.edu</code>, instead.
-
ssh sunetid@cardinal.stanford.edu
+
<source lang="sh">ssh sunetid@cardinal.stanford.edu</source>
<code>cardinal</code> systems should ''not'' be used for long-running or compute- and/or memory-intensive work.
<code>cardinal</code> systems should ''not'' be used for long-running or compute- and/or memory-intensive work.
Line 55: Line 57:
SRCC participates in [https://web.stanford.edu/group/su-hpc/cgi-bin/mediawiki/index.php/SMACC SMACC] office hours, held weekly in the basement of [https://campus-map.stanford.edu/?id=04-080&lat=37.42787956&lng=-122.17429865&zoom=17&srch=Huang%20Engineering%20Center Huang Engineering Center], near the [https://icme.stanford.edu ICME] offices.
SRCC participates in [https://web.stanford.edu/group/su-hpc/cgi-bin/mediawiki/index.php/SMACC SMACC] office hours, held weekly in the basement of [https://campus-map.stanford.edu/?id=04-080&lat=37.42787956&lng=-122.17429865&zoom=17&srch=Huang%20Engineering%20Center Huang Engineering Center], near the [https://icme.stanford.edu ICME] offices.
-
SMACC office hours are not held during the Summer Quarter, but will resume in Autumn.
+
Office hours for Spring Quarter are Fridays, 1–3 PM. SMACC office hours are not held during the Summer Quarter, or during inter-quarter periods.
=== SSDS Consulting ===
=== SSDS Consulting ===
-
The [https://ssds.stanford.edu SSDS] group supports statistical software, including R, Stata, and SAS. They are located in the Velma Denning Room in the Bing Wing of [https://campus-map.stanford.edu/?id=03-200&lat=37.42690686&lng=-122.16759602&zoom=17&srch=Green%20Library Green Library] and hold office hours Monday–Thursday, 2–5 PM, starting in the second week of each quarter and ending the last week of classes.
+
The [https://ssds.stanford.edu SSDS] group supports statistical software, including R, Stata, and SAS. They are located in the Velma Denning Room in the Bing Wing of [https://campus-map.stanford.edu/?id=03-200&lat=37.42690686&lng=-122.16759602&zoom=17&srch=Green%20Library Green Library] and hold office hours Monday–Thursday, 2–5 PM, starting in the second week of each quarter and ending the last week of classes. SRCC staff are present on the third Tuesday of each month, from 2–4 PM. SSDS office hours are not held during the Summer Quarter.
-
 
+
-
SSDS office hours are not held during the Summer Quarter, but will resume in Autumn.
+
== Software  ==
== Software  ==
Line 77: Line 77:
Some software, including all licensed software, is built and/or installed manually and organized using the [https://lmod.readthedocs.io Lmod] environment module system.
Some software, including all licensed software, is built and/or installed manually and organized using the [https://lmod.readthedocs.io Lmod] environment module system.
-
module help
+
<source lang="sh">
-
module avail
+
module help
-
module load
+
module avail
 +
module load
 +
</source>
=== User-installed Software ===
=== User-installed Software ===
-
New or updated software can often be built and/or installed by users in their own home directories, and local package managers like [http://linuxbrew.sh Linuxbrew] and [https://spack.io Spack] can help. Local package managers are also available for many programming languages, and some provide tools for managing entire local programming environments (e.g., [https://pip.pypa.io <code>pip</code>], [https://virtualenv.pypa.io <code>virtualenv</code>], and [https://conda.io Conda] for [https://www.python.org Python], <code>local::lib</code> and [https://perlbrew.pl Perlbrew] for [https://www.perl.org Perl], and [https://luarocks.org Luarocks] for [https://www.lua.org Lua].
+
New or updated software can often be built and/or installed by users in their own home directories, and local package managers like [http://linuxbrew.sh Linuxbrew] and [https://spack.io Spack] can help. Local package managers are also available for many programming languages (e.g., [https://pip.pypa.io <code>pip</code>], [https://virtualenv.pypa.io <code>virtualenv</code>], and [https://conda.io Conda] for [https://www.python.org Python], <code>local::lib</code> and [https://perlbrew.pl Perlbrew] for [https://www.perl.org Perl], and [https://luarocks.org Luarocks] for [https://www.lua.org Lua]), and some of these provide tools for managing entire local programming environments.
=== Containers ===
=== Containers ===
[http://singularity.lbl.gov Singularity] containers are supported, but bootstrapping an image requires <code>root</code> access, so you'll need to create your containers elsewhere and copy them to FarmShare to run.
[http://singularity.lbl.gov Singularity] containers are supported, but bootstrapping an image requires <code>root</code> access, so you'll need to create your containers elsewhere and copy them to FarmShare to run.
-
 
-
== Legacy FarmShare Environment ==
 
-
 
-
'''The legacy environment will be retired on Wednesday, December 20, 2017.''' FarmShare 2 should be used for all new work.
 
-
 
-
=== Connecting ===
 
-
 
-
Log into <code>corn.stanford.edu</code>. Authentication is by SUNet ID and password (or GSSAPI), and two-step authentication is required.
 
-
 
-
ssh sunetid@corn.stanford.edu
 
-
 
-
For work requiring access to a GPU, log into <code>rye.stanford.edu</code>, instead.
 
-
 
-
ssh sunetid@rye.stanford.edu
 
-
 
-
More information is available in the [https://itservices.stanford.edu/service/sharedcomputing legacy service documentation].
 

Revision as of 20:30, 21 June 2018

FarmShare is Stanford’s community computing environment. It is primarily intended for use in coursework and unsponsored research (note that some software tools, like ANSYS, are only licensed for use on Farmshare for academic course use, not research); users participating in sponsored or departmental research should investigate the Sherlock service or other, local alternatives, instead. FarmShare is not approved for use with high-risk data, including protected health information and personally identifiable information, and is subject to University policies on acceptable use.

For a description of the current environment, see FarmShare 2. More information can be found in the service documentation.


Contents

Recent Messages on farmshare-discuss

    System Status

    FarmShare is fully operational.

    Special downtime is planned for Labor Day weekend, Saturday, September 1–Monday, September 3, to accommodate a shutdown of the Stanford Research Computing Facility (SRCF), where FarmShare systems are located, for necessary power systems maintenance. During this period all FarmShare systems will be down; you will not be able to login, submit jobs, or access files in your FarmShare home directory. See SRCF Reboot for more information.

    Getting Started

    Any person with a full-service SUNet ID can access FarmShare.

    Connecting

    Do not connect to farm.stanford.edu. While there is such a system, it is not part of the FarmShare service.

    Log into rice.stanford.edu. Authentication is by SUNet ID and password (or GSSAPI), and two-step authentication is required.

    ssh sunetid@rice.stanford.edu
    

    SSH host keys and fingerprints are available for verification.

    For light-duty, interactive work (e.g., e-mail, web browsing and development, file editing, and AFS access or file transfers), log into cardinal.stanford.edu, instead.

    ssh sunetid@cardinal.stanford.edu
    

    cardinal systems should not be used for long-running or compute- and/or memory-intensive work.

    For more information, see Getting Connected and Advanced Connection Options.

    User Guide

    The User Guide has information regarding storage, file-transfer, and cluster configuration. See the FAQ for common issues, and tips and tricks.

    Support

    SRCC staff can be reached by e-mail at: srcc-support@stanford.edu. When reporting a problem, please let us know that you're running on FarmShare and report any relevant details, including the full text of any error message you're receiving, and the job ID and contents of your batch script (if applicable).

    Course Instructors

    If you are a course instructor using FarmShare for classwork and have any special requests or requirements please contact SRCC at least 30 days before the start of the academic quarter in which the class will be held. We try to accommodate reasonable requests but staff time is limited.

    Discussion List

    Subscribe to the community discussion list, farmshare-discuss, post questions and concerns to: farmshare-discuss@lists.stanford.edu, or browse the archives.

    Office Hours

    SRCC participates in SMACC office hours, held weekly in the basement of Huang Engineering Center, near the ICME offices.

    Office hours for Spring Quarter are Fridays, 1–3 PM. SMACC office hours are not held during the Summer Quarter, or during inter-quarter periods.

    SSDS Consulting

    The SSDS group supports statistical software, including R, Stata, and SAS. They are located in the Velma Denning Room in the Bing Wing of Green Library and hold office hours Monday–Thursday, 2–5 PM, starting in the second week of each quarter and ending the last week of classes. SRCC staff are present on the third Tuesday of each month, from 2–4 PM. SSDS office hours are not held during the Summer Quarter.

    Software

    A variety of useful software, including some popular commercial software, is provided as part of the FarmShare environment. If something is missing, or a particular application, library, or utility needs updating, please let us know. We try to accommodate reasonable requests but staff time is limited.

    For more information, see Software.

    Packaged Software

    FarmShare systems run Ubuntu 16.04 LTS, and most software is sourced from standard repositories.

    Modules and Licensed Software

    Some software, including all licensed software, is built and/or installed manually and organized using the Lmod environment module system.

    module help
    module avail
    module load
    

    User-installed Software

    New or updated software can often be built and/or installed by users in their own home directories, and local package managers like Linuxbrew and Spack can help. Local package managers are also available for many programming languages (e.g., pip, virtualenv, and Conda for Python, local::lib and Perlbrew for Perl, and Luarocks for Lua), and some of these provide tools for managing entire local programming environments.

    Containers

    Singularity containers are supported, but bootstrapping an image requires root access, so you'll need to create your containers elsewhere and copy them to FarmShare to run.

    Personal tools
    Toolbox
    LANGUAGES