Jupyter
From FarmShare
(start of revision to jupyter) |
m (→FarmShare Specific Features: link explaining encryption and link to python) |
||
Line 6: | Line 6: | ||
At the end of this guide, the resulting jupyter notebook will support: | At the end of this guide, the resulting jupyter notebook will support: | ||
- | * an | + | * an [https://en.wikipedia.org/wiki/Transport_Layer_Security encrypted], password enabled, web-browser enabled programming environment |
* persistence of the environment for seven days (maximum duration of [https://uit.stanford.edu/service/kerberos Stanford Kerberos] tickets | * persistence of the environment for seven days (maximum duration of [https://uit.stanford.edu/service/kerberos Stanford Kerberos] tickets | ||
* file/data storage on the [https://uit.stanford.edu/service/afs Stanford AFS] servers with 5GB user quota and automatic backups | * file/data storage on the [https://uit.stanford.edu/service/afs Stanford AFS] servers with 5GB user quota and automatic backups | ||
* shared file/data storage to [https://uit.stanford.edu/service/its-course-support/diskspace Class Disk AFS Space] | * shared file/data storage to [https://uit.stanford.edu/service/its-course-support/diskspace Class Disk AFS Space] | ||
* simple switching to any of the [https://web.stanford.edu/group/farmshare/cgi-bin/wiki/index.php/Main_Page Stanford FarmShare] systems | * simple switching to any of the [https://web.stanford.edu/group/farmshare/cgi-bin/wiki/index.php/Main_Page Stanford FarmShare] systems | ||
- | * | + | * [https://www.python.org python3] support |
=== Installation === | === Installation === |
Revision as of 14:26, 23 December 2016
Contents |
Jupyter
Project Jupyter evolved out of the IPython project (specifically the IPython notebook). The primary goal of Project Jupyter is to provide an interactive, web-browser driven, language-independent programming environment. Jupyter can be deployed on the farmshare servers to enable an accessible, powerful, and persistent computational platform.
At the end of this guide, the resulting jupyter notebook will support:
- an encrypted, password enabled, web-browser enabled programming environment
- persistence of the environment for seven days (maximum duration of Stanford Kerberos tickets
- file/data storage on the Stanford AFS servers with 5GB user quota and automatic backups
- shared file/data storage to Class Disk AFS Space
- simple switching to any of the Stanford FarmShare systems
- python3 support
Installation
Ipython
Ipython provides both a command line and browser based (notebook) interfaces. The development is quite fast, so the distribution provided packages tend to lag behind enough it makes sense to setup a python environment which incorporates the latest updates.
building an Ipython notebook environment
Login to a corn and make yourself an Ipython environment in the non-AFS space
mkdir -p /farmshare/user_data/$USER/ipythontest cd /farmshare/user_data/$USER/ipythontest virtualenv --system-site-packages devbranch devbranch/bin/pip install --upgrade ipython devbranch/bin/pip install --upgrade tornado devbranch/bin/pip install jsonschema cp -p /farmshare/software/examples/ipython/audio.ipynb .
To run Ipython notebook environment, first start it up:
devbranch/bin/ipython notebook `%pylab inline` --no-browser
You should see output similar to following:
2013-12-03 21:39:50.435 [NotebookApp] Created profile dir: u'/afs/ir.stanford.edu/users/b/i/bishopj/.config/ipython/profile_default' 2013-12-03 21:39:50.465 [NotebookApp] Using MathJax from CDN: http://cdn.mathjax.org/mathjax/latest/MathJax.js 2013-12-03 21:39:50.599 [NotebookApp] Serving notebooks from local directory: /srv/zfs01/user_data/bishopj/ipyhtontest 2013-12-03 21:39:50.599 [NotebookApp] The IPython Notebook is running at: http://127.0.0.1:8888/ 2013-12-03 21:39:50.599 [NotebookApp] Use Control-C to stop this server and shut down all kernels (twice to skip confirmation).
Setup an ssh tunnel from your desktop system to the same corn system you ran the notebook on in previous step. In my case port 8888 and corn02.
ssh -L 8888:localhost:8888 corn02
Now again from your desktop system open a web browser and navigate to 'localhost:8888'
Now click on Cluster and startup your cluster
Click back on the Notebook tab and you should see an audio notebook. click on this.
Now you can load up a notebook and "play"