Welcome group members: Difference between revisions

From DISI
Jump to navigation Jump to search
No edit summary
No edit summary
Line 1: Line 1:
Welcome to the lab. This page is designed for new group members, our collaborators and anyone else who wishes to access our cluster via ssh.
Welcome to the lab. This page is designed for new group members, our collaborators and anyone else who wishes to access our cluster via ssh.


= Obtaining credentials =
As you know, we have two labs, one in Toronto and one in San FranciscoMoreover, in each location there are shared clusters that we have access to.  We take up each in turn.  
For command line access to our cluster, please contact Teague, Therese or John for credentials.
 
For your main email address, you may well use your gmail account or other public account for most purposesHowever, if you need personal access to the SciNet cluster, you will need a U of T email addressIf you do not need access to SciNet, then you may well not need a U of T email address.
 
* Step 1 is to contact Lilita, who can get you a U of T email address.
* Step 2. Is to get a Compute Canada Role Identifier (CCRI) from me.
* Step 3. is to register on SciNet (page here).


= Toronto - our cluster =
{{TOCright}}
{{TOCright}}
== Obtaining credentials ==
For command line access to our cluster, please contact Teague, Therese or John for credentials.
For your main email address, you may well use your gmail account or other public account for most purposes.


= Disk usage conventions =  
== Disk usage conventions ==  
We differentiate dockers from everyone else. If you are a full time member of the group, your disk space allocation will be like this:
We differentiate dockers from everyone else. If you are a full time member of the group, your disk space allocation will be like this:


Line 30: Line 27:
  /nfs/software/<userid>/
  /nfs/software/<userid>/


= Getting set up with lab software =  
== Getting set up with lab software ==  
  svn co dockenv
  svn co dockenv
  cp $SOFT/labenv.csh ~/.csh  
  cp $SOFT/labenv.csh ~/.csh  
Line 36: Line 33:
  cp $SOFT/labenv.sh ~/.bashrc
  cp $SOFT/labenv.sh ~/.bashrc
for bash users.
for bash users.
= Toronto - SciNet cluster =
If you need personal access to the SciNet cluster, you will need a U of T email address.  If you do not need access to SciNet, then you may well not need a U of T email address.
* 1. Contact Lilita, who can get you a U of T email address.
* 2. Get a Compute Canada Role Identifier (CCRI) from me.
* 3. Register on SciNet (page here).
= San Francisco - our lab =
= San Francisco - shared cluster =
= San Francisco - new cluster =


= Access from home =  
= Access from home =  
[[How to generate ssh keys securely]]
[[How to generate ssh keys securely]]


Line 51: Line 65:
Please discuss with Teague or Therese or John one month before you leave the lab to agree on which of your files will remain.  
Please discuss with Teague or Therese or John one month before you leave the lab to agree on which of your files will remain.  
We can provide you with portable disks so you can take software and data with you, if you like. If you want to take the lab software with you, we can help with that too.
We can provide you with portable disks so you can take software and data with you, if you like. If you want to take the lab software with you, we can help with that too.


[[Category:Tutorials]]
[[Category:Tutorials]]

Revision as of 15:56, 14 February 2014

Welcome to the lab. This page is designed for new group members, our collaborators and anyone else who wishes to access our cluster via ssh.

As you know, we have two labs, one in Toronto and one in San Francisco. Moreover, in each location there are shared clusters that we have access to. We take up each in turn.

Toronto - our cluster

Obtaining credentials

For command line access to our cluster, please contact Teague, Therese or John for credentials. For your main email address, you may well use your gmail account or other public account for most purposes.

Disk usage conventions

We differentiate dockers from everyone else. If you are a full time member of the group, your disk space allocation will be like this:

Your home directory is for important or small files. 500 GB default. Backed up.

/nfs/home/<userid>/

We expect you to run docking calculations in /project/. 1TB default. Not backed up.

/nfs/project/<userid>/

If you have large amounts of data you want kept, e.g. from the synchrotron, you may request repository space to keep it. Backed up. Size by agreement.

/nfs/repos/<userid>/

If you generate private databases, you may request /db/ space. Backup by arrangement. Size by agreement.

/nfs/db/<userid>/

If you have software you want to share, you may request /software/ space. backed up. 500 GB.

/nfs/software/<userid>/

Getting set up with lab software

svn co dockenv
cp $SOFT/labenv.csh ~/.csh 

OR

cp $SOFT/labenv.sh ~/.bashrc

for bash users.

Toronto - SciNet cluster

If you need personal access to the SciNet cluster, you will need a U of T email address. If you do not need access to SciNet, then you may well not need a U of T email address.

  • 1. Contact Lilita, who can get you a U of T email address.
  • 2. Get a Compute Canada Role Identifier (CCRI) from me.
  • 3. Register on SciNet (page here).

San Francisco - our lab

San Francisco - shared cluster

San Francisco - new cluster

Access from home

How to generate ssh keys securely

How_to_create_a_vpn/ssh_tunnel

Good habits

Set aside a quiet time every month to review your disk usage, and compress, delete or move excessive usage.

Synchrotron trips

We can help arrange to store your data in a safe place. Ask before you leave.

When you leave the lab

Please discuss with Teague or Therese or John one month before you leave the lab to agree on which of your files will remain. We can provide you with portable disks so you can take software and data with you, if you like. If you want to take the lab software with you, we can help with that too.