Category:Cluster: Difference between revisions

From DISI
Jump to navigation Jump to search
No edit summary
 
(33 intermediate revisions by the same user not shown)
Line 1: Line 1:
We currently have three computer clusters, but aim to reduce this to two or even one.
== Current Usage Narrative ==


* [[Cluster 0]] also known as the legacy cluster is in San Francisco at UCSF. (was UCSF Cluster)
As of September 9, 2026:
* [[Cluster 1]] is in the pharmacy building at U of T(was UofT Cluster)
* Cluster 7: default for new users. Many things work here, and all of Cluster 2 is accessible read-only from Cluster 7.  
* [[Cluster 2]] is in Byers Hall 101 and Genentech Hall 108 at UCSF aka "the new cluster".
* Cluster 8: aka CoreHPC/FAC. Katie now has docking and 3D building working there. We have recently expanded to 50 TB.
Legacy:
* Cluster 2: old default, most people are still using C2. New users should generally not be added.
* Cluster 3: aka Wynton, you have about 5 month left. We strongly urge you to a. consolidate your footprint as small as you can on WyntonBackup your data to C7 or C2.
* Cluster 0: still in use, supports DUDE and not a lot else.
* Cluster 6: aka Keiser. Rapidly shrinking. If you are still using Keiser cluster, please wind down, transfer files off, and stop.


Access clusters via sgehead if on campus, [[Portal system | portals]] if off campus.
== Set up your own cluster ==
see: [[So you want to set up a lab]]


We also have access to two shared clusters, as follows:
== New group members ==
* please use [[Cluster 7]] and [[Cluster 8]].
[[cluster exceptions|exceptions]].


* [https://salilab.org/qb3cluster QB3 Shared Cluster] aka [[Cluster 3]].
{| class="wikitable"
* [[Apply for SciNet Account | SciNet Cluster]] aka [[Cluster 4]].
|-
! Cluster ID !! Description !! How to get started || cpu/gpu || Disk space || Notes
|-
| [[Cluster 0]] ||  Legacy UCSF cluster || Closed || 300/0 || 20 TB ||  Legacy support. Retire asap.
|-
| [[Cluster 1]] || Toronto Cluster || Closed||  448/0 ||40 TB || Defunct
|-
| [[Cluster 2]] ||  New UCSF cluster || Closed || 800/52 || 6.5 PB || No new growth. Merge into Cluster 7
|-
| [[Cluster 3]]  || [https://salilab.org/qb3cluster UCSF Shared Cluster] aka Wynton ||  Closed || 18,000/250 || 6 PB ||  End of life. Use cluster 7 & 8.
|-
| [[Cluster 5]]  || [https://aws.amazon.com/ Amazon Cloud] ||  ask John  || unlimited || unlimited ||  Commercial. Ask us. Watch out for runaway costs.
|-
| [[Cluster 6]] || Mike Keiser cluster ||  Closed || 100/50 || 1 PB ||  End of life. Being merged into cluster 7.
|-
| [[Cluster 7]]  || New Cluster 7 ||  JJ/Khanh || 100/8 || 1 PB ||  Default for new users
|-
| [[Cluster 8]] || FAC/coreHPC ||  UCSF IT || 16,000/350 || 50 TB on FAC ||  CoreHPC/FAC. Default for new users.
|-
| [[Cluster 9]] || Offsite experimental cluster ||  John || 64/4 || 1 PB ||  off-site cluster
|}


We also use commercial cloud clusters  
Access our clusters from [[Lab Security Policy | secure machines]] only.  If unsure, ask the [[sysadmin]]s.
*  Amazon cloud EC2, which we affectionately refer to as [[Cluster 5]]
* Google cloud, which we call [[Cluster 6]].
 
Need advice about which cluster to use? Ask the [[sysadmin]].


[[Category:Internal]]
[[Category:Internal]]
[[Category:Cluster]]
[[Category:Topic]]

Latest revision as of 18:17, 10 September 2026

Current Usage Narrative

As of September 9, 2026:

  • Cluster 7: default for new users. Many things work here, and all of Cluster 2 is accessible read-only from Cluster 7.
  • Cluster 8: aka CoreHPC/FAC. Katie now has docking and 3D building working there. We have recently expanded to 50 TB.

Legacy:

  • Cluster 2: old default, most people are still using C2. New users should generally not be added.
  • Cluster 3: aka Wynton, you have about 5 month left. We strongly urge you to a. consolidate your footprint as small as you can on Wynton. Backup your data to C7 or C2.
  • Cluster 0: still in use, supports DUDE and not a lot else.
  • Cluster 6: aka Keiser. Rapidly shrinking. If you are still using Keiser cluster, please wind down, transfer files off, and stop.

Set up your own cluster

see: So you want to set up a lab

New group members

exceptions.

Cluster ID Description How to get started cpu/gpu Disk space Notes
Cluster 0 Legacy UCSF cluster Closed 300/0 20 TB Legacy support. Retire asap.
Cluster 1 Toronto Cluster Closed 448/0 40 TB Defunct
Cluster 2 New UCSF cluster Closed 800/52 6.5 PB No new growth. Merge into Cluster 7
Cluster 3 UCSF Shared Cluster aka Wynton Closed 18,000/250 6 PB End of life. Use cluster 7 & 8.
Cluster 5 Amazon Cloud ask John unlimited unlimited Commercial. Ask us. Watch out for runaway costs.
Cluster 6 Mike Keiser cluster Closed 100/50 1 PB End of life. Being merged into cluster 7.
Cluster 7 New Cluster 7 JJ/Khanh 100/8 1 PB Default for new users
Cluster 8 FAC/coreHPC UCSF IT 16,000/350 50 TB on FAC CoreHPC/FAC. Default for new users.
Cluster 9 Offsite experimental cluster John 64/4 1 PB off-site cluster

Access our clusters from secure machines only. If unsure, ask the sysadmins.