Category:Cluster: Difference between revisions

From DISI
Jump to navigation Jump to search
m (asdf)
 
(16 intermediate revisions by the same user not shown)
Line 1: Line 1:
Set up your own cluster? see: [[So you want to set up a lab]]  If you are a group member, please use [[Cluster 2]]. Generally, these are kept separate, with some specific [[cluster exceptions|exceptions]].
== Current Usage Narrative ==
 
As of September 9, 2026:
* Cluster 7: default for new users. Many things work here, and all of Cluster 2 is accessible read-only from Cluster 7.
* Cluster 8: aka CoreHPC/FAC. Katie now has docking and 3D building working there. We have recently expanded to 50 TB.
Legacy:
* Cluster 2: old default, most people are still using C2. New users should generally not be added.
* Cluster 3: aka Wynton, you have about 5 month left. We strongly urge you to a. consolidate your footprint as small as you can on Wynton.  Backup your data to C7 or C2.
* Cluster 0: still in use, supports DUDE and not a lot else.
* Cluster 6: aka Keiser. Rapidly shrinking. If you are still using Keiser cluster, please wind down, transfer files off, and stop.
 
== Set up your own cluster ==
see: [[So you want to set up a lab]]   
 
== New group members ==
* please use [[Cluster 7]] and [[Cluster 8]].
[[cluster exceptions|exceptions]].


{| class="wikitable"
{| class="wikitable"
|-
|-
! Cluster ID !! Description !! How to get started || sge-CPU-cores || Our disk space || Notes
! Cluster ID !! Description !! How to get started || cpu/gpu || Disk space || Notes
|-
| [[Cluster 0]] ||  Legacy UCSF cluster || Closed || 300/0 || 20 TB ||  Legacy support. Retire asap.
|-
|-
| [[Cluster 0]] || Legacy UCSF cluster || Closed || 590 || 20 TB || Legacy use only.  Will continue to shrink.
| [[Cluster 1]] || Toronto Cluster || Closed|| 448/0 ||40 TB || Defunct
|-
|-
| [[Cluster 1]] || Toronto Cluster || Closed|| 448 ||40 TB || Defunct
| [[Cluster 2]] || New UCSF cluster || Closed || 800/52 || 6.5 PB || No new growth. Merge into Cluster 7
|-
|-
| [[Cluster 2]] || New UCSF cluster || Teague || 448 || 120 TB || Default cluster
| [[Cluster 3]] || [https://salilab.org/qb3cluster UCSF Shared Cluster] aka Wynton || Closed || 18,000/250 || 6 PB || End of life. Use cluster 7 & 8.
|-
|-
| [[Cluster 3]]  || [https://salilab.org/qb3cluster UCSF Shared Cluster] ||  Teague -> Josh || 6301 || 120 TB ||  Shared UID space! cross mounted disks!
| [[Cluster 5]]  || [https://aws.amazon.com/ Amazon Cloud] ||  ask John  || unlimited || unlimited ||  Commercial. Ask us. Watch out for runaway costs.
|-
|-
| [[Cluster 5]]  || [https://aws.amazon.com/ Amazon Cloud] ||  Teague  || unlimited || unlimited ||  Commercial. Ask us. Watch out for bandwidth costs.
| [[Cluster 6]]  || Mike Keiser cluster ||  Closed || 100/50 || 1 PB ||  End of life. Being merged into cluster 7.
|-
|-
| [[Cluster 6]]  || [https://cloud.google.com/ Google cloud] ||  Teague || unlimited || unlimited ||  Commercial. Ask us. Watch out for bandwidth costs.
| [[Cluster 7]]  || New Cluster 7 ||  JJ/Khanh || 100/8 || 1 PB ||  Default for new users
|-
|-
| [[Cluster 7]]  || New Cluster 7 ||  Teague || unlimited || unlimited ||  This is the future
| [[Cluster 8]]  || FAC/coreHPC ||  UCSF IT || 16,000/350 || 50 TB on FAC ||  CoreHPC/FAC. Default for new users.
|-
|-
| [[Cluster 8]]  || FAC/coreHPC ||  Teague || unlimited || unlimited ||  UCSF replacement for Wynton
| [[Cluster 9]]  || Offsite experimental cluster ||  John || 64/4 || 1 PB ||  off-site cluster
|}
|}



Latest revision as of 18:17, 10 September 2026

Current Usage Narrative

As of September 9, 2026:

  • Cluster 7: default for new users. Many things work here, and all of Cluster 2 is accessible read-only from Cluster 7.
  • Cluster 8: aka CoreHPC/FAC. Katie now has docking and 3D building working there. We have recently expanded to 50 TB.

Legacy:

  • Cluster 2: old default, most people are still using C2. New users should generally not be added.
  • Cluster 3: aka Wynton, you have about 5 month left. We strongly urge you to a. consolidate your footprint as small as you can on Wynton. Backup your data to C7 or C2.
  • Cluster 0: still in use, supports DUDE and not a lot else.
  • Cluster 6: aka Keiser. Rapidly shrinking. If you are still using Keiser cluster, please wind down, transfer files off, and stop.

Set up your own cluster

see: So you want to set up a lab

New group members

exceptions.

Cluster ID Description How to get started cpu/gpu Disk space Notes
Cluster 0 Legacy UCSF cluster Closed 300/0 20 TB Legacy support. Retire asap.
Cluster 1 Toronto Cluster Closed 448/0 40 TB Defunct
Cluster 2 New UCSF cluster Closed 800/52 6.5 PB No new growth. Merge into Cluster 7
Cluster 3 UCSF Shared Cluster aka Wynton Closed 18,000/250 6 PB End of life. Use cluster 7 & 8.
Cluster 5 Amazon Cloud ask John unlimited unlimited Commercial. Ask us. Watch out for runaway costs.
Cluster 6 Mike Keiser cluster Closed 100/50 1 PB End of life. Being merged into cluster 7.
Cluster 7 New Cluster 7 JJ/Khanh 100/8 1 PB Default for new users
Cluster 8 FAC/coreHPC UCSF IT 16,000/350 50 TB on FAC CoreHPC/FAC. Default for new users.
Cluster 9 Offsite experimental cluster John 64/4 1 PB off-site cluster

Access our clusters from secure machines only. If unsure, ask the sysadmins.