Category:Cluster: Difference between revisions

From DISI
Jump to navigation Jump to search
No edit summary
 
(21 intermediate revisions by the same user not shown)
Line 1: Line 1:
Cluster may refer to:
== Current Usage Narrative ==


* [[About our cluster|Our computer clusters]]. Please use [[Cluster 2]] if you can, otherwise [[Cluster 0]] or [Cluster 1]] if you must.
As of September 9, 2026:
* [[So you want to set up a lab]] - a guide to creating a cluster.  
* Cluster 7: default for new users. Many things work here, and all of Cluster 2 is accessible read-only from Cluster 7.
* Cluster 8: aka CoreHPC/FAC. Katie now has docking and 3D building working there. We have recently expanded to 50 TB.
Legacy:
* Cluster 2: old default, most people are still using C2. New users should generally not be added.  
* Cluster 3: aka Wynton, you have about 5 month left. We strongly urge you to a. consolidate your footprint as small as you can on Wynton.  Backup your data to C7 or C2.
* Cluster 0: still in use, supports DUDE and not a lot else.
* Cluster 6: aka Keiser. Rapidly shrinking. If you are still using Keiser cluster, please wind down, transfer files off, and stop.


You may have access to one of several clusters. Generally, these are kept separate, with some specific [[cluster exceptions|exceptions]].
== Set up your own cluster ==
[[Category:Info]]
see: [[So you want to set up a lab]]


== New group members ==
* please use [[Cluster 7]] and [[Cluster 8]].
[[cluster exceptions|exceptions]].


{| class="wikitable"
{| class="wikitable"
|-
|-
! Cluster ID !! Description !! How to get started || sge-CPU-cores || Our disk space || Notes
! Cluster ID !! Description !! How to get started || cpu/gpu || Disk space || Notes
|-
|-
| [[Cluster 0]] ||  Legacy UCSF cluster || Therese || 590 || 20 TB ||  Will shrink in 2014 as equipment is transferred to Cluster 2.
| [[Cluster 0]] ||  Legacy UCSF cluster || Closed || 300/0 || 20 TB ||  Legacy support. Retire asap.  
|-
|-
| [[Cluster 1]] || Toronto Cluster || Therese ||  448 ||40 TB || Ask the [[sysadmin]]s about this cluster for important information.
| [[Cluster 1]] || Toronto Cluster || Closed||  448/0 ||40 TB || Defunct
|-
|-
| [[Cluster 2]] ||  New UCSF cluster || Teague || 448 || 120 TB || We are just starting to get people to use this cluster. Patience please!
| [[Cluster 2]] ||  New UCSF cluster || Closed || 800/52 || 6.5 PB || No new growth. Merge into Cluster 7
|-
|-
| [[Cluster 3]]  || [https://salilab.org/qb3cluster UCSF Shared Cluster] ||  Teague -> Josh || 6301 || 120 TB ||  Shared UID space! cross mounted disks!
| [[Cluster 3]]  || [https://salilab.org/qb3cluster UCSF Shared Cluster] aka Wynton ||  Closed || 18,000/250 || 6 PB ||  End of life. Use cluster 7 & 8.
|-
|-
| [[Cluster 5]]  || [https://aws.amazon.com/ Amazon Cloud] ||  Teague || unlimited || unlimited ||  Commercial. Ask us. Watch out for bandwidth costs.
| [[Cluster 5]]  || [https://aws.amazon.com/ Amazon Cloud] ||  ask John || unlimited || unlimited ||  Commercial. Ask us. Watch out for runaway costs.
|-
|-
| [[Cluster 6]]  || [https://cloud.google.com/ Google cloud] ||  Teague || unlimited || unlimited ||  Commercial. Ask us. Watch out for bandwidth costs.
| [[Cluster 6]]  || Mike Keiser cluster ||  Closed || 100/50 || 1 PB ||  End of life. Being merged into cluster 7.
|-
| [[Cluster 7]]  || New Cluster 7 ||  JJ/Khanh || 100/8 || 1 PB ||  Default for new users
|-
| [[Cluster 8]] || FAC/coreHPC ||  UCSF IT || 16,000/350 || 50 TB on FAC ||  CoreHPC/FAC. Default for new users.  
|-
| [[Cluster 9]]  || Offsite experimental cluster ||  John || 64/4 || 1 PB ||  off-site cluster
|}
|}


Access our clusters from [[Lab Security Policy | secure machines]] only.  Unsure which cluster to use? Default is [[Cluster 2]]. If unsure, ask the [[sysadmin]]s.
Access our clusters from [[Lab Security Policy | secure machines]] only.  If unsure, ask the [[sysadmin]]s.


[[Category:Internal]]
[[Category:Internal]]
[[Category:Topic]]
[[Category:Topic]]

Latest revision as of 18:17, 10 September 2026

Current Usage Narrative

As of September 9, 2026:

  • Cluster 7: default for new users. Many things work here, and all of Cluster 2 is accessible read-only from Cluster 7.
  • Cluster 8: aka CoreHPC/FAC. Katie now has docking and 3D building working there. We have recently expanded to 50 TB.

Legacy:

  • Cluster 2: old default, most people are still using C2. New users should generally not be added.
  • Cluster 3: aka Wynton, you have about 5 month left. We strongly urge you to a. consolidate your footprint as small as you can on Wynton. Backup your data to C7 or C2.
  • Cluster 0: still in use, supports DUDE and not a lot else.
  • Cluster 6: aka Keiser. Rapidly shrinking. If you are still using Keiser cluster, please wind down, transfer files off, and stop.

Set up your own cluster

see: So you want to set up a lab

New group members

exceptions.

Cluster ID Description How to get started cpu/gpu Disk space Notes
Cluster 0 Legacy UCSF cluster Closed 300/0 20 TB Legacy support. Retire asap.
Cluster 1 Toronto Cluster Closed 448/0 40 TB Defunct
Cluster 2 New UCSF cluster Closed 800/52 6.5 PB No new growth. Merge into Cluster 7
Cluster 3 UCSF Shared Cluster aka Wynton Closed 18,000/250 6 PB End of life. Use cluster 7 & 8.
Cluster 5 Amazon Cloud ask John unlimited unlimited Commercial. Ask us. Watch out for runaway costs.
Cluster 6 Mike Keiser cluster Closed 100/50 1 PB End of life. Being merged into cluster 7.
Cluster 7 New Cluster 7 JJ/Khanh 100/8 1 PB Default for new users
Cluster 8 FAC/coreHPC UCSF IT 16,000/350 50 TB on FAC CoreHPC/FAC. Default for new users.
Cluster 9 Offsite experimental cluster John 64/4 1 PB off-site cluster

Access our clusters from secure machines only. If unsure, ask the sysadmins.