Category:Cluster: Difference between revisions

From DISI
Jump to navigation Jump to search
No edit summary
 
(25 intermediate revisions by the same user not shown)
Line 1: Line 1:
Group members have access to several clusters, generally separate from each other:
== Current Usage Narrative ==
 
As of September 9, 2026:
* Cluster 7: default for new users. Many things work here, and all of Cluster 2 is accessible read-only from Cluster 7.
* Cluster 8: aka CoreHPC/FAC. Katie now has docking and 3D building working there. We have recently expanded to 50 TB.
Legacy:
* Cluster 2: old default, most people are still using C2. New users should generally not be added.
* Cluster 3: aka Wynton, you have about 5 month left. We strongly urge you to a. consolidate your footprint as small as you can on Wynton.  Backup your data to C7 or C2.
* Cluster 0: still in use, supports DUDE and not a lot else.
* Cluster 6: aka Keiser. Rapidly shrinking. If you are still using Keiser cluster, please wind down, transfer files off, and stop.
 
== Set up your own cluster ==
see: [[So you want to set up a lab]] 
 
== New group members ==
* please use [[Cluster 7]] and [[Cluster 8]].
[[cluster exceptions|exceptions]].


{| class="wikitable"
{| class="wikitable"
|-
|-
! Cluster ID !! Description !! How to get started || sge-CPU-cores || Our disk space || Notes
! Cluster ID !! Description !! How to get started || cpu/gpu || Disk space || Notes
|-
| [[Cluster 0]] ||  Legacy UCSF cluster || Closed || 300/0 || 20 TB ||  Legacy support. Retire asap.
|-
| [[Cluster 1]] || Toronto Cluster || Closed||  448/0 ||40 TB || Defunct
|-
| [[Cluster 2]] ||  New UCSF cluster || Closed || 800/52 || 6.5 PB || No new growth. Merge into Cluster 7
|-
|-
| [[Cluster 0]] || Legacy UCSF cluster || Therese || 600 || 20 TB ||  Will shrink in 2014 as equipment is transferred to Cluster 2.
| [[Cluster 3]] || [https://salilab.org/qb3cluster UCSF Shared Cluster] aka Wynton || Closed || 18,000/250 || 6 PB ||  End of life. Use cluster 7 & 8.
|-
|-
| [[Cluster 1]] || Toronto Cluster || Therese || 448 ||40 TB || Ask the [[sysadmin]]s about this cluster for important information.
| [[Cluster 5]] || [https://aws.amazon.com/ Amazon Cloud] || ask John  || unlimited || unlimited || Commercial. Ask us. Watch out for runaway costs.
|-
|-
| [[Cluster 2]] || New UCSF cluster || Teague || 448 || 120 TB || We are just starting to get people to use this cluster. Patience please!
| [[Cluster 6]] || Mike Keiser cluster || Closed || 100/50 || 1 PB || End of life. Being merged into cluster 7.
|-
|-
| [[Cluster 3]]  || [https://salilab.org/qb3cluster UCSF Shared Cluster] ||  Teague -> Josh || 3500 || 120 TB ||  Shared UID space! cross mounted disks!
| [[Cluster 7]]  || New Cluster 7 ||  JJ/Khanh || 100/8 || 1 PB ||  Default for new users
|-
| [[Cluster 8]]  || FAC/coreHPC ||  UCSF IT || 16,000/350 || 50 TB on FAC ||  CoreHPC/FAC. Default for new users.  
|-
| [[Cluster 9]]  || Offsite experimental cluster ||  John || 64/4 || 1 PB ||  off-site cluster
|}
|}


Access to clusters is only from [[Lab Security Policy | secure machines]].
Access our clusters from [[Lab Security Policy | secure machines]] only.  If unsure, ask the [[sysadmin]]s.
 
Commercial cloud clusters are also available:
* Amazon cloud EC2, which we affectionately refer to as [[Cluster 5]]
* Google cloud, which we call [[Cluster 6]].
 
Need advice about which cluster to use? Ask the [[sysadmin]]s.


[[Category:Internal]]
[[Category:Internal]]
[[Category:Topic]]
[[Category:Topic]]

Latest revision as of 18:17, 10 September 2026

Current Usage Narrative

As of September 9, 2026:

  • Cluster 7: default for new users. Many things work here, and all of Cluster 2 is accessible read-only from Cluster 7.
  • Cluster 8: aka CoreHPC/FAC. Katie now has docking and 3D building working there. We have recently expanded to 50 TB.

Legacy:

  • Cluster 2: old default, most people are still using C2. New users should generally not be added.
  • Cluster 3: aka Wynton, you have about 5 month left. We strongly urge you to a. consolidate your footprint as small as you can on Wynton. Backup your data to C7 or C2.
  • Cluster 0: still in use, supports DUDE and not a lot else.
  • Cluster 6: aka Keiser. Rapidly shrinking. If you are still using Keiser cluster, please wind down, transfer files off, and stop.

Set up your own cluster

see: So you want to set up a lab

New group members

exceptions.

Cluster ID Description How to get started cpu/gpu Disk space Notes
Cluster 0 Legacy UCSF cluster Closed 300/0 20 TB Legacy support. Retire asap.
Cluster 1 Toronto Cluster Closed 448/0 40 TB Defunct
Cluster 2 New UCSF cluster Closed 800/52 6.5 PB No new growth. Merge into Cluster 7
Cluster 3 UCSF Shared Cluster aka Wynton Closed 18,000/250 6 PB End of life. Use cluster 7 & 8.
Cluster 5 Amazon Cloud ask John unlimited unlimited Commercial. Ask us. Watch out for runaway costs.
Cluster 6 Mike Keiser cluster Closed 100/50 1 PB End of life. Being merged into cluster 7.
Cluster 7 New Cluster 7 JJ/Khanh 100/8 1 PB Default for new users
Cluster 8 FAC/coreHPC UCSF IT 16,000/350 50 TB on FAC CoreHPC/FAC. Default for new users.
Cluster 9 Offsite experimental cluster John 64/4 1 PB off-site cluster

Access our clusters from secure machines only. If unsure, ask the sysadmins.

Retrieved from "http://wiki.docking.org/index.php?title=Category:Cluster&oldid=17506"