Category:Cluster: Difference between revisions

From DISI
Jump to navigation Jump to search
No edit summary
(asdf)
 
(22 intermediate revisions by the same user not shown)
Line 1: Line 1:
Group members have access to several clusters, generally separate from each other:
== Current Usage Narrative ==
 
As of July 17, 2026:
* Cluster 2 is your default choice for local compute. Most things work here.
* Cluster 3 aka Wynton is your default for "at scale" calculations. Most of ZINC and most software is here.  Cluster 3 will be going away in 2027. We'
're not sure exactly when.
* Cluster 7 should be your default choice for local compute, except it still lacks some features and software. This is the cluster that will grow most between now and 2030 assuming we survive our leaders.
* Cluster 8 will be your default choice for "at scale" calculations by 2027. For now, you can get access, and there is spare capacity.
* Cluster 0 still exists, but is "legacy" and is being wound up.
* Cluster 6 aka Keiser still exists, but is "legacy" and is being wound up.
* Cluster 1 has not existed since 2014. ixnay onyay ethay uestionsqay.
 
== Set up your own cluster ==
see: [[So you want to set up a lab]] 
 
== New group members ==
please use [[Cluster 7]].
Most group members as of Feb 2026 are using [[Cluster 2]].
A few are using [[Cluster 7]], just ask us. Cluster 8 (coreHPC) is available.
[[cluster exceptions|exceptions]].
 
** the cpu/gpu and disk spaces are guesses and no effort has been made to make them accurate. If you know the correct numbers, please update and indicate this **


{| class="wikitable"
{| class="wikitable"
|-
|-
! Cluster ID !! Description !! How to get started || Notes
! Cluster ID !! Description !! How to get started || cpu/gpu || Disk space || Notes
|-
|-
| [[Cluster 0]] ||  Legacy UCSF cluster || Therese || Will shrink in 2014 as equipment is transferred to Cluster 2.
| [[Cluster 0]] ||  Legacy UCSF cluster || Closed || 300/0 || 20 TB ||  Legacy support. Retire asap.  
|-
|-
| [[Cluster 1]] || Toronto Cluster || Therese || Ask the [[sysadmin]]s about this cluster for important information.
| [[Cluster 1]] || Toronto Cluster || Closed|| 448/0 ||40 TB || Defunct
|-
|-
| [[Cluster 2]] ||  New UCSF cluster || Teague || We are just starting to get people to use this cluster. Patience please!
| [[Cluster 2]] ||  New UCSF cluster || Closed || 800/52 || 6.5 PB || No new growth. Merge into Cluster 7
|-
|-
| [[Cluster 3]]  || [https://salilab.org/qb3cluster UCSF Shared Cluster] ||  Teague -> Josh || Shared UID space! cross mounted disks!
| [[Cluster 3]]  || [https://salilab.org/qb3cluster UCSF Shared Cluster] aka Wynton ||  Closed || 18,000/250 || 6 PB ||  Wynton is end of life. Merging with cluster 8.
|-
| [[Cluster 5]]  || [https://aws.amazon.com/ Amazon Cloud] ||  ask John  || unlimited || unlimited ||  Commercial. Ask us. Watch out for bandwidth costs.
|-
| [[Cluster 6]]  || Mike Keiser cluster ||  Closed || 100/50 || 1 PB ||  End of life. being merged into cluster 7
|-
| [[Cluster 7]]  || New Cluster 7 ||  JJ/Khanh || 100/8 || 1 PB ||  Future main private cluster for our group
|-
| [[Cluster 8]]  || FAC/coreHPC ||  UCSF IT || 16,000/350 || 1 PB ||  UCSF replacement for Wynton
|-
| [[Cluster 9]]  || Offsite experimental cluster ||  John || 64/4 || 1 PB ||  off-site cluster
|}
|}


Access to clusters is only from [[Lab Security Policy | secure machines]].
Access our clusters from [[Lab Security Policy | secure machines]] onlyIf unsure, ask the [[sysadmin]]s.
 
Commercial cloud clusters are also available:
* Amazon cloud EC2, which we affectionately refer to as [[Cluster 5]]
* Google cloud, which we call [[Cluster 6]].
 
Need advice about which cluster to use? Ask the [[sysadmin]]s.


[[Category:Internal]]
[[Category:Internal]]
[[Category:Topic]]
[[Category:Topic]]

Latest revision as of 20:20, 17 July 2026

Current Usage Narrative

As of July 17, 2026:

  • Cluster 2 is your default choice for local compute. Most things work here.
  • Cluster 3 aka Wynton is your default for "at scale" calculations. Most of ZINC and most software is here. Cluster 3 will be going away in 2027. We'

're not sure exactly when.

  • Cluster 7 should be your default choice for local compute, except it still lacks some features and software. This is the cluster that will grow most between now and 2030 assuming we survive our leaders.
  • Cluster 8 will be your default choice for "at scale" calculations by 2027. For now, you can get access, and there is spare capacity.
  • Cluster 0 still exists, but is "legacy" and is being wound up.
  • Cluster 6 aka Keiser still exists, but is "legacy" and is being wound up.
  • Cluster 1 has not existed since 2014. ixnay onyay ethay uestionsqay.

Set up your own cluster

see: So you want to set up a lab

New group members

please use Cluster 7. Most group members as of Feb 2026 are using Cluster 2. A few are using Cluster 7, just ask us. Cluster 8 (coreHPC) is available. exceptions.

    • the cpu/gpu and disk spaces are guesses and no effort has been made to make them accurate. If you know the correct numbers, please update and indicate this **
Cluster ID Description How to get started cpu/gpu Disk space Notes
Cluster 0 Legacy UCSF cluster Closed 300/0 20 TB Legacy support. Retire asap.
Cluster 1 Toronto Cluster Closed 448/0 40 TB Defunct
Cluster 2 New UCSF cluster Closed 800/52 6.5 PB No new growth. Merge into Cluster 7
Cluster 3 UCSF Shared Cluster aka Wynton Closed 18,000/250 6 PB Wynton is end of life. Merging with cluster 8.
Cluster 5 Amazon Cloud ask John unlimited unlimited Commercial. Ask us. Watch out for bandwidth costs.
Cluster 6 Mike Keiser cluster Closed 100/50 1 PB End of life. being merged into cluster 7
Cluster 7 New Cluster 7 JJ/Khanh 100/8 1 PB Future main private cluster for our group
Cluster 8 FAC/coreHPC UCSF IT 16,000/350 1 PB UCSF replacement for Wynton
Cluster 9 Offsite experimental cluster John 64/4 1 PB off-site cluster

Access our clusters from secure machines only. If unsure, ask the sysadmins.