Cluster Details¶
Hardware¶
Monsoon is a capacity-type, Linux-based computer cluster with 4252 cores, 27TB of memory, and 24 NVIDIA GPUs: V100, A100, H200, and RTX 6000. It has been designed to be flexible and handle a diverse set of research requirements. 107 individual systems are interconnected via FDR, and HDR InfiniBand. Cluster nodes have access to 2.3PB of shared storage of type scratch (lustre), and long-term project space (NFS). Monsoon has a measured peak CPU performance of 224 teraflops.
Platform¶
Cluster nodes are x86_64 systems running the Red Hat Enterprise Linux 10 distribution.
Scheduling¶
Job scheduling is performed by SLURM. Job priorities are currently based upon a fair-share policy. For more information on how resources are allocated on Monsoon, visit our page on resource allocation.
GPU Node Details¶
| Node | CPU | Total CPU Count | CPU Socket Count | Base Frequency (GHz) | Boost Frequency (GHz) | RAM (GB) | GPUs | GPU Count | V-RAM Per GPU (GB) |
|---|---|---|---|---|---|---|---|---|---|
| cn1 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 380 | Nvidia V100-SXM2-16GB | 4 | 16 |
| cn2 | AMD EPYC 7542 | 64 | 2 | 3.3 | 500 | Nvidia A100 | 3 | ||
| cn3 | Intel(R) Xeon(R) Platinum 8358 CPU | 64 | 2 | 2.6 | 3.4 | 500 | Nvidia A100 | 4 | 40 |
| cn31 | Intel(R) Xeon(R) CPU E5-2680 v3 | 64 | 2 | 2.5 | 3.3 | 500 | Nvidia H200 | 2 | |
| cn32 | Intel(R) Xeon(R) CPU E5-2680 v4 | 64 | 2 | 2.4 | 3.3 | 500 | Nvidia H200 | 2 | |
| cn33 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 | Nvidia P100-PCIE-16GB | 4 | 16 |
| cn34 | Intel(R) Xeon(R) 6737P CPU | 64 | 2 | 500 | Nvidia H200 MIG | 7 | |||
| cn109 | Intel(R) Xeon(R) 6737P CPU | 64 | 2 | 2.9 | 250 | Nvidia RTX PRO 6000 Blackwell | 2 |
CPU Node Details¶
| Node | CPU | Total CPU Count | CPU Socket Count | Base Frequency (GHz) | Boost Frequency (GHz) | RAM (GiB) |
|---|---|---|---|---|---|---|
| cn4 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 248 |
| cn5 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 248 |
| cn6 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 248 |
| cn7 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 248 |
| cn8 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 248 |
| cn9 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 248 |
| cn10 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 248 |
| cn11 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 248 |
| cn12 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 248 |
| cn13 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 248 |
| cn14 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 248 |
| cn15 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 248 |
| cn16 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 248 |
| cn17 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 248 |
| cn18 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 248 |
| cn19 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 248 |
| cn20 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 248 |
| cn21 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 248 |
| cn22 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 248 |
| cn23 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 248 |
| cn24 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 248 |
| cn25 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 248 |
| cn26 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 248 |
| cn27 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 248 |
| cn28 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 2011 |
| cn29 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 2011 |
| cn30 | AMD EPYC 7542 32-Core Processor | 64 | 2 | 2.9 | 3.4 | 2011 |
| cn35 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn36 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn37 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn38 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn39 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn40 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn41 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn42 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn43 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn44 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn45 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn46 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn47 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn48 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn49 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn50 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn51 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn52 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn53 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn54 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn55 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn56 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn57 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn58 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn59 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn60 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn61 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn62 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn63 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn64 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn65 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn66 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn67 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn68 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn69 | Intel(R) Xeon(R) CPU E5-2680 v4 | 28 | 2 | 2.4 | 3.3 | 123 |
| cn70 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn71 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn72 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn73 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn74 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn75 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn76 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn77 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn78 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn79 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn80 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn81 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn82 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn83 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn84 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn85 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn86 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn87 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn88 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn89 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn90 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn91 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn92 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn93 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn94 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn95 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn96 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn97 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn98 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn99 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn100 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn101 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn102 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn103 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn104 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn105 | Intel(R) Xeon(R) Gold 6132 CPU | 28 | 2 | 2.6 | 3.7 | 187 |
| cn106 | Intel(R) Xeon(R) Gold 6242 CPU | 32 | 2 | 2.8 | 3.9 | 250 |
| cn107 | Intel(R) Xeon(R) Gold 6242 CPU | 32 | 2 | 2.8 | 3.9 | 250 |
| cn108 | Intel(R) Xeon(R) Gold 6242 CPU | 32 | 2 | 2.8 | 3.9 | 250 |