|
Lenovo Global Technology ThinkSystem SR665 V3 (AMD EPYC 9654) |
SPEChpc 2021_tny_base = 38.2 |
|
SPEChpc 2021_tny_peak = 38.2 |
| hpc2021 License: | 28 | Test Date: | Jan-2023 |
|---|---|---|---|
| Test Sponsor: | Lenovo Global Technology | Hardware Availability: | Nov-2022 |
| Tested by: | Lenovo Global Technology | Software Availability: | Nov-2022 |
Benchmark result graphs are available in the PDF report.
Results Table
| Benchmark | Base | Peak | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Model | Ranks | Thrds/Rnk | Seconds | Ratio | Seconds | Ratio | Seconds | Ratio | Model | Ranks | Thrds/Rnk | Seconds | Ratio | Seconds | Ratio | Seconds | Ratio | |
| SPEChpc 2021_tny_base | 38.2 | |||||||||||||||||
| SPEChpc 2021_tny_peak | 38.2 | |||||||||||||||||
| Results appear in the order in which they were run. Bold underlined text indicates a median measurement. | ||||||||||||||||||
| 505.lbm_t | OMP | 72 | 8 | 48.0 | 46.8 | 43.4 | 51.8 | 42.2 | 53.3 | OMP | 72 | 8 | 48.0 | 46.8 | 43.4 | 51.8 | 42.2 | 53.3 |
| 513.soma_t | OMP | 72 | 8 | 79.5 | 46.5 | 78.7 | 47.0 | 83.2 | 44.5 | OMP | 72 | 8 | 79.5 | 46.5 | 78.7 | 47.0 | 83.2 | 44.5 |
| 518.tealeaf_t | OMP | 72 | 8 | 21.3 | 77.3 | 21.1 | 78.1 | 21.9 | 75.5 | OMP | 72 | 8 | 21.3 | 77.3 | 21.1 | 78.1 | 21.9 | 75.5 |
| 519.clvleaf_t | OMP | 72 | 8 | 76.4 | 21.6 | 100 | 16.4 | 87.7 | 18.8 | OMP | 72 | 8 | 76.4 | 21.6 | 100 | 16.4 | 87.7 | 18.8 |
| 521.miniswp_t | OMP | 72 | 8 | 68.4 | 23.4 | 67.9 | 23.6 | 68.4 | 23.4 | OMP | 72 | 8 | 68.4 | 23.4 | 67.9 | 23.6 | 68.4 | 23.4 |
| 528.pot3d_t | OMP | 72 | 8 | 60.9 | 34.9 | 60.8 | 34.9 | 60.0 | 35.4 | OMP | 72 | 8 | 60.9 | 34.9 | 60.8 | 34.9 | 60.0 | 35.4 |
| 532.sph_exa_t | OMP | 72 | 8 | 81.2 | 24.0 | 81.7 | 23.9 | 81.0 | 24.1 | OMP | 72 | 8 | 81.2 | 24.0 | 81.7 | 23.9 | 81.0 | 24.1 |
| 534.hpgmgfv_t | OMP | 72 | 8 | 55.1 | 21.3 | 53.0 | 22.2 | 54.0 | 21.8 | OMP | 72 | 8 | 55.1 | 21.3 | 53.0 | 22.2 | 54.0 | 21.8 |
| 535.weather_t | OMP | 72 | 8 | 27.6 | 117 | 27.6 | 117 | 28.3 | 114 | OMP | 72 | 8 | 27.6 | 117 | 27.6 | 117 | 28.3 | 114 |
| Hardware Summary | |
|---|---|
| Type of System: | Homogeneous Cluster |
| Compute Node: | ThinkSystem SR665 V3 |
| Interconnect: | Nvidia Mellanox ConnectX-6 HDR |
| Compute Nodes Used: | 3 |
| Total Chips: | 6 |
| Total Cores: | 576 |
| Total Threads: | 1152 |
| Total Memory: | 4608 GB |
| Max. Peak Threads: | 8 |
| Software Summary | |
|---|---|
| Compiler: | Intel oneAPI Compiler 2022.1.0 |
| MPI Library: | Intel MPI Library for Linux OS, Build 20220227 |
| Base Parallel Model: | OMP |
| Base Ranks Run: | 72 |
| Base Threads Run: | 8 |
| Peak Parallel Models: | OMP |
| Minimum Peak Ranks: | 72 |
| Maximum Peak Ranks: | 72 |
| Max. Peak Threads: | 8 |
| Min. Peak Threads: | 8 |
Node Description: ThinkSystem SR665 V3
| Hardware | |
|---|---|
| Number of nodes: | 3 |
| Uses of the node: | Compute |
| Vendor: | Lenovo Global Technology |
| Model: | ThinkSystem SR665 V3 |
| CPU Name: | AMD EPYC 9654 |
| CPU(s) orderable: | 1,2 chips |
| Chips enabled: | 2 |
| Cores enabled: | 192 |
| Cores per chip: | 96 |
| Threads per core: | 2 |
| CPU Characteristics: | Max Boost Clock up to 3.7 GHz |
| CPU MHz: | 2400 |
| Primary Cache: | 32 KB I + 32 KB D on chip per core |
| Secondary Cache: | 1 MB I+D on chip per core |
| L3 Cache: | 384 MB I+D on chip per chip 32 MB shared / 8 cores |
| Other Cache: | None |
| Memory: | 1536 GB (24 x 64 GB 2Rx4 PC5-4800B-R) |
| Disk Subsystem: | 1x ThinkSystem 2.5" 5300 480GB SSD |
| Other Hardware: | None |
| Adapter: | Nvidia Mellanox ConnectX-6 HDR |
| Number of Adapters: | 1 |
| Slot Type: | PCI-Express 4.0 x16 |
| Data Rate: | 200 Gb/s |
| Ports Used: | 1 |
| Interconnect Type: | ConnectX-6 HDR |
| Software | |
|---|---|
| Adapter: | Nvidia Mellanox ConnectX-6 HDR |
| Adapter Driver: | 5.7-1.0.2 |
| Adapter Firmware: | 20.28.1002 |
| Operating System: | Red Hat Enterprise Linux Server release 8.6, Kernel 4.18.0-372.9.1.el8.x86_64 |
| Local File System: | xfs |
| Shared File System: | None |
| System State: | Multi-user, run level 3 |
| Other Software: | None |
Interconnect Description: Nvidia Mellanox ConnectX-6 HDR
| Hardware | |
|---|---|
| Vendor: | Nvidia |
| Model: | Nvidia Mellanox ConnectX-6 HDR |
| Switch Model: | QM8700 |
| Number of Switches: | 1 |
| Number of Ports: | 40 |
| Data Rate: | 200 Gb/s |
| Firmware: | 3.9.0606 |
| Topology: | Mesh |
| Primary Use: | MPI Traffic, NFS Access |
| Software |
|---|
Submit Notes
The config file option 'submit' was used.
submit = mpiexec -hostfile $[top]/3nodes -np ranks -genv OMP_NUM_THREADS=$threads -ppn %{NRNK} $command
Compiler Version Notes
==============================================================================
FC 519.clvleaf_t(base) 528.pot3d_t(base) 535.weather_t(base)
------------------------------------------------------------------------------
Intel(R) Fortran Compiler for applications running on Intel(R) 64, Version
2022.1.0 Build 20220316
Copyright (C) 1985-2022 Intel Corporation. All rights reserved.
ifx: command line error: no files specified; for help type "ifx -help"
------------------------------------------------------------------------------
==============================================================================
CC 505.lbm_t(base) 513.soma_t(base) 518.tealeaf_t(base) 521.miniswp_t(base)
534.hpgmgfv_t(base)
------------------------------------------------------------------------------
Intel(R) oneAPI DPC++/C++ Compiler for applications running on Intel(R) 64,
Version 2022.1.0 Build 20220316
Copyright (C) 1985-2022 Intel Corporation. All rights reserved.
clang: warning: -Z-reserved-lib-stdc++: 'linker' input unused
[-Wunused-command-line-argument]
------------------------------------------------------------------------------
==============================================================================
CXXC 532.sph_exa_t(base)
------------------------------------------------------------------------------
Intel(R) oneAPI DPC++/C++ Compiler for applications running on Intel(R) 64,
Version 2022.1.0 Build 20220316
Copyright (C) 1985-2022 Intel Corporation. All rights reserved.
clang: warning: -Z-reserved-lib-stdc++: 'linker' input unused
[-Wunused-command-line-argument]
------------------------------------------------------------------------------
Base Compiler Invocation
C benchmarks:
| mpiicc -cc=icx |
C++ benchmarks:
| mpiicpc -cxx=icx |
Fortran benchmarks:
| mpiifort -fc=ifx |
Base Portability Flags
| 505.lbm_t: | -lstdc++ |
| 513.soma_t: | -lstdc++ -DSPEC_NO_VAR_ARRAY_REDUCE |
| 518.tealeaf_t: | -lstdc++ |
| 519.clvleaf_t: | -lstdc++ |
| 521.miniswp_t: | -lstdc++ |
| 528.pot3d_t: | -lstdc++ |
| 532.sph_exa_t: | -lstdc++ |
| 534.hpgmgfv_t: | -lstdc++ |
| 535.weather_t: | -lstdc++ |
Base Optimization Flags
C benchmarks:
| -Ofast -mprefer-vector-width=512 -march=core-avx2 -ipo -fiopenmp -ansi-alias |
C++ benchmarks:
| -Ofast -mprefer-vector-width=512 -march=core-avx2 -ipo -fiopenmp -ansi-alias |
Fortran benchmarks:
| -Ofast -mprefer-vector-width=512 -march=core-avx2 -ipo -fiopenmp -nostandard-realloc-lhs -align array64byte |
Base Other Flags
C benchmarks (except as noted below):
| -Ispecmpitime | |
| 521.miniswp_t: | -Ispecmpitime/ |
| 534.hpgmgfv_t: | -Ispecmpitime |
C++ benchmarks:
| -Ispecmpitime |
Fortran benchmarks:
| 519.clvleaf_t: | -Ispecmpitime |
Peak Optimization Flags
C benchmarks:
| 505.lbm_t: | basepeak = yes |
| 513.soma_t: | basepeak = yes |
| 518.tealeaf_t: | basepeak = yes |
| 521.miniswp_t: | basepeak = yes |
| 534.hpgmgfv_t: | basepeak = yes |
C++ benchmarks:
| 532.sph_exa_t: | basepeak = yes |
Fortran benchmarks:
| 519.clvleaf_t: | basepeak = yes |
| 528.pot3d_t: | basepeak = yes |
| 535.weather_t: | basepeak = yes |