MPI2007 license: | 4 | Test date: | Dec-2013 |
---|---|---|---|
Test sponsor: | SGI | Hardware Availability: | Sep-2013 |
Tested by: | SGI | Software Availability: | Nov-2013 |
Benchmark | Base | Peak | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Ranks | Seconds | Ratio | Seconds | Ratio | Seconds | Ratio | Ranks | Seconds | Ratio | Seconds | Ratio | Seconds | Ratio | |
Results appear in the order in which they were run. Bold underlined text indicates a median measurement. | ||||||||||||||
121.pop2 | 1920 | 80.2 | 48.5 | 76.4 | 50.9 | 76.2 | 51.0 | |||||||
122.tachyon | 1920 | 56.3 | 34.5 | 55.7 | 34.9 | 54.9 | 35.4 | |||||||
125.RAxML | 1920 | 70.2 | 41.6 | 71.2 | 41.0 | 69.8 | 41.8 | |||||||
126.lammps | 1920 | 40.3 | 61.0 | 39.6 | 62.0 | 40.6 | 60.5 | |||||||
128.GAPgeofem | 1920 | 86.9 | 68.3 | 88.1 | 67.4 | 87.3 | 68.0 | |||||||
129.tera_tf | 1920 | 36.6 | 30.0 | 37.9 | 29.0 | 36.9 | 29.8 | |||||||
132.zeusmp2 | 1920 | 27.4 | 77.3 | 27.4 | 77.3 | 27.4 | 77.4 | |||||||
137.lu | 1920 | 28.0 | 150 | 28.4 | 148 | 28.0 | 150 | |||||||
142.dmilc | 1920 | 29.8 | 124 | 29.9 | 123 | 29.9 | 123 | |||||||
143.dleslie | 1920 | 35.2 | 88.0 | 35.1 | 88.4 | 35.9 | 86.4 | |||||||
145.lGemsFDTD | 1920 | 66.6 | 66.2 | 66.9 | 65.9 | 66.6 | 66.2 | |||||||
147.l2wrf2 | 1920 | 81.6 | 101 | 81.7 | 100 | 81.6 | 100 |
Hardware Summary | |
---|---|
Type of System: | Homogeneous |
Compute Node: | SGI ICE X IP-113 Compute Node |
Interconnect: | InfiniBand (MPI and I/O) |
File Server Node: | SGI Modular InfiniteStorage Server |
Total Compute Nodes: | 96 |
Total Chips: | 192 |
Total Cores: | 1920 |
Total Threads: | 3840 |
Total Memory: | 6 TB |
Base Ranks Run: | 1920 |
Minimum Peak Ranks: | -- |
Maximum Peak Ranks: | -- |
Software Summary | |
---|---|
C Compiler: | Intel C++ Composer XE 2011 for Linux, Version 14.0.0.080 Build 20130728 |
C++ Compiler: | Intel C++ Composer XE 2011 for Linux, Version 14.0.0.080 Build 20130728 |
Fortran Compiler: | Intel Fortran Composer XE 2011 for Linux, Version 14.0.0.080 Build 20130728 |
Base Pointers: | 64-bit |
Peak Pointers: | 64-bit |
MPI Library: | SGI MPT 2.09 |
Other MPI Info: | OFED 1.5.2 |
Pre-processors: | None |
Other Software: | None |
Hardware | |
---|---|
Number of nodes: | 96 |
Uses of the node: | compute |
Vendor: | SGI |
Model: | SGI ICE X IP-113 (Intel Xeon E5-2690 v2, 3.0 GHz) |
CPU Name: | Intel Xeon E5-2690 v2 |
CPU(s) orderable: | 1-2 chips |
Chips enabled: | 2 |
Cores enabled: | 20 |
Cores per chip: | 10 |
Threads per core: | 2 |
CPU Characteristics: | Ten Core, 3.0 GHz, 8.0 GT/s QPI Intel Turbo Boost Technology up to 3.60 GHz Hyper-Threading Technology enabled |
CPU MHz: | 3000 |
Primary Cache: | 32 KB I + 32 KB D on chip per core |
Secondary Cache: | 256 KB I+D on chip per core |
L3 Cache: | 25 MB I+D on chip per chip |
Other Cache: | None |
Memory: | 64 GB (8 x 8 GB 2Rx4 PC3-14900R-13, ECC) |
Disk Subsystem: | None |
Other Hardware: | None |
Adapter: | Mellanox MT27500 with ConnectX-3 ASIC (PCIe x8 Gen3 8 GT/s) |
Number of Adapters: | 2 |
Slot Type: | PCIe x8 Gen3 |
Data Rate: | InfiniBand 4x FDR |
Ports Used: | 2 |
Interconnect Type: | InfiniBand |
Software | |
---|---|
Adapter: | Mellanox MT27500 with ConnectX-3 ASIC (PCIe x8 Gen3 8 GT/s) |
Adapter Driver: | OFED-1.5.2 |
Adapter Firmware: | 2.11.312 |
Operating System: | SUSE Linux Enterprise Server 11 SP2, Kernel 3.0.80-0.7-default |
Local File System: | NFSv3 |
Shared File System: | NFSv3 IPoIB |
System State: | Multi-user, run level 3 |
Other Software: | SGI Tempo Compute Node 2.7.3, Build 708rp14.sles11sp2-1305311204 |
Hardware | |
---|---|
Number of nodes: | 1 |
Uses of the node: | fileserver |
Vendor: | SGI |
Model: | SGI Modular InfiniteStorage Server |
CPU Name: | Intel Xeon E5-2670 |
CPU(s) orderable: | 1-2 chips |
Chips enabled: | 2 |
Cores enabled: | 16 |
Cores per chip: | 8 |
Threads per core: | 2 |
CPU Characteristics: | Intel Turbo Boost Technology up to 3.33 GHz Hyper-Threading Technology enabled |
CPU MHz: | 2600 |
Primary Cache: | 32 KB I + 32 KB D on chip per core |
Secondary Cache: | 256 KB I+D on chip per chip |
L3 Cache: | 20 MB I+D on chip per chip |
Other Cache: | None |
Memory: | 128 GB (8 * 16 GB 2Rx4 PC3-12800R-11, ECC) |
Disk Subsystem: | 64.8 TB RAID 6 72 x 900 GB SAS (Western Digital, 10K RPM) |
Other Hardware: | None |
Adapter: | Mellanox MT27500 with ConnectX-3 ASIC (PCIe x8 Gen3 8 GT/s) |
Number of Adapters: | 2 |
Slot Type: | PCIe x8 Gen3 |
Data Rate: | InfiniBand 4x FDR |
Ports Used: | 2 |
Interconnect Type: | InfiniBand |
Software | |
---|---|
Adapter: | Mellanox MT27500 with ConnectX-3 ASIC (PCIe x8 Gen3 8 GT/s) |
Adapter Driver: | OFED-1.5.0 |
Adapter Firmware: | 2.11.312 |
Operating System: | SUSE Linux Enterprise Server 11 SP3 Kernel |
Local File System: | xfs |
Shared File System: | -- |
System State: | Multi-user, run level 3 |
Other Software: | SGI Foundation Software 2.9, Build 700r3.sles11-1004061553 |
Hardware | |
---|---|
Vendor: | Mellanox Technologies and SGI |
Model: | None |
Switch Model: | SGI FDR Integrated IB Switch Blade 2SW9x27 with Mellanox SwitchX device 51000 |
Number of Switches: | 22 |
Number of Ports: | 36 |
Data Rate: | InfiniBand 4x FDR |
Firmware: | 07130007_LLR and 08130007_LLR |
Topology: | Enhanced Hypercube |
Primary Use: | MPI and I/O traffic |
The config file option 'submit' was used.
130.socorro (base): "nullify_ptrs" src.alt was used. Software environment: export MPI_REQUEST_MAX=65536 export MPI_TYPE_MAX=32768 export MPI_BUFS_THRESHOLD=1 export MPI_IB_RAILS=2 export MPI_CONNECTIONS_THRESHOLD=0 ulimit -s unlimited BIOS settings: AMI BIOS version 3.0 Hyper-Threading Technology enabled (default) Intel Turbo Boost Technology enabled (default) Intel Turbo Boost Technology activated in the OS via /etc/init.d/acpid start /etc/init.d/powersaved start powersave -f Job Placement: Each MPI job was assigned to a topologically compact set of nodes, i.e. the minimal needed number of switches was used for each job: 2 switches for up to 180 ranks, 4 switches for up to 320 ranks, 8 switches for 640 ranks, 10 switches for 800 ranks, 16 switches for 1280 ranks, 22 switches for 1920 ranks, and 30 switches for 2560 ranks. Additional notes regarding interconnect: The Infiniband network consists of two independent planes, with half the switches in the system allocated to each plane. I/O traffic is restricted to one plane, while MPI traffic can use both planes.
icc |
126.lammps: | icpc |
ifort |
icc ifort |
121.pop2: | -DSPEC_MPI_CASE_FLAG |