SPEC(R) MPIM2007 Summary SGI SGI ICE X (Intel Xeon E5-2690 v3, 2.6 GHz) Thu Jul 24 14:38:39 2014 MPI2007 License: 14 Test date: Jul-2014 Test sponsor: SGI Hardware availability: Sep-2014 Tested by: SGI Software availability: Apr-2014 Base Base Base Peak Peak Peak Benchmarks Ranks Run Time Ratio Ranks Run Time Ratio -------------- ------ --------- --------- ------ --------- --------- 104.milc 800 10.7 146 S 800 10.7 146 S 104.milc 800 10.7 146 * 800 10.7 146 * 104.milc 800 10.7 146 S 800 10.7 146 S 107.leslie3d 800 28.8 181 S 800 28.8 181 S 107.leslie3d 800 28.8 182 * 800 28.8 182 * 107.leslie3d 800 27.9 187 S 800 27.9 187 S 113.GemsFDTD 800 219 28.8 * 160 146 43.2 * 113.GemsFDTD 800 219 28.8 S 160 146 43.2 S 113.GemsFDTD 800 219 28.8 S 160 146 43.1 S 115.fds4 800 10.7 182 S 800 10.7 182 S 115.fds4 800 10.9 179 * 800 10.9 179 * 115.fds4 800 10.9 179 S 800 10.9 179 S 121.pop2 800 74.3 55.5 * 800 74.3 55.5 * 121.pop2 800 74.3 55.5 S 800 74.3 55.5 S 121.pop2 800 74.5 55.4 S 800 74.5 55.4 S 122.tachyon 800 22.8 123 S 800 22.8 123 S 122.tachyon 800 22.8 123 S 800 22.8 123 S 122.tachyon 800 22.8 123 * 800 22.8 123 * 126.lammps 800 99.1 29.4 * 800 99.1 29.4 * 126.lammps 800 101 28.8 S 800 101 28.8 S 126.lammps 800 99.0 29.4 S 800 99.0 29.4 S 127.wrf2 800 29.6 263 S 800 29.6 263 S 127.wrf2 800 29.6 263 * 800 29.6 263 * 127.wrf2 800 29.4 265 S 800 29.4 265 S 128.GAPgeofem 800 9.04 228 S 800 9.04 228 S 128.GAPgeofem 800 9.18 225 * 800 9.18 225 * 128.GAPgeofem 800 9.21 224 S 800 9.21 224 S 129.tera_tf 800 23.2 119 * 800 23.2 119 * 129.tera_tf 800 23.2 119 S 800 23.2 119 S 129.tera_tf 800 23.3 119 S 800 23.3 119 S 130.socorro 800 35.3 108 * 800 35.3 108 * 130.socorro 800 35.3 108 S 800 35.3 108 S 130.socorro 800 35.2 108 S 800 35.2 108 S 132.zeusmp2 800 24.2 128 * 800 24.2 128 * 132.zeusmp2 800 24.1 129 S 800 24.1 129 S 132.zeusmp2 800 24.2 128 S 800 24.2 128 S 137.lu 800 23.7 155 * 800 23.7 155 * 137.lu 800 23.7 155 S 800 23.7 155 S 137.lu 800 23.6 156 S 800 23.6 156 S ============================================================================== 104.milc 800 10.7 146 * 800 10.7 146 * 107.leslie3d 800 28.8 182 * 800 28.8 182 * 113.GemsFDTD 800 219 28.8 * 160 146 43.2 * 115.fds4 800 10.9 179 * 800 10.9 179 * 121.pop2 800 74.3 55.5 * 800 74.3 55.5 * 122.tachyon 800 22.8 123 * 800 22.8 123 * 126.lammps 800 99.1 29.4 * 800 99.1 29.4 * 127.wrf2 800 29.6 263 * 800 29.6 263 * 128.GAPgeofem 800 9.18 225 * 800 9.18 225 * 129.tera_tf 800 23.2 119 * 800 23.2 119 * 130.socorro 800 35.3 108 * 800 35.3 108 * 132.zeusmp2 800 24.2 128 * 800 24.2 128 * 137.lu 800 23.7 155 * 800 23.7 155 * SPECmpiM_base2007 112 SPECmpiM_peak2007 115 BENCHMARK DETAILS ----------------- Type of System: Homogeneous Total Compute Nodes: 40 Total Chips: 80 Total Cores: 960 Total Threads: 960 Total Memory: 5 TB Base Ranks Run: 800 Minimum Peak Ranks: 160 Maximum Peak Ranks: 800 C Compiler: Intel C++ Composer XE 2013 for Linux, Version 14.0.3.174 Build 20140422 C++ Compiler: Intel C++ Composer XE 2013 for Linux Version 14.0.3.174 Build 20140422 Fortran Compiler: Intel Fortran Composer XE 2013 for Linux, Version 14.0.3.174 Build 20140422 Base Pointers: 64-bit Peak Pointers: Not Applicable MPI Library: SGI MPT 2.09 Patch 11049 Other MPI Info: OFED 1.5.4 Pre-processors: None Other Software: None Node Description: SGI ICE X IP-131 Compute Node =============================================== HARDWARE -------- Number of nodes: 40 Uses of the node: compute Vendor: SGI Model: SGI ICE X (Intel Xeon E6-2690 v3, 2.6 GHz) CPU Name: Intel Xeon E5-2690 v3 CPU(s) orderable: 1-2 chips Chips enabled: 2 Cores enabled: 24 Cores per chip: 12 Threads per core: 1 CPU Characteristics: 12 Core, 2.60 GHz, 9.6 GT/s QPI Intel Turbo Boost Technology up to 3.50 GHz Hyper-Threading Technology disabled CPU MHz: 2600 Primary Cache: 32 KB I + 32 KB D on chip per core Secondary Cache: 256 KB I+D on chip per core L3 Cache: 30 MB I+D on chip per chip Other Cache: None Memory: 128 GB (8 x 16 GB 2Rx4 PC4-17000R-15, ECC) Disk Subsystem: None Other Hardware: None Adapter: Mellanox MT27500 with ConnectX-3 ASIC (PCIe x8 Gen3 8 GT/s) Number of Adapters: 2 Slot Type: PCIe x8 Gen3 Data Rate: InfiniBand 4x FDR Ports Used: 2 Interconnect Type: InfiniBand SOFTWARE -------- Adapter: Mellanox MT27500 with ConnectX-3 ASIC (PCIe x8 Gen3 8 GT/s) Adapter Driver: OFED-1.5.4 Adapter Firmware: 2.30.3000 Operating System: SUSE Linux Enterprise Server 11 SP3 (x86_64), Kernel 3.0.93-0.8-default Local File System: NFSv3 Shared File System: NFSv3 IPoIB System State: Multi-user, run level 3 Other Software: SGI Tempo Service Node 2.8.1, Build 709rp49.sles11sp3-1402182002 Node Description: SGI Rackable C1103-TY12 ========================================= HARDWARE -------- Number of nodes: 1 Uses of the node: fileserver Vendor: SGI Model: SGI Rackable C1103-TY12 (Intel Xeon X5670, 2.93 GHz) CPU Name: Intel Xeon X5670 CPU(s) orderable: 1-2 chips Chips enabled: 2 Cores enabled: 12 Cores per chip: 6 Threads per core: 2 CPU Characteristics: Intel Turbo Boost Technology up to 3.33 GHz Hyper-Threading Technology enabled CPU MHz: 2933 Primary Cache: 32 KB I + 32 KB D on chip per core Secondary Cache: 256 KB I+D on chip per chip L3 Cache: 12 MB I+D on chip per chip Other Cache: None Memory: 96 GB (12 * 8 GB 2Rx4 PC3-10600R-9, ECC) Disk Subsystem: 12 TB RAID 6 12 x 1 TB SATA (Seagate Constellation, 7200RPM) Other Hardware: None Adapter: Mellanox MT27500 with ConnectX-3 ASIC (PCIe x8 Gen3 8 GT/s) Number of Adapters: 2 Slot Type: PCIe x8 Gen3 Data Rate: InfiniBand 4x FDR Ports Used: 2 Interconnect Type: InfiniBand SOFTWARE -------- Adapter: Mellanox MT27500 with ConnectX-3 ASIC (PCIe x8 Gen3 8 GT/s) Adapter Driver: OFED-1.5.2 Adapter Firmware: 2.30.3000 Operating System: SUSE Linux Enterprise Server 11 SP1 (x86_64), Kernel 2.6.32.46-0.3-default Local File System: xfs Shared File System: -- System State: Multi-user, run level 3 Other Software: SGI Foundation Software 2.5, Build 705r10.sles11-1110192111 Interconnect Description: InfiniBand (MPI and I/O) ================================================== HARDWARE -------- Vendor: Mellanox Technologies and SGI Model: None Switch Model: SGI FDR Integrated IB Switch Blade 2SW9x27 with Mellanox SwitchX device 51000 Number of Switches: 10 Number of Ports: 36 Data Rate: InfiniBand 4x FDR Firmware: 09.02.3000 Topology: Enhanced Hypercube Primary Use: MPI and I/O traffic Submit Notes ------------ The config file option 'submit' was used. General Notes ------------- Software environment: export MPI_REQUEST_MAX=65536 export MPI_TYPE_MAX=32768 export MPI_IB_RAILS=2 export MPI_CONNECTIONS_THRESHOLD=0 ulimit -s unlimited BIOS settings: AMI BIOS version DY2E6044 Hyper-Threading Technology disabled Intel Turbo Boost Technology enabled (default) Intel Turbo Boost Technology activated with modprobe acpi_cpufreq cpupower frequency-set -u 2601MHz -d 2601MHz -g performance Job Placement: Ten ranks were assigned to each CPU chip, leaving 2 cores per chip idle. There were 10 switches used with a topologically compact configuration. Additional notes regarding interconnect: The Infiniband network consists of two independent planes, with half the switches in the system allocated to each plane. I/O traffic is restricted to one plane, while MPI traffic can use both planes. Peak run: In the peak run, some benchmarks used different number of ranks from base. It is the only difference between base and peak. Compiler Invocation ------------------- C benchmarks: icc C++ benchmarks: 126.lammps: icpc Fortran benchmarks: ifort Benchmarks using both Fortran and C: icc ifort Portability Flags ----------------- 121.pop2: -DSPEC_MPI_CASE_FLAG 127.wrf2: -DSPEC_MPI_CASE_FLAG -DSPEC_MPI_LINUX 130.socorro: -assume nostd_intent_in Base Optimization Flags ----------------------- C benchmarks: -O3 -xCORE-AVX2 -no-prec-div C++ benchmarks: 126.lammps: -O3 -xCORE-AVX2 -no-prec-div -ansi-alias Fortran benchmarks: -O3 -xCORE-AVX2 -no-prec-div Benchmarks using both Fortran and C: -O3 -xCORE-AVX2 -no-prec-div Peak Optimization Flags ----------------------- C benchmarks: 104.milc: basepeak = yes 122.tachyon: basepeak = yes C++ benchmarks: 126.lammps: basepeak = yes Fortran benchmarks: 107.leslie3d: basepeak = yes 113.GemsFDTD: -O3 -xCORE-AVX2 -no-prec-div 129.tera_tf: basepeak = yes 137.lu: basepeak = yes Benchmarks using both Fortran and C: 115.fds4: basepeak = yes 121.pop2: basepeak = yes 127.wrf2: basepeak = yes 128.GAPgeofem: basepeak = yes 130.socorro: basepeak = yes 132.zeusmp2: basepeak = yes Other Flags ----------- C benchmarks: -lmpi C++ benchmarks: 126.lammps: -lmpi Fortran benchmarks: -lmpi Benchmarks using both Fortran and C: -lmpi The flags file that was used to format this result can be browsed at http://www.spec.org/mpi2007/flags/SGI_x86_64_Intel14_flags.20140908.html You can also download the XML flags source by saving the following link: http://www.spec.org/mpi2007/flags/SGI_x86_64_Intel14_flags.20140908.xml SPEC and SPEC MPI are registered trademarks of the Standard Performance Evaluation Corporation. All other brand and product names appearing in this result are trademarks or registered trademarks of their respective holders. ----------------------------------------------------------------------------- For questions about this result, please contact the tester. For other inquiries, please contact webmaster@spec.org. Copyright 2006-2010 Standard Performance Evaluation Corporation Tested with SPEC MPI2007 v2.0.1. Report generated on Mon Sep 8 13:46:16 2014 by MPI2007 ASCII formatter v1463. Originally published on 8 September 2014.