Hewlett Packard Enterprise ProLiant DL385 Gen10 328007 SPECjbb2015-Distributed max-jOPS
125514 SPECjbb2015-Distributed critical-jOPS
Tested by: Hewlett Packard Enterprise Test Sponsor: Hewlett Packard Enterprise Test location: Hewlett Packard Enterprise Test date: Jul 12, 2019
SPEC license #: 3 Hardware Availability: Aug-2019 Software Availability: Jun-2019 Publication: Wed Aug 7 19:56:20 EDT 2019
Benchmark Results Summary
 
Overall Throughput RT curve
Overall SUT (System Under Test) Description
VendorHewlett Packard Enterprise
Vendor URLhttp://hpe.com/
System SourceSingle Supplier
System DesignationServer Rack
Total Systems1
All SUT Systems IdenticalYes
Total Nodes1
All Nodes IdenticalYes
Nodes Per System1
Total Chips2
Total Cores128
Total Threads256
Total Memory Amount (GB)1024
Total OS Images1
SW EnvironmentNon-virtual
 
Hardware hw_1
NameProLiant DL385 Gen10
VendorHewlett Packard Enterprise
Vendor URLhttp://hpe.com/
AvailableAug-2019
ModelProLiant DL385 Gen10
Form Factor2U Rack
CPU NameAMD EPYC 7702
CPU Characteristics64 Core, 2.0 GHz, 256 MB L3 cache (Turbo Boost Technology up to 3.35 GHz)
Number of Systems1
Nodes Per System1
Chips Per System2
Cores Per System128
Cores Per Chip64
Threads Per System256
Threads Per Core2
VersionA40 07/04/2019
CPU Frequency (MHz)2000
Primary Cache32 KB I + 32 KB D on chip per core
Secondary Cache512 KB I+D on chip per core
Tertiary Cache256 MB L3 cache per chip
Other CacheNone
Disk1 x 400 GB SSD SAS
File SystemXFS
Memory Amount (GB)1024
# and size of DIMM(s)16 x 64 GB
Memory Details64 GB 4Rx4 PC4-2933Y-L
# and type of Network Interface Cards (NICs)HPE Ethernet 10Gb 2-port
Power Supply Quantity and Rating (W)2 x 800
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_1
NameSUSE Linux Enterprise Server 15 SP1
VendorSUSE
Vendor URLhttps://www.suse.com/
Version4.12.14-195-default
AvailableJun-2019
Bitness64
NotesNone
Java Virtual Machine jvm_1
NameOpenJDK 12.0.1
VendorOpenJDK (openjdk.java.net)
Vendor URLhttp://openjdk.java.net/
VersionOpenJDK 64-Bit Server VM version 12.0.1
AvailableApr-2019
Bitness64
NotesCommunity Support:
Other Software other_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware hw_2
NameProLiant DL325 Gen10
VendorHewlett Packard Enterprise
Vendor URLhttp://hpe.com/
AvailableAug-2019
ModelProLiant DL325 Gen10
Form Factor1U Rack
CPU NameAMD EPYC 7702P
CPU Characteristics64 Core, 2.0 GHz, 16 MB L3 cache per 4 core (Turbo Boost Technology up to 3.35 GHz)
Number of Systems1
Nodes Per System1
Chips Per System1
Cores Per System64
Cores Per Chip64
Threads Per System128
Threads Per Core2
VersionA41 07/04/2019
CPU Frequency (MHz)2000
Primary Cache32 KB I + 32 KB D on chip per core
Secondary Cache512 KB I+D on chip per core
Tertiary Cache256 MB L3 cache per chip
Other CacheNone
Disk1 x 480 GB SSD SATA
File SystemXFS
Memory Amount (GB)512
# and size of DIMM(s)8 x 64 GB
Memory Details64 GB 4Rx4 PC4-2933Y-L
# and type of Network Interface Cards (NICs)HPE Ethernet 1Gb 4-port
Power Supply Quantity and Rating (W)2 x 800
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_2
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_2
NameSUSE Linux Enterprise Server 15 SP1
VendorSUSE
Vendor URLhttps://www.suse.com/
Version4.12.14-195-default
AvailableJun-2019
Bitness64
NotesNone
Java Virtual Machine jvm_2
NameOpenJDK 12.0.1
VendorOpenJDK (openjdk.java.net)
Vendor URLhttp://openjdk.java.net/
VersionOpenJDK 64-Bit Server VM version 12.0.1
AvailableApr-2019
Bitness64
NotesCommunity Support:
Other Software other_2
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware
OS Images os_Image_1(1)
Hardware Description hw_1
Number of Systems 1
SW Environment Non-virtual
Tuning
  • Workload Profile=High Performance Compute(HPC)
  • Thermal Configuration=Maximum Cooling
  • Performance Determinism=Power Deterministic
  • Memory Patrol Scrubbing=Disabled
  • NUMA memory domains per socket=Four memory domains per socket
  • Last-Level Cache(LLC) As NUMA Node= Enabled
  • Processor Power and Utilization Monitoring = Disabled
  • Memory Pre-Failure Notification = Disabled
Notes None
OS Image os_Image_1
JVM Instances jvm_Backend_1(16)
OS Image Description os_1
Tuning
  • tuned-adm profile=throughput-performance
  • ulimit -n 655350
  • echo 15000000 > /proc/sys/kernel/sched_wakeup_granularity_ns
  • echo 80000000 > /proc/sys/kernel/sched_min_granularity_ns
  • echo 1000 > /proc/sys/kernel/sched_migration_cost_ns
  • echo 16 > /proc/sys/kernel/sched_nr_migrate
  • echo 950000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 10000000 > /proc/sys/kernel/sched_latency_ns
  • echo 10000 > /proc/sys/vm/dirty_expire_centisecs
  • echo 1500 > /proc/sys/vm/dirty_writeback_centisecs
  • echo 40 > /proc/sys/vm/dirty_ratio
  • echo 10 > /proc/sys/vm/dirty_background_ratio
  • echo 10 > /proc/sys/vm/swappiness
  • echo 0 > /proc/sys/kernel/numa_balancing
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
Notes None
JVM Instance jvm_Backend_1
Parts of Benchmark Backend
JVM Instance Description jvm_1
Command Line

-showversion -server -XX:AllocatePrefetchInstr=2 -XX:LargePageSizeInBytes=2m -XX:-UsePerfData -XX:-UseAdaptiveSizePolicy -XX:+AlwaysPreTouch -XX:-UseBiasedLocking -XX:+UseLargePages -XX:+UseParallelOldGC -Xms29g -Xmx29g -Xmn27g -XX:SurvivorRatio=28 -XX:TargetSurvivorRatio=98 -XX:ParallelGCThreads=16 -XX:MaxTenuringThreshold=15 -Xnoclassgc -XX:+PrintGCDetails -XX:InlineSmallCode=10k -XX:MaxGCPauseMillis=300 -XX:ThreadStackSize=1m

Tuning None
Notes

Used numactl to affinitize each Backend JVM to two NUMA nodes.

  • numactl --cpunodebind=0,1 --localalloc
  • numactl --cpunodebind=2,3 --localalloc
  • numactl --cpunodebind=4,5 --localalloc
  • numactl --cpunodebind=6,7 --localalloc
  • numactl --cpunodebind=8,9 --localalloc
  • numactl --cpunodebind=10,11 --localalloc
  • numactl --cpunodebind=12,13 --localalloc
  • numactl --cpunodebind=14,15 --localalloc
  • numactl --cpunodebind=16,17 --localalloc
  • numactl --cpunodebind=18,19 --localalloc
  • numactl --cpunodebind=20,21 --localalloc
  • numactl --cpunodebind=22,23 --localalloc
  • numactl --cpunodebind=24,25 --localalloc
  • numactl --cpunodebind=26,27 --localalloc
  • numactl --cpunodebind=28,29 --localalloc
  • numactl --cpunodebind=30,31 --localalloc
Hardware
OS Images os_Image_2(1)
Hardware Description hw_2
Number of Systems 1
SW Environment Non-virtual
Tuning
  • Workload Profile=High Performance Compute(HPC)
  • Thermal Configuration=Maximum Cooling
  • Performance Determinism=Power Deterministic
  • Memory Patrol Scrubbing=Disabled
  • NUMA memory domains per socket=Four memory domains per socket
  • Last-Level Cache(LLC) As NUMA Node= Enabled
  • Maximum memory Bus Frequency=2933
Notes None
OS Image os_Image_2
JVM Instances jvm_Ctr_1(1), jvm_TxInjector_1(16)
OS Image Description os_2
Tuning
  • tuned-adm profile=throughput-performance
  • ulimit -n 655350
  • echo 15000000 > /proc/sys/kernel/sched_wakeup_granularity_ns
  • echo 80000000 > /proc/sys/kernel/sched_min_granularity_ns
  • echo 1000 > /proc/sys/kernel/sched_migration_cost_ns
  • echo 16 > /proc/sys/kernel/sched_nr_migrate
  • echo 950000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 10000000 > /proc/sys/kernel/sched_latency_ns
  • echo 10000 > /proc/sys/vm/dirty_expire_centisecs
  • echo 1500 > /proc/sys/vm/dirty_writeback_centisecs
  • echo 40 > /proc/sys/vm/dirty_ratio
  • echo 10 > /proc/sys/vm/dirty_background_ratio
  • echo 10 > /proc/sys/vm/swappiness
  • echo 0 > /proc/sys/kernel/numa_balancing
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
Notes None
JVM Instance jvm_Ctr_1
Parts of Benchmark Controller
JVM Instance Description jvm_2
Command Line -Xms3g -Xmx3g -Xmn2g -XX:+UseParallelOldGC -XX:ParallelGCThreads=1 -XX:CICompilerCount=2
Tuning None
Notes numactl --interleave=all
JVM Instance jvm_TxInjector_1
Parts of Benchmark TxInjector
JVM Instance Description jvm_2
Command Line -Xms4g -Xmx4g -Xmn3g -XX:+UseParallelOldGC -XX:ParallelGCThreads=3 -XX:CICompilerCount=2
Tuning None
Notes

Used numactl to affinitize each Transaction Injector JVM to a Numa Node.

  • numactl --cpunodebind=1 --localalloc
  • numactl --cpunodebind=3 --localalloc
  • numactl --cpunodebind=5 --localalloc
  • numactl --cpunodebind=7 --localalloc
  • numactl --cpunodebind=9 --localalloc
  • numactl --cpunodebind=11 --localalloc
  • numactl --cpunodebind=13 --localalloc
  • numactl --cpunodebind=15 --localalloc
  • numactl --cpunodebind=17 --localalloc
  • numactl --cpunodebind=19 --localalloc
  • numactl --cpunodebind=21 --localalloc
  • numactl --cpunodebind=23 --localalloc
  • numactl --cpunodebind=25 --localalloc
  • numactl --cpunodebind=27 --localalloc
  • numactl --cpunodebind=29 --localalloc
  • numactl --cpunodebind=31 --localalloc
max-jOPS = jOPS passed before the First Failure
Pass/Fail Pass Pass Fail Fail Fail
jOPS 324193 328007 331821 335635 339449
critical-jOPS = Geomean ( jOPS @ 10000; 25000; 50000; 75000; 100000; SLAs )
Response time percentile is 99-th
SLA (us) 10000 25000 50000 75000 100000 Geomean
jOPS 85816 108700 127770 146840 177987 125514
  Percentile
  10-th 50-th 90-th 95-th 99-th 100-th
500us 3814 / 7628 - / 3814 - / 3814 - / 3814 - / 3814 - / 3814
1000us 30512 / 34326 11442 / 15256 3814 / 7628 3814 / 7628 - / 3814 - / 3814
5000us 286052 / 289866 91537 / 95351 49582 / 53396 38140 / 41954 30512 / 34326 - / 3814
10000us 293680 / 297494 259354 / 263168 91537 / 95351 91537 / 95351 83909 / 87723 - / 3814
25000us 297494 / 301308 282238 / 286052 240284 / 244098 221214 / 225028 106793 / 110607 19070 / 3814
50000us 301308 / 305122 289866 / 293680 263168 / 266982 236470 / 240284 125863 / 129677 19070 / 3814
75000us 301308 / 305122 289866 / 293680 270796 / 274610 244098 / 247912 144933 / 148747 19070 / 15256
100000us 305122 / 308936 293680 / 297494 274610 / 278424 259354 / 263168 183073 / 175445 19070 / 15256
200000us 312750 / 316564 301308 / 305122 286052 / 289866 278424 / 282238 251726 / 255540 87723 / 15256
500000us 324193 / 328007 316564 / 320379 305122 / 308936 301308 / 305122 293680 / 297494 236470 / 240284
1000000us 328007 / - 324193 / 328007 316564 / 320379 316564 / 320379 312750 / 316564 293680 / 297494
Probes jOPS / Total jOPS
Request Mix Accuracy
Note
(Actual % in the Mix - Expected % in the Mix) must be within:
'Main Tx' limit of +/-5.0% for the requests whose expected % in the mix is >= 10.0%
'Minor Tx' limit of +/-1.0% for the requests whose expected % in the mix is < 10.0%
There were no non-critical failures in Response Time curve building
Delay between status pings
IR/PR Accuracy
This section lists properties only set by user
Property Name Default Controller
specjbb.comm.connect.selector.runner.count 0 1
specjbb.comm.connect.timeouts.connect 60000 700000
specjbb.comm.connect.timeouts.read 60000 700000
specjbb.comm.connect.timeouts.write 60000 700000
specjbb.comm.connect.worker.pool.max 256 111
specjbb.comm.connect.worker.pool.min 1 64
specjbb.controller.host localhost 10.10.0.153
specjbb.customerDriver.threads 64 {=64, probe=64, saturate=64}
specjbb.forkjoin.workers 128 {Tier1=224, Tier2=72, Tier3=32}
specjbb.group.count 1 16
specjbb.mapreducer.pool.size 128 4
View table in csv format
 
Level: COMPLIANCE
Check Agent Result
Check properties on compliance All PASSED
 
Level: CORRECTNESS
Check Agent Result
Compare SM and HQ Inventory All PASSED
High-bound (max attempted) is 381403 IR
High-bound (settled) is 347684 IR