Dell Inc. PowerEdge R650xs 205936 SPECjbb2015-Distributed max-jOPS
157043 SPECjbb2015-Distributed critical-jOPS
Tested by: Dell Inc. Test Sponsor: Dell Inc. Test location: Round Rock, TX Test date: Apr 24,2023
SPEC license #: 6573 Hardware Availability: Jul-2021 Software Availability: Jan-2023 Publication: Thu Jun 15 12:31:48 EDT 2023
Benchmark Results Summary
 
Overall Throughput RT curve
Overall SUT (System Under Test) Description
VendorDell Inc.
Vendor URLhttp://www.dell.com/
System SourceSingle Supplier
System DesignationServer Rack
Total Systems1
All SUT Systems IdenticalYES
Total Nodes1
All Nodes IdenticalYES
Nodes Per System1
Total Chips2
Total Cores64
Total Threads128
Total Memory Amount (GB)1024
Total OS Images1
SW EnvironmentNon-virtual
 
Hardware hw_1
NameDell Inc. PowerEdge R650xs
VendorDell Inc.
Vendor URLhttp://www.dell.com/
AvailableJul-2021
ModelPowerEdge R650xs
Form Factor1U Rack
CPU NameIntel Xeon Gold 6338
CPU Characteristics32 core, 2.00 GHz, 48 MB L3 Cache (Turbo boost Technology up to 3.20 GHz)
Number of Systems1
Nodes Per System1
Chips Per System2
Cores Per System64
Cores Per Chip32
Threads Per System128
Threads Per Core2
Version1.6.5
CPU Frequency (MHz)2000
Primary Cache32 KB (I) + 48 KB (D) per core
Secondary Cache1.25 MB (I+D) per core
Tertiary Cache48 MB (I+D) on chip per chip
Other CacheNone
Disk1X WD 250GB SATA SSD
File Systemxfs
Memory Amount (GB)1024
# and size of DIMM(s)16 x 64 GB
Memory Details64 GB RDIMM 2Rx4 PC4-3200AA-R (slots A1-8, B1-8 populated)
# and type of Network Interface Cards (NICs)1 x Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe 1Gb/s Dual Port
Power Supply Quantity and Rating (W)1 x 800
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_1
NameSUSE Linux Enterprise Server 15 SP4
VendorSUSE
Vendor URLhttp://www.suse.com/
Version5.14.21-150400.22-default
AvailableJun-2022
Bitness64
NotesNone
Java Virtual Machine jvm_1
NameOracle Java SE 17.0.6
VendorOracle
Vendor URLhttp://www.oracle.com/
VersionJava HotSpot 64-bit Server VM, version 17.0.6
AvailableJan-2023
Bitness64
NotesNone
Other Software other_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware hw_2
NameDell Inc. PowerEdge R650xs
VendorDell Inc.
Vendor URLhttp://www.dell.com/
AvailableJul-2021
ModelPowerEdge R650xs
Form Factor1U Rack
CPU NameIntel Xeon Gold 6338
CPU Characteristics32 core, 2.00 GHz, 48 MB L3 Cache (Turbo boost Technology up to 3.20 GHz)
Number of Systems1
Nodes Per System1
Chips Per System2
Cores Per System64
Cores Per Chip32
Threads Per System128
Threads Per Core2
Version1.6.5
CPU Frequency (MHz)2000
Primary Cache32 KB (I) + 48 KB (D) per core
Secondary Cache1.25 MB (I+D) per core
Tertiary Cache48 MB (I+D) on chip per chip
Other CacheNone
Disk1X WD 250GB SATA SSD
File Systemxfs
Memory Amount (GB)1024
# and size of DIMM(s)16 x 64 GB
Memory Details64 GB RDIMM 2Rx4 PC4-3200AA-R (slots A1-8, B1-8 populated)
# and type of Network Interface Cards (NICs)1 x Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe 1Gb/s Dual Port
Power Supply Quantity and Rating (W)1 x 800
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_2
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_2
NameSUSE Linux Enterprise Server 15 SP4
VendorSUSE
Vendor URLhttp://www.suse.com/
Version5.14.21-150400.22-default
AvailableJun-2022
Bitness64
NotesNone
Java Virtual Machine jvm_2
NameOracle Java SE 17.0.6
VendorOracle
Vendor URLhttp://www.oracle.com/
VersionJava HotSpot 64-bit Server VM, version 17.0.6
AvailableJan-2023
Bitness64
NotesNone
Other Software other_2
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware
OS Images os_Image_1(1)
Hardware Description hw_1
Number of Systems 1
SW Environment Non-virtual
Tuning
  • Logical Processor : Enabled
  • Virtualization Technology : Disabled
  • DCU Streamer Prefetcher : Disabled
  • MADT Core Enumeration : Linear
  • Sub NUMA Cluster : Disabled
  • System Profile : Custom
  • CPU Power Management : Maximum Performance
  • Turbo Boost : Enabled
Notes None
OS Image os_Image_1
JVM Instances jvm_Backend_1(2)
OS Image Description os_1
Tuning
  • echo 950000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 100000000 > /proc/sys/kernel/sched_latency_ns
  • echo 80000 > /proc/sys/kernel/sched_migration_cost_ns
  • echo 600000 > /proc/sys/kernel/sched_min_granularity_ns
  • echo 100000 > /proc/sys/kernel/sched_wakeup_granularity_ns
  • echo 10000 > /proc/sys/vm/dirty_expire_centisecs
  • echo 1500 > /proc/sys/vm/dirty_writeback_centisecs
  • echo 40 > /proc/sys/vm/dirty_ratio
  • echo 10 > /proc/sys/vm/dirty_background_ratio
  • echo 10 > /proc/sys/vm/swappiness
  • echo 0 > /proc/sys/kernel/numa_balancing
  • echo 0 > /proc/sys/vm/numa_stat
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag
  • sysctl -w net.ipv4.icmp_echo_ignore_broadcasts=1
  • sysctl -w net.ipv4.conf.all.rp_filter=1
  • sysctl -w fs.inotify.max_user_watches=65536
  • sysctl -w net.ipv4.conf.default.promote_secondaries=1
  • sysctl -w net.ipv4.conf.all.promote_secondaries=1
  • sysctl -w vm.dirty_background_ratio=1
  • sysctl -w vm.swappiness=0
  • sysctl -w vm.overcommit_memory=0
  • sysctl -w net.ipv4.tcp_mtu_probing=1
  • sysctl -w net.core.wmem_max=12582912
  • sysctl -w net.core.rmem_max=12582912
  • sysctl -w net.ipv4.tcp_rmem='10240 87380 12582912'
  • sysctl -w net.ipv4.tcp_wmem='10240 87380 12582912'
  • sysctl -w net.core.netdev_max_backlog=655560
  • sysctl -w net.core.somaxconn=32768
  • sysctl -w net.ipv4.tcp_no_metrics_save=1
Notes None
JVM Instance jvm_Backend_1
Parts of Benchmark Backend
JVM Instance Description jvm_1
Command Line -server -XX:AllocatePrefetchLines=3 -XX:+UseParallelGC -XX:ParallelGCThreads=32 -XX:LargePageSizeInBytes=2m -XX:+AlwaysPreTouch -XX:+UseLargePages -Xms225g -Xmx225g -Xmn215g -XX:SurvivorRatio=30 -XX:TargetSurvivorRatio=99 -XX:MaxTenuringThreshold=15 -XX:InlineSmallCode=10k -XX:MaxGCPauseMillis=500 -XX:UseAVX=0 -XX:LoopUnrollLimit=20 -XX:AdaptiveSizeMajorGCDecayTimeScale=12 -XX:AdaptiveSizeDecrementScaleFactor=2 -XX:AllocatePrefetchDistance=384 -XX:AllocatePrefetchStepSize=128 -XX:AllocateInstancePrefetchLines=2
Tuning numactl used to affinitize each Backend JVM to a single CPU memory node
  • numactl --cpunodebind=$node --localalloc
Notes None
Hardware
OS Images os_Image_2(1)
Hardware Description hw_2
Number of Systems 1
SW Environment Non-virtual
Tuning
  • Logical Processor : Enabled
  • Virtualization Technology : Disabled
  • DCU Streamer Prefetcher : Disabled
  • MADT Core Enumeration : Linear
  • Sub NUMA Cluster : Disabled
  • System Profile : Custom
  • CPU Power Management : Maximum Performance
  • Turbo Boost : Enabled
Notes None
OS Image os_Image_2
JVM Instances jvm_Ctr_1(1), jvm_TxInjector_1(2)
OS Image Description os_2
Tuning
  • echo 950000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 100000000 > /proc/sys/kernel/sched_latency_ns
  • echo 80000 > /proc/sys/kernel/sched_migration_cost_ns
  • echo 600000 > /proc/sys/kernel/sched_min_granularity_ns
  • echo 100000 > /proc/sys/kernel/sched_wakeup_granularity_ns
  • echo 10000 > /proc/sys/vm/dirty_expire_centisecs
  • echo 1500 > /proc/sys/vm/dirty_writeback_centisecs
  • echo 40 > /proc/sys/vm/dirty_ratio
  • echo 10 > /proc/sys/vm/dirty_background_ratio
  • echo 10 > /proc/sys/vm/swappiness
  • echo 0 > /proc/sys/kernel/numa_balancing
  • echo 0 > /proc/sys/vm/numa_stat
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag
Notes None
JVM Instance jvm_Ctr_1
Parts of Benchmark Controller
JVM Instance Description jvm_2
Command Line -Xms2g -Xmx2g -Xmn1536m -XX:+UseParallelGC -XX:CICompilerCount=2 -XX:ParallelGCThreads=2
Tuning Used numactl to interleave memory on all CPUs
  • numactl --interleave=all
Notes None
JVM Instance jvm_TxInjector_1
Parts of Benchmark TxInjector
JVM Instance Description jvm_2
Command Line -Xms2g -Xmx2g -Xmn1536m -XX:+UseParallelGC -XX:CICompilerCount=2 -XX:ParallelGCThreads=2
Tuning numactl used to affinitize each jvm_TxInjector_1 JVM to a single CPU memory node
  • numactl --cpunodebind=$node --localalloc
Notes None
max-jOPS = jOPS passed before the First Failure
Pass/Fail Pass Pass Fail Fail Fail
jOPS 203484 205936 208388 210839 213291
critical-jOPS = Geomean ( jOPS @ 10000; 25000; 50000; 75000; 100000; SLAs )
Response time percentile is 99-th
SLA (us) 10000 25000 50000 75000 100000 Geomean
jOPS 126258 153226 163033 170387 177742 157043
  Percentile
  10-th 50-th 90-th 95-th 99-th 100-th
500us 2452 / 4903 - / 2452 - / 2452 - / 2452 - / 2452 - / 2452
1000us 115226 / 117678 7355 / 9806 4903 / 7355 2452 / 4903 2452 / 4903 - / 2452
5000us 198581 / 201033 188775 / 191226 110323 / 112775 88258 / 90710 56387 / 58839 9806 / 12258
10000us 198581 / 201033 196130 / 198581 178968 / 181420 166710 / 169162 127484 / 125033 19613 / 12258
25000us 201033 / 203484 196130 / 198581 188775 / 191226 181420 / 183871 154452 / 152000 19613 / 12258
50000us 201033 / 203484 196130 / 198581 188775 / 191226 181420 / 183871 164259 / 161807 19613 / 12258
75000us 201033 / 203484 196130 / 198581 188775 / 191226 183871 / 186323 169162 / 171613 63742 / 36774
100000us 201033 / 203484 196130 / 198581 188775 / 191226 186323 / 188775 176517 / 178968 112775 / 46581
200000us 203484 / 205936 196130 / 198581 191226 / 193678 188775 / 191226 181420 / 183871 159355 / 149549
500000us 203484 / 205936 201033 / 203484 193678 / 196130 193678 / 196130 191226 / 193678 181420 / 183871
1000000us 205936 / - 203484 / 205936 201033 / 203484 201033 / 203484 196130 / 198581 191226 / 193678
Probes jOPS / Total jOPS
Request Mix Accuracy
Note
(Actual % in the Mix - Expected % in the Mix) must be within:
'Main Tx' limit of +/-5.0% for the requests whose expected % in the mix is >= 10.0%
'Minor Tx' limit of +/-1.0% for the requests whose expected % in the mix is < 10.0%
There were no non-critical failures in Response Time curve building
Delay between status pings
IR/PR Accuracy
This section lists properties only set by user
Property Name Default Controller Group1.Backend.beJVM Group1.TxInjector.txiJVM1 Group2.Backend.beJVM Group2.TxInjector.txiJVM1
specjbb.comm.connect.client.pool.size 256 256 128 150 128 150
specjbb.comm.connect.selector.runner.count 0 16 4 4 4 4
specjbb.comm.connect.timeouts.connect 60000 600000 900000 900000 900000 900000
specjbb.comm.connect.timeouts.read 60000 600000 800000 800000 800000 800000
specjbb.comm.connect.timeouts.write 60000 600000 800000 800000 800000 800000
specjbb.comm.connect.worker.pool.max 256 256 128 150 128 150
specjbb.comm.connect.worker.pool.min 1 1 128 4 128 4
specjbb.controller.handshake.period 5000 20000
specjbb.controller.handshake.timeout 600000 900000
specjbb.controller.host localhost 127.0.0.1
specjbb.forkjoin.workers 128 {Tier1=213, Tier2=48, Tier3=24}
specjbb.group.count 1 2
specjbb.heartbeat.period 10000 2000
specjbb.heartbeat.threshold 100000 9000000
specjbb.mapreducer.pool.size 128 26
specjbb.txi.pergroup.count 1 1
View table in csv format
 
Level: COMPLIANCE
Check Agent Result
Check properties on compliance All PASSED
 
Level: CORRECTNESS
Check Agent Result
Compare SM and HQ Inventory All PASSED
High-bound (max attempted) is 245162 IR
High-bound (settled) is 223414 IR