Supermicro SuperServer SYS-221H-TNR 545001 SPECjbb2015-MultiJVM max-jOPS
298157 SPECjbb2015-MultiJVM critical-jOPS
Tested by: Supermicro Test Sponsor: Supermicro Test location: San Jose, California Test date: Nov 15, 2023
SPEC license #: 001176 Hardware Availability: Dec-2023 Software Availability: Oct-2023 Publication: Thu Dec 14 10:44:19 EST 2023
Benchmark Results Summary
 
Overall Throughput RT curve
Overall SUT (System Under Test) Description
VendorSupermicro
Vendor URLhttps://www.supermicro.com
System SourceSingle Supplier
System DesignationServer Rack
Total Systems1
All SUT Systems IdenticalYES
Total Nodes1
All Nodes IdenticalYES
Nodes Per System1
Total Chips2
Total Cores128
Total Threads256
Total Memory Amount (GB)1024
Total OS Images1
SW EnvironmentNon-virtual
 
Hardware hw_1
NameSuperServer SYS-221H-TNR
VendorSupermicro
Vendor URLhttps://www.supermicro.com
AvailableDec-2023
ModelX13DEM
Form Factor2U
CPU NameINTEL XEON PLATINUM 8592+
CPU Characteristics64 Core, 1.9 GHz, 320MB L3 Cache (Turbo Boost Technology up to 3.90 GHz)
Number of Systems1
Nodes Per System1
Chips Per System2
Cores Per System128
Cores Per Chip64
Threads Per System256
Threads Per Core2
Version2.0 (11/09/2023)
CPU Frequency (MHz)1900
Primary Cache32 KB (I) + 48 KB (D) on chip per core
Secondary Cache2 MB (I+D) on chip per core
Tertiary Cache320 MB (I+D) on chip per chip
Other CacheNone
Disk1 x 960 GB NVMe SSD
File Systemext4
Memory Amount (GB)1024
# and size of DIMM(s)16 x 64GB
Memory Details64GB 2Rx4 PC5-5600B-R
# and type of Network Interface Cards (NICs)1x 10 Gbit + 1x 1Gbit NICs
Power Supply Quantity and Rating (W)2 x 1200W
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_1
NameUbuntu 22.04.3 LTS
VendorUbuntu
Vendor URLhttp://www.ubuntu.com/
Version5.15.0-88-generic
AvailableAug-2023
Bitness64
NotesNone
Java Virtual Machine jvm_1
NameOracle Java SE 17.0.9
VendorOracle
Vendor URLhttp://oracle.com/
VersionJava HotSpot 64-bit Server VM, version 17.0.9
AvailableOct-2023
Bitness64
NotesNone
Other Software other_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware
OS Images os_Image_1(1)
Hardware Description hw_1
Number of Systems 1
SW Environment non-virtual
Tuning

BIOS Settings:

  • SNC=Enable SNC2(2- Clusters)
  • Power Technology=Custom
  • Power Performance Tuning=BIOS Controls EPB
  • ENERGY_PERF_BIAS_CFG mode=Extreme Performance

Notes None
OS Image os_Image_1
JVM Instances jvm_Ctr_1(1), jvm_Backend_1(8), jvm_TxInjector_1(8)
OS Image Description os_1
Tuning

  • cpupower -c all frequency-set -g performance
  • tuned-adm profile throughput-performance
  • ulimit -n 1024000
  • echo 10000 > /proc/sys/kernel/sched_cfs_bandwidth_slice_us
  • echo 0 > /proc/sys/kernel/sched_child_runs_first
  • echo 56000000 > /sys/kernel/debug/sched/latency_ns
  • echo 1000 > /sys/kernel/debug/sched/migration_cost_ns
  • echo 16000000 > /sys/kernel/debug/sched/min_granularity_ns
  • echo 9 > /sys/kernel/debug/sched/nr_migrate
  • echo 100 > /proc/sys/kernel/sched_rr_timeslice_ms
  • echo 1000000 > /proc/sys/kernel/sched_rt_period_us
  • echo 990000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 0 > /proc/sys/kernel/sched_schedstats
  • echo 1 > /sys/kernel/debug/sched/tunable_scaling
  • echo 50000000 > /sys/kernel/debug/sched/wakeup_granularity_ns
  • echo 3000 > /proc/sys/vm/dirty_expire_centisecs
  • echo 500 > /proc/sys/vm/dirty_writeback_centisecs
  • echo 40 > /proc/sys/vm/dirty_ratio
  • echo 10 > /proc/sys/vm/dirty_background_ratio
  • echo 10 > /proc/sys/vm/swappiness
  • echo 0 > /proc/sys/kernel/numa_balancing
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
  • ulimit -v 800000000
  • ulimit -m 800000000
  • ulimit -l 800000000
  • echo 300 > /sys/kernel/mm/hugepages/hugepages-1048576kB/nr_hugepages
  • echo 8000 > /sys/kernel/mm/hugepages/hugepages-2048kb/nr_hugepages
  • systemctl stop systemed-update-utmp-runlevel.service
  • echo 274877906944 > /proc/sys/kernel/shmmax
  • echo 274877906944 > /proc/sys/kernel/shmall

Notes None
JVM Instance jvm_Ctr_1
Parts of Benchmark Controller
JVM Instance Description jvm_1
Command Line

-server -Xms2g -Xmx2g -Xmn1536m -XX:+UseLargePages -XX:LargePageSizeInBytes=1G -XX:+UseParallelGC -XX:ParallelGCThreads=2

Tuning None
Notes None
JVM Instance jvm_Backend_1
Parts of Benchmark Backend
JVM Instance Description jvm_1
Command Line

-XX:+UseParallelGC -XX:+UseLargePages -XX:+AlwaysPreTouch -XX:-UseAdaptiveSizePolicy -XX:MaxTenuringThreshold=15 -XX:InlineSmallCode=10k -verbose:gc -XX:-UseCountedLoopSafepoints -XX:LoopUnrollLimit=20 -server -XX:TargetSurvivorRatio=95 -XX:SurvivorRatio=28 -XX:LargePageSizeInBytes=1G -XX:MaxGCPauseMillis=500 -XX:AdaptiveSizeMajorGCDecayTimeScale=12 -XX:AdaptiveSizeDecrementScaleFactor=2 -XX:AllocatePrefetchLines=3 -XX:AllocateInstancePrefetchLines=2 -XX:AllocatePrefetchStepSize=128 -XX:AllocatePrefetchDistance=384 -Xms29g -Xmx29g -Xmn27g -XX:UseAVX=0 -XX:ParallelGCThreads=32 -XX:+UseHugeTLBFS

Tuning

Used numactl to affinitize 2 Backend JVM to physcical cores in a NUMA node

    • Group1: numactl --physcpubind=0-15,128-143 --localalloc
    • Group2:numactl --physcpubind=16-31,144-159 --localalloc
    • Group3:numactl --physcpubind=32-47,160-175 --localalloc
    • Group4:numactl --physcpubind=48-63,176-191 --localalloc
    • Group5: numactl --physcpubind=64-79,192-207 --localalloc
    • Group6:numactl --physcpubind=80-95,208-223 --localalloc
    • Group7:numactl --physcpubind=96-111,224-239 --localalloc
    • Group8:numactl --physcpubind=112-127,240-255 --localalloc

Notes None
JVM Instance jvm_TxInjector_1
Parts of Benchmark TxInjector
JVM Instance Description jvm_1
Command Line

-server -Xms2g -Xmx2g -Xmn1536m -XX:+UseLargePages -XX:LargePageSizeInBytes=1G -XX:+UseParallelGC -XX:ParallelGCThreads=2

Tuning

Used numactl to affinitize 2 Injector JVM to physcical cores in a NUMA node

    • Group1: numactl --physcpubind=0-15,128-143 --localalloc
    • Group2:numactl --physcpubind=16-31,144-159 --localalloc
    • Group3:numactl --physcpubind=32-47,160-175 --localalloc
    • Group4:numactl --physcpubind=48-63,176-191 --localalloc
    • Group5: numactl --physcpubind=64-79,192-207 --localalloc
    • Group6:numactl --physcpubind=80-95,208-223 --localalloc
    • Group7:numactl --physcpubind=96-111,224-239 --localalloc
    • Group8:numactl --physcpubind=112-127,240-255 --localalloc

Notes None
max-jOPS = jOPS passed before the First Failure
Pass/Fail Pass Pass Fail Fail Fail
jOPS 538188 545001 551813 558626 565438
critical-jOPS = Geomean ( jOPS @ 10000; 25000; 50000; 75000; 100000; SLAs )
Response time percentile is 99-th
SLA (us) 10000 25000 50000 75000 100000 Geomean
jOPS 194156 241844 316781 378094 418969 298157
  Percentile
  10-th 50-th 90-th 95-th 99-th 100-th
500us 6813 / 13625 - / 6813 - / 6813 - / 6813 - / 6813 - / 6813
1000us 313375 / 238438 20438 / 27250 13625 / 20438 6813 / 13625 6813 / 13625 - / 6813
5000us 504126 / 510938 463251 / 470063 320188 / 327000 218000 / 197563 102188 / 109000 6813 / 13625
10000us 510938 / 517751 476876 / 483688 367876 / 374688 313375 / 320188 190750 / 197563 6813 / 13625
25000us 517751 / 524563 490501 / 497313 436001 / 442813 388313 / 395126 238438 / 245250 6813 / 13625
50000us 517751 / 524563 497313 / 504126 456438 / 463251 415563 / 422376 313375 / 320188 6813 / 13625
75000us 524563 / 531376 504126 / 510938 463251 / 470063 442813 / 449626 374688 / 381501 149875 / 27250
100000us 524563 / 531376 504126 / 510938 476876 / 483688 456438 / 463251 415563 / 422376 204375 / 40875
200000us 531376 / 538188 517751 / 524563 497313 / 504126 483688 / 490501 476876 / 483688 381501 / 367876
500000us 545001 / - 531376 / 538188 517751 / 524563 510938 / 517751 510938 / 517751 476876 / 483688
1000000us 545001 / - 545001 / - 531376 / 538188 531376 / 538188 531376 / 538188 510938 / 517751
Probes jOPS / Total jOPS
Request Mix Accuracy
Note
(Actual % in the Mix - Expected % in the Mix) must be within:
'Main Tx' limit of +/-5.0% for the requests whose expected % in the mix is >= 10.0%
'Minor Tx' limit of +/-1.0% for the requests whose expected % in the mix is < 10.0%
There were no non-critical failures in Response Time curve building
Delay between status pings
IR/PR Accuracy
This section lists properties only set by user
Property Name Default Controller
specjbb.comm.connect.client.pool.size 256 232
specjbb.comm.connect.selector.runner.count 0 1
specjbb.comm.connect.timeouts.connect 60000 600000
specjbb.comm.connect.timeouts.read 60000 600000
specjbb.comm.connect.timeouts.write 60000 600000
specjbb.comm.connect.worker.pool.max 256 81
specjbb.comm.connect.worker.pool.min 1 24
specjbb.controller.host localhost localhost
specjbb.controller.port 24000 24000
specjbb.controller.type HBIR_RT HBIR_RT
specjbb.customerDriver.threads 64 {=75, probe=69, saturate=85}
specjbb.forkjoin.workers 256 {Tier1=224, Tier2=57, Tier3=25}
specjbb.group.count 1 8
specjbb.mapreducer.pool.size 256 223
specjbb.txi.pergroup.count 1 1
View table in csv format
 
Level: COMPLIANCE
Check Agent Result
Check properties on compliance All PASSED
 
Level: CORRECTNESS
Check Agent Result
Compare SM and HQ Inventory All PASSED
High-bound (max attempted) is 681251 IR
High-bound (settled) is 567842 IR