SPECvirt_sc2010 Result: IBM Corporation

SPECvirt_sc2010 Result
Copyright © 2010 Standard Performance Evaluation Corporation

IBM Corporation: x3690 X5
Red Hat: Enterprise Linux 6.0 (KVM)

SPECvirt_sc2010 1763 @ 108 VMs

Tested By:

IBM Corporation

SPEC License #:

Test Date:

Nov-2010

Performance Section
Performance Summary
Performance Details
Validation Errors

SUT Configuration Section
Physical Configuration
Virtual Configuration

Power Section

N/A

Notes Section
Physical System Notes
Virtualization SW Notes
Hosted VM Notes

Performance Summary:

Performance
Tile #	Pct Load	Application Server	Web Server	Mail Server	Idle Server	Per-Tile Score	Overall Score
1	100%	33.38	53.81	88.61	N/A	97.87	1763
2	100%	33.38	53.54	88.54	N/A	97.68
3	100%	33.47	53.94	88.70	N/A	98.07
4	100%	33.26	53.57	88.65	N/A	97.63
5	100%	33.48	53.87	88.85	N/A	98.10
6	100%	33.19	53.61	88.93	N/A	97.69
7	100%	33.44	53.86	88.73	N/A	98.01
8	100%	33.45	53.63	88.76	N/A	97.89
9	100%	33.44	53.94	88.78	N/A	98.07
10	100%	33.41	53.84	88.58	N/A	97.91
11	100%	33.54	53.91	89.04	N/A	98.25
12	100%	33.40	53.93	89.14	N/A	98.16
13	100%	33.45	53.93	88.49	N/A	97.97
14	100%	33.38	53.87	88.62	N/A	97.91
15	100%	33.65	54.00	88.65	N/A	98.26
16	100%	33.37	53.88	88.76	N/A	97.96
17	100%	33.51	53.88	88.79	N/A	98.11
18	100%	33.49	53.91	88.86	N/A	98.13

Quality Of Service (QOS)
Tile #	Pct Load	Application Server	Web Server	Mail Server	Idle Server	Per-Tile Score	Overall Score
1	100%	0.98	1.00	1.00	1.00	1.00	99.69%
2	100%	0.97	1.00	1.00	1.00	0.99
3	100%	0.99	1.00	1.00	1.00	1.00
4	100%	0.98	1.00	1.00	1.00	1.00
5	100%	0.99	1.00	1.00	1.00	1.00
6	100%	0.97	1.00	1.00	1.00	0.99
7	100%	0.99	1.00	1.00	1.00	1.00
8	100%	0.99	1.00	1.00	1.00	1.00
9	100%	0.99	1.00	1.00	1.00	1.00
10	100%	0.98	1.00	1.00	1.00	1.00
11	100%	1.00	1.00	1.00	1.00	1.00
12	100%	0.98	1.00	1.00	1.00	1.00
13	100%	1.00	1.00	1.00	1.00	1.00
14	100%	0.99	1.00	1.00	1.00	1.00
15	100%	1.00	1.00	1.00	1.00	1.00
16	100%	0.99	1.00	1.00	1.00	1.00
17	100%	1.00	1.00	1.00	1.00	1.00
18	100%	0.99	1.00	1.00	1.00	1.00

Performance Details:

Tile 1

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.37	1.33	8.03	1.75	5
Dealer	20.02	0.27/0.44/0.31	16.00/20.20/13.01	0.40/0.90/0.40	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.81	386955	478	15	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.23	102426	102426	0	100.00
Fetch	36.35	261750	261750	0	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	4.16	2	19

Tile 2

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.37	1.37	7.31	2.00	5
Dealer	20.02	0.33/0.48/0.39	14.02/17.38/11.76	0.50/1.00/0.50	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.54	383573	1549	330	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.39	103587	103587	0	100.00
Fetch	36.10	259903	259903	0	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	4.27	1	226

Tile 3

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.37	1.31	13.10	1.75	5
Dealer	20.10	0.24/0.41/0.25	18.09/22.11/16.89	0.50/0.90/0.40	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.94	387665	575	92	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.31	103060	103054	6	99.99
Fetch	36.23	260826	260823	3	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	4.31	2	39

Tile 4

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.31	1.33	7.10	1.75	5
Dealer	19.94	0.29/0.44/0.34	14.45/17.04/12.60	0.50/1.00/0.50	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.57	384310	1211	202	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.38	103541	103541	0	100.00
Fetch	36.21	260705	260705	0	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	3.92	2	24

Tile 5

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.36	1.27	10.07	1.75	5
Dealer	20.12	0.18/0.36/0.19	9.04/12.85/9.30	0.40/0.80/0.40	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.87	387245	567	52	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.32	103122	103119	3	100.00
Fetch	36.25	260996	260995	1	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	4.87	2	44

Tile 6

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.32	1.37	9.68	2.00	5
Dealer	19.87	0.34/0.50/0.36	11.41/17.17/10.34	0.60/1.10/0.60	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.61	384519	1306	175	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.28	102796	102796	0	100.00
Fetch	36.33	261586	261586	0	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	3.79	2	23

Tile 7

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.36	1.26	16.10	1.75	5
Dealer	20.09	0.19/0.35/0.20	18.87/21.05/18.03	0.40/0.80/0.40	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.86	386935	692	177	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.23	102436	102436	0	100.00
Fetch	36.36	261819	261819	0	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	4.04	2	26

Tile 8

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.37	1.29	12.12	1.75	5
Dealer	20.08	0.22/0.38/0.24	14.61/18.12/14.05	0.50/0.90/0.40	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.63	384440	1587	102	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.34	103240	103240	0	100.00
Fetch	36.18	260527	260524	3	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	4.21	2	227

Tile 9

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.35	1.30	12.39	1.75	5
Dealer	20.09	0.22/0.39/0.22	12.59/15.28/12.68	0.40/0.90/0.40	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.94	387843	445	115	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.30	102957	102957	0	100.00
Fetch	36.26	261048	261048	0	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	4.05	2	53

Tile 10

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.37	1.35	9.00	2.00	5
Dealer	20.04	0.28/0.47/0.30	10.37/19.86/8.26	0.60/1.10/0.50	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.84	387141	502	32	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.38	103508	103451	57	99.94
Fetch	36.12	260099	260084	15	99.99

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	4.48	2	226

Tile 11

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.37	1.19	13.04	1.50	5
Dealer	20.17	0.15/0.27/0.17	10.05/15.02/9.02	0.40/0.60/0.40	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.91	387849	277	16	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.25	102607	102607	0	100.00
Fetch	36.29	261321	261321	0	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	5.16	2	349

Tile 12

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.33	1.36	12.04	2.00	5
Dealer	20.07	0.29/0.47/0.31	13.27/20.33/13.29	0.60/1.10/0.50	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.93	387857	372	77	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.27	102763	102763	0	100.00
Fetch	36.20	260652	260652	0	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	3.62	2	16

Tile 13

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.35	1.19	5.25	1.50	5
Dealer	20.09	0.15/0.26/0.17	4.07/7.52/4.23	0.40/0.60/0.40	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.93	387947	336	16	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.22	102391	102391	0	100.00
Fetch	36.27	261112	261112	0	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	3.71	1	37

Tile 14

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.34	1.36	9.56	2.00	5
Dealer	20.04	0.25/0.46/0.26	11.94/17.06/10.00	0.50/1.10/0.50	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.87	387210	418	202	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.19	102175	102151	24	99.98
Fetch	36.30	261378	261377	1	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	4.81	2	33

Tile 15

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.36	1.17	3.06	1.50	5
Dealer	20.29	0.14/0.24/0.16	2.23/5.05/1.62	0.30/0.60/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	54.00	388397	340	42	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.32	103129	103129	0	100.00
Fetch	36.10	259952	259952	0	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	4.26	1	37

Tile 16

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.34	1.31	11.98	1.75	5
Dealer	20.03	0.22/0.40/0.23	15.85/17.31/14.48	0.50/0.90/0.50	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.88	387371	385	174	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.10	101534	101534	0	100.00
Fetch	36.37	261836	261836	0	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	5.70	2	262

Tile 17

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.40	1.18	4.44	1.50	5
Dealer	20.11	0.14/0.25/0.15	2.18/6.89/2.65	0.30/0.60/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.88	387435	252	275	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.30	102958	102897	61	99.94
Fetch	36.20	260650	260641	9	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	5.54	2	24

Tile 18

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.35	1.32	8.44	1.75	5
Dealer	20.13	0.22/0.40/0.22	8.88/15.26/7.00	0.50/1.00/0.50	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.91	387607	411	103	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.25	102600	102600	0	100.00
Fetch	36.28	261248	261248	0	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	4.92	1	228

Validation Errors:

No Validation Errors Found

Physical Configuration:

System Under Test (SUT)
Virt. Vendor/Product	Red Hat Enterprise Linux 6.0 (KVM)
# of SUTs	1
Server Vendor	IBM Corporation
Server Model	x3690 X5
Processor	Intel X7560
Processor Speed (MHz)	2262
Processor Cores	16 cores, 2 chips, 8 cores/chip, 2 threads/core
Primary Cache	32 KB I + 32 KB D on chip per core
Secondary Cache	256 KB I+D on chip per core
Other Cache	24 MB I+D on chip per chip
Memory	1 TB (64 x 16 GB, Quad Rank x4 PC3-8500 CL7 ECC DDR3 1066MHz LP RDIMM)
Operating System	Red Hat Enterprise Linux 6.0
File System	ext4
Other Hardware	Max5 memory expansion
Other Software	N/A

SUT Storage
Storage Controllers	1 x Dual port QLogic Corp. ISP2432-based 4Gb Fibre Channel
Storage Enclosure	1 x IBM DS4800, 12 x IBM EXP810
Disk Description	192 x 73 GB 15k RPM FC
RAID Level	RAID 5
UPS Required?	No

SUT Network
Network Adapters	1 x Broadcom NetXtreme II Gigabit Ethernet (dual port, integrated) 1 x Intel x520 (dual port, 10Gb, PCI-express)
SUT Ports Total	2 2
SUT Ports Used	2 2
Network Type	1000BASE-T 10GBASE-SR
Network Speed	1 Gb/s 10 Gb/s

Clients
Model	x3250M3
# of Clients	3
Processor	Intel E5520
Processor Speed (MHz)	2262
# Processors	2
Memory	32 GB SDRAM
Network Controller	Broadcom NetXtreme II (2 ports), 2 x Intel Corporation 82571EB Gigabit Ethernet Controller (2 ports each)
Operating System	Red Hat Enterprise Linux 6.0 (64-bit)
JVM Version	Java HotSpot(TM) Server VM (build 16.3-b01, mixed mode)
Other Hardware	N/A
Other Software	N/A

Availability Dates
SUT Hardware	Apr-2010
Virt. Software	Nov-2010
Other Components	N/A

Virtual Configuration:

Web Server

VM Configuration Details
# VCPUS	1
VCPU Speed (MHz)	2262 MHz
Memory (MB)	40960
# VNICs	2
VNIC Description	1 x virtio_net, 1 x ixgbevf
Storage Description	2 x virtio_blk
Virtual Disk Size (MB)	15630
Datastore Size (MB)	20480
VM OS	Red Hat Enterprise Linux 6.0 (64-bit)
VM OS Availability	Nov-2010

Web Server Configuration Details
Web Server Vendor	Red Hat
Web Server Name/Version	Apache 2.2.15
Availability Date	Nov-2010
Script Vendor	Red Hat
Script Name/Version	PHP 5.3.2
Script Availability Date	Nov-2010
JVM Version	IBM JRE 1.6.0 J9 2.4 Linux x86-32 jvmxi3260sr8-20100401_55940
Other Software	Alternative PHP Cache APC 3.1.3 (Red Hat) Smarty Template Engine 2.6.26

Application Server

VM Configuration Details
# VCPUS	2
VCPU Speed (MHz)	2262 MHz
Memory (MB)	2560
# VNICs	2
VNIC Description	1 x virtio_net, 1 x ixgbevf
Storage Description	2 x virtio_blk
Virtual Disk Size (MB)	15360
Datastore Size (MB)	20480
VM OS	Red Hat Enterprise Linux 6.0 (64-bit)
VM OS Availability	Nov-2010

App Server Configuration Details
Application Server Vendor	IBM
App. Server Name/Version	WebSphere Application Server 7.0.0.7
Availability Date	Jan-2009
Emulator Vendor	IBM
Emulator Name/Version	WebSphere Application Server 7.0.0.7
Emulator Availability Date	Jan-2009
JVM Description	IBM J9 VM (build 2.4, JRE 1.6.0 IBM J9 2.4 Linux x86-32 jvmxi3260sr6-20091001_43491
JVM Availability	Nov-2009
Other Software	N/A

Mail Server

VM Configuration Details
# VCPUS	1
VCPU Speed (MHz)	2262 MHz
Memory (MB)	2048
# VNICs	2
VNIC Description	1 x virtio_net, 1 x ixgbevf
Storage Description	2 x virtio_blk
Virtual Disk Size (MB)	15360
Datastore Size (MB)	40960
VM OS	Red Hat Enterprise Linux 6.0 (64-bit)
VM OS Availability	Nov-2010

Mail Server Configuration Details
Mail Server Vendor	dovecot.org
Mail Server Name/Version	Dovecot 2.0.7
Availability Date	Nov-2010
JVM Version	IBM JRE 1.6.0 J9 2.4 Linux x86-32 jvmxi3260sr8-20100401_55940
Other Software	N/A

Database Server

VM Configuration Details
# VCPUS	1
VCPU Speed (MHz)	2262 MHz
Memory (MB)	2048
# VNICs	2
VNIC Description	1 x virtio_net, 1 x ixgbevf
Storage Description	2 x virtio_blk
Virtual Disk Size (MB)	15360
Datastore Size (MB)	20480
VM OS	Red Hat Enterprise Linux 6.0 (64-bit)
VM OS Availability	Nov-2010

Database Configuration Details
Database Vendor	IBM
Database Name/Version	DB2 v9.7
Availability Date	Mar-2010
JVM Version	IBM JRE 1.6.0 J9 2.4 Linux x86-32 jvmxi3260sr8-20100401_55940
Other Software	N/A

Infraserver

VM Configuration Details
# VCPUS	1
VCPU Speed (MHz)	2262 MHz
Memory (MB)	1024
# VNICs	2
VNIC Description	1 x virtio_net, 1 x ixgbevf
Storage Description	2 x virtio_blk
Virtual Disk Size (MB)	15360
Datastore Size (MB)	61440
VM OS	Red Hat Enterprise Linux 6.0 (64-bit)
VM OS Availability	Nov-2010

Infraserver Configuration Details
Web Server Vendor	Red Hat
Web Server Name/Version	Apache 2.2.15
Availability Date	Nov-2010
Script Vendor	Fedora Project, release 14 (fedoraproject.org)
Script Name/Version	fcgi-2.4.0
Script Availability Date	Nov-2010
JVM Version	IBM JRE 1.6.0 J9 2.4 Linux x86-32 jvmxi3260sr8-20100401_55940
Other Software	N/A

Idle Server

VM Configuration Details
# VCPUS	1
VCPU Speed (MHz)	2262 MHz
Memory (MB)	1024
# VNICs	1
VNIC Description	1 x virtio_net
Storage Description	2 x virtio_blk
Virtual Disk Size (MB)	15360
Datastore Size (MB)	20480
VM OS	Red Hat Enterprise Linux 6.0 (64-bit)
VM OS Availability	Nov-2010

Idle Server Configuration Details
JVM Version	1.6.0 IBM J9 2.4 Linux amd64-64 jvmxa6460sr8-20100401_55940
Other Software	N/A

Notes:

Physical System Notes

Firmware settings used:
TurboModeEnable=Enable
TurboBoost=Traditional
HardwarePrefetcher=Disable
MemoryScalingAffinity=Pooled

Storage Notes

All storage accessed with 2 x 4 Gb Fibre Channel links attached directly to 1 x DS4800 unit using 2 x 4 Gb host ports. There are 12 EXP810 disk enclosures attached to the 1 x DS4800 via 4 x 4 Gb drive ports. Two sets of 6 x EXP810 enclosures are daisy-chained together to form two loops with the DS4800 unit. Each EXP810 holds 16 x 73 GB FC drives. Total drive count is 192. There are 18 RAID5 arrays, each consisting of 8 drives (48 drives unused). Each array has one LUN defined for one Tile. The first array has one extra LUN defined for the system's boot disk. Each LUN defined for a Tile is divided into 12 logical volumes (2 per VM) using LVM.

Virtualization Software Notes

The following boot options were used:
intel_iommu=on iommu=pt
The following services are disabled:
atd, autofs, avahi-daemon, cgconfig, cron, iptables, ip6tables, iscsi, iscsid, ksm, ksmtuned, postfix, rhnsd, rpcbind, sysstat
Network configuration is as follows:
One software bridge is created, br0 and the second Broadcom
Ethernet port is assigned to the bridge (eth1 to br0). First Broadcom
port is for host access. Every VM's virtIO network device is assigned to br0.
Kernel module for Intel x520 10 Gigabit Server adapter is loaded with
these options to create 120 virtual functions: max_vfs=60,60.
90 of these virtual functions are assigned (one per VM) to the Web, App
DB, Infra and Mail VMs. When a virtual function is present on a VM, a script
is executed to shut down the first virtio_net device and migrate the IP
settings to the virtual function device. This is done to facilitate
easy IP/dns management when using a mix of VMs with and without
virtual functions. The script, convert_to_vf.sh is available in the
disclosure archive. On the host, Ethernet devices eth2 and eth3 are the two physical
functions for the Intel 10Gbps Ethernet ports. These are only used by the host to
provide physical transport for the virtual functions.
Web VMs are launched with nice utility (-n -2) to adjust their scheduling priority
All VMs of odd numbered tiles are bound to NUMA node 1 and have a preferred memory allocation node of 1
All VMs of even numbered tiles are bound to NUMA node 0 and have a preferred memory allocation node of 0
All VMs are created with the following command line format (options in [] are for VMs which have PCI device assignment):
/usr/libexec/qemu-kvm -name $name -M rhel6.0.0 -enable-kvm -drive file=$dev1,if=virtio,boot=on,cache=none
-drive file=$dev2,if=virtio,boot=off,cache=none -netdev tap,id=$name,ifname=$name,script=/etc/kvm/qemu-ifup-br0,vhost=off
-device virtio-net-pci,netdev=$name,mac=$macaddr [-pcidevice host=$pcidev] -m $mem -vnc $vnc_port -cpu qemu64,+x2apic
-no-kvm-pit-reinjection -smp $cpus,sockets=$cpus,cores=1,threads=1 -monitor telnet::$monitor_port,server,nowait
-serial telnet::$serial_port,server,nowait -daemonize
After boot, all block I/O devices changed to use deadline I/O scheduler via sysfs interface

Web Server VM Notes

The following boot options were used:
selinux=0 elevator=deadline
The following services are disabled:
atd, avahi-daemon, cgconfig, cron, iptables, ip6tables, iscsi, iscsid, postfix, rhnsd, sysstat
ulimits for nofile and noproc set to 102400
httpd.conf changes:
KeepAlive on
MaxKeepAliveRequest 0
ServerLimit 10240
MaxClients 10240
MaxRequestsPerChild 1000
CustomLog logs/access_log common
Web VM used NFS to access files from infra VM
No options were specified in the NFS mount
root file-system options: barrier=0
datastore file-system options: noatime,barrier=0,data=writeback
ixgbevf module option used: InterruptThrottleRate=2000

Application Server VM Notes

The following boot options were used:
selinux=0 elevator=deadline
The following services are disabled:
atd, avahi-daemon, cgconfig, cron, iptables, ip6tables, iscsi, iscsid, postfix, rhnsd, sysstat
ulimits for nofile and noproc set to 102400
There are two WebSphere profiles, AppSrv01 for SPECjAppServer2004 and AppSrv02 for SPEC Emulator
Heap size for AppSrv01 has been changed to 1280 MB
root file-system options: barrier=0
datastore file-system options: noatime,barrier=0,data=writeback
ixgbevf module option used: InterruptThrottleRate=2000

Mail Server VM Notes

The following boot options were used:
selinux=0 elevator=deadline
The following services are disabled:
atd, avahi-daemon, cgconfig, cron, iptables, ip6tables, iscsi, iscsid, postfix, rhnsd, sysstat
ulimits for nofile and noproc set to 102400
Dovecot was compiled with default options and the following dovecot.conf was used:
base_dir = /var/run/dovecot/
ssl = no
disable_plaintext_auth = no
listen = *
log_path = /var/log/dovecot
mail_debug = yes
mail_location = dbox:/mailstore/dovecot/maildir/%u
mdbox_rotate_size = 2048
passdb {
args = /etc/passwd.dovecot
driver = passwd-file
}
protocols = imap
service auth {
user = root
}
service imap-login {
inet_listener imap {
port = 143
}
process_min_avail = 10
}
userdb {
driver = passwd
driver = passwd
}
root file-system options: barrier=0
datastore file-system options: noatime,barrier=0,data=writeback
ixgbevf module option used: InterruptThrottleRate=2000

Database Server VM Notes

The following boot options were used:
hugepages=416 selinux=0 elevator=deadline
The following services are disabled:
atd, avahi-daemon, cgconfig, cron, iptables, ip6tables, iscsi, iscsid, postfix, rhnsd, sysstat
ulimits for nofile and noproc set to 102400
Database tuning options:
db2 update db cfg for specdb using DATABASE_MEMORY 200000
db2set DB2_LARGE_PAGE_MEM=DB; db2set DB2_PINNED_BP=ON
alter bufferpool IBMDEFAULTBP size 160000
alter tablespace roll_space NO FILE SYSTEM CACHING
alter tablespace C_cust_space NO FILE SYSTEM CACHING
alter tablespace C_supp_space NO FILE SYSTEM CACHING
alter tablespace C_site_space NO FILE SYSTEM CACHING
alter tablespace C_parts_space NO FILE SYSTEM CACHING
alter tablespace C_custinv_space NO FILE SYSTEM CACHING
alter tablespace M_parts_space NO FILE SYSTEM CACHING
alter tablespace M_bom_space NO FILE SYSTEM CACHING
alter tablespace M_wo_space NO FILE SYSTEM CACHING
alter tablespace M_lo_space NO FILE SYSTEM CACHING
alter tablespace M_inv_space NO FILE SYSTEM CACHING
alter tablespace O_cust_space NO FILE SYSTEM CACHING
alter tablespace O_ords_space NO FILE SYSTEM CACHING
alter tablespace O_ordl_space NO FILE SYSTEM CACHING
alter tablespace O_item_space NO FILE SYSTEM CACHING
alter tablespace S_comp_space NO FILE SYSTEM CACHING
alter tablespace S_sc_space NO FILE SYSTEM CACHING
alter tablespace S_po_space NO FILE SYSTEM CACHING
alter tablespace S_site_space NO FILE SYSTEM CACHING
alter tablespace S_supp_space NO FILE SYSTEM CACHING
alter tablespace U_space NO FILE SYSTEM CACHING
update db cfg for specdb using logprimary 64
root file-system options: barrier=0
datastore file-system options: noatime,barrier=0,data=writeback
ixgbevf module option used: InterruptThrottleRate=2000

Infraserver VM Notes

The following boot options were used:
selinux=0 elevator=deadline
The following services are disabled:
atd, avahi-daemon, cgconfig, cron, iptables, ip6tables, iscsi, iscsid, postfix, rhnsd, sysstat
ulimits for nofile and noproc set to 102400
httpd.conf changes:
Listen port to 81
ServerLimit 10240
MaxClients 10240
CustomLog logs/access_log common
/etc/httpd/conf.d/fcgi.conf added:
LoadModule fastcgi_module modules/mod_fastcgi.so
ScriptAlias /fcgi-bin/ /var/www/fcgi-bin/
FastCgiIpcDir /etc/httpd/fastcgi
<Directory /var/www/fcgi-bin>
AllowOverride None
Options +ExecCGI -Includes
SetHandler fastcgi-script
Order allow,deny
Allow from all
</Directory>
AddHandler fastcgi-script fcgi
FastCgiServer /var/www/fcgi-bin/besim_fcgi.fcgi -processes 50
Standard Linux NFS server is enabled to serve files to Web VM
/etc/exports file contains:
/support-download *(rw,no_subtree_check,crossmnt,no_root_squash)
root file-system options: barrier=0
datastore file-system options: noatime,barrier=0,data=writeback
ixgbevf module option used: InterruptThrottleRate=2000
Fcgi package built from Fedora 14 source RPM, which includes patch to compile with GCC 4.4

Idle Server VM Notes

The following boot options were used:
selinux=0 elevator=deadline
The following services are disabled:
atd, avahi-daemon, cgconfig, cron, iptables, ip6tables, iscsi, iscsid, postfix, rhnsd, sysstat
ulimits for nofile and noproc set to 102400
root file-system options: barrier=0
datastore file-system options: noatime,barrier=0,data=writeback

Client Driver Notes

All prime clients and prime controller are VMs hosted with Red Hat Enterprise Linux 6.0. Client systems host 6 prime client VMs. The third client system also hosts the prime controller VM. Each VM has 2 vCPUs, and prime client VMs' vCPUs are bound to sibling threads in a processor core. Paravirtual clock is used for all client VMs. 1 virtio_net device, and 1 virtio_blk device are used in all client VMs. For all hosts, there are 4 1Gbps Ethernet ports (4 active) on each physical client. On all client systems, first Ethernet port is used for host access and NFS. The remaining 3 active ports are used for software bridges, up to 3 VMs per bridge. Client VM images are provided from an NFS server.

Other Notes

A single Netgear switch, model GSM7352Sv2, is equipped with 2 x SFP+ 10GBASE-LR LC transceivers, and this switch is used for all physical network connections

For questions about this result, please contact the submitter: IBM Corporation

First published at SPEC.org on 15-Dec-2010