Soap-Stone: How Fast Is Your Network Today? White Paper Results Submit Your Results Support Products Download Soap-Stone

Related Resources:

Soap-Stone: Submit Your Results

First, be aware that in the case of benchmarks for the major application-server products (BEA-Weblogic etc), unless you have obtained and can provide prior written permission from the vendor to publish the benchmarks you have made we will be unable to accept them on the Soap-Stone web-site.

The main intention of this submission process (at present) is to allow for a comparison between different Java virtual machines (Sun, IBM, etc), different hardware systems (Intel, Sparc, etc), and different operating systems (Windows, Solaris, Linux etc), and different network technologies ( 100Mbit/sec, Giga-bit Ethernet, Wi-Fi), different topologies (Switch, Hub, etc), and different protocols (including open-source application servers such as Axis and JBoss).

Submission Process

Soap-Stone ships with a number of built-in scenarios (configured by the soap-stone.properties resource in the jar file, and overridable by a local file with this same name).

scenario.1=client -protocol [raw,rmi,http,soap]
scenario.2=client -protocol [raw,rmi,http,soap] -size [100,1k,10k,100k,1m,10m] -tables -columns avg
scenario.3=client -protocol [raw,rmi,http,soap] -size [1kb,2kb,4kb,8kb,16kb,32kb,64kb]
scenario.4=client -protocol [raw,rmi,http,soap] -size [128kb,256kb,512kb]
scenario.5=client -protocol [raw,rmi,http,soap] -size [1mb,2mb,4mb,8mb]
		

Scenario 2 exercises all of the current protocols over a range of sizes, for unidirectional data transfer. This is the scenario that you should run for submission of results, since it will facilitate comparison between systems and networks.

A typical run of this scenario (augmented with "-buffers 1" to speed things up) results in a soap-stone.csv file which looks like this:

scenario: -protocol [raw;rmi;http;soap] -size [100;1k;10k;100k;1m;10m] -buffers 1

table 1
size,avg/-protocol=raw,avg/-protocol=rmi,avg/-protocol=http,avg/-protocol=soap
100,29.33,3.31,1.87,0.29
1k,301.61,30.54,19.01,3.3
10k,619.31,139.9,124.29,21.05
100k,417.15,205.14,349.05,34.41
1m,443.83,202.74,410.1,23.8
10m,408.62,116.55,408.02,26.21

Network Information:,                 , Examples:
Network Speed       , <type here>     , localhost/1Gbps/100Mbps/etc.
Network Technology  , <type here>     , localhost/100base-T/11Mbps Wi-Fi/etc.
Network Connectivity, <type here>     , localhost/1Gbps Switch/100Mbps Hub/etc.

Client JVM Properties: 
java.runtime.name,Java(TM) 2 Runtime Environment, Standard Edition
java.runtime.version,1.4.2_02-b03
java.vm.info,mixed mode
java.vm.name,Java HotSpot(TM) Client VM
java.vm.vendor,Sun Microsystems Inc.
java.vm.version,1.4.2_02-b03
os.arch,x86
os.name,Windows XP
os.version,5.1
soap-stone.memory.free,2783344
soap-stone.memory.max,532742144
soap-stone.memory.total,15831040
soap-stone.processors,2

Server JVM Properties: 
java.runtime.name,Java(TM) 2 Runtime Environment, Standard Edition
java.runtime.version,1.4.2_02-b03
java.vm.info,mixed mode
java.vm.name,Java HotSpot(TM) Client VM
java.vm.vendor,Sun Microsystems Inc.
java.vm.version,1.4.2_02-b03
os.arch,x86
os.name,Windows XP
os.version,5.1
soap-stone.memory.free,3513480
soap-stone.memory.max,532742144
soap-stone.memory.total,15831040
soap-stone.processors,2
		

Note: you will probably find it necessary to increase the maximum memory of the JVM when running this scenario as follows:

java -Xmx512m -jar ../dist/soap-stone-full.jar -scenario 2

Important: when you run this test for submission to our repository, please run it with the default scenario settings as shown above. This will make the timing results more accurate and consistent with other result submissions.

There is one section in this file which requires manual data entry before you submit it, namely this:

Network Information:,                 , Examples:
Network Speed       , <type here>     , localhost/1Gbps/100Mbps/etc.
Network Technology  , <type here>     , localhost/100base-T/11Mbps Wi-Fi/etc.
Network Connectivity, <type here>     , localhost/1Gbps Switch/100Mbps Hub/etc.
		

Once you have gathered and edited the soap-stone.csv file, send it to us as an email attachment and we will include it in our results page and database. If you are sending more than one file, please name them numerically and attach them to the email that you send, e.g. soap-stone.csv.1 etc.