Soap-Stone: How Fast Is Your Network Today?

White Paper
Results
Submit Your Results
Support
Products
Download Soap-Stone

Related Resources:
download soap-stone-full-0.952.jar soap-stone home-page at sourceforge.net simontuffs.com home-page licensing information contact us SourceForge.net home-page
Copyright P. Simon Tuffs, 2004. All Rights Reserved.Version 0.95

Soap-Stone: Submit Your Results

This page provides information on how you can submit benchmark results gathered using Soap-Stone on your hardware/software combinations.

First, be aware that in the case of benchmarks for the major application-server products (BEA-Weblogic etc), unless you have obtained and can provide prior written permission from the vendor to publish the benchmarks you have made we will be unable to accept them on the Soap-Stone web-site.

The main intention of this submission process (at present) is to allow for a comparison between different Java virtual machines (Sun, IBM, etc), different hardware systems (Intel, Sparc, etc), and different operating systems (Windows, Solaris, Linux etc), and different network technologies ( 100Mbit/sec, Giga-bit Ethernet, Wi-Fi), different topologies (Switch, Hub, etc), and different protocols (including open-source application servers such as Axis and JBoss).

Submission Process

Soap-Stone gathers timing information in the form of a comma-separated variable (CSV) file called soap-stone.csv. This log file is re-written for each scenario which is executed.

Soap-Stone ships with a number of built-in scenarios (configured by the soap-stone.properties resource in the jar file, and overridable by a local file with this same name).

Scenario 2 exercises all of the current protocols over a range of sizes, for unidirectional data transfer. This is the scenario that you should run for submission of results, since it will facilitate comparison between systems and networks.

A typical run of this scenario (augmented with "-buffers 1" to speed things up) results in a soap-stone.csv file which looks like this:

Note: you will probably find it necessary to increase the maximum memory of the JVM when running this scenario as follows:

Important: when you run this test for submission to our repository, please run it with the default scenario settings as shown above. This will make the timing results more accurate and consistent with other result submissions.

There is one section in this file which requires manual data entry before you submit it, namely this:

Where the file contains <type here> you should enter data specific to your hardware and software. This will allow us to categorize your results appropriately, for comparison with other results, and to build a database for others to use as a reference. If you are performing a test on a localhost loopback connection, please enter localhost for all three fields.

Once you have gathered and edited the soap-stone.csv file, send it to us as an email attachment and we will include it in our results page and database. If you are sending more than one file, please name them numerically and attach them to the email that you send, e.g. soap-stone.csv.1 etc.


If you like SoapStone then you might want to check out some of the other Open-Source projects developed by simontuffs.com:
soap-stone at sourceforge.net simontuffs.com