Changes between Version 78 and Version 79 of benchmarks

Timestamp:

11/23/11 16:15:33 (12 years ago)

Author:

bartek

Comment:

--

benchmarks

@@ -150 +150 @@
 The QCG-Notification performance was compared to the performance of two other services implementing brokered version of WS-Notification specification. These were Apache !ServiceMix (version 3.3.1) and IBM !WebSphere Application Server (version 7.0). 
 
-A reliable performance tests of the notification systems are difficult to realise. Note that the proceeding time of a single, small message is very short, difficult to correct measurement and highly depends on many aspects, such us underlying best effort transport protocols, transport protocols or service's configuration. 
+A reliable performance tests of the notification systems are difficult to realise. Note that the proceeding time of a single, small message is very short, difficult to correct measurement and highly depends on many aspects, such as underlying best effort transport protocols, network protocols or service's configuration. 
 
 Taking into account these objectives as well as the fact that the tested notification systems are different: each system provides a set of specific functions that may be unavilable in the another systems (for example, !ServiceMix doesn’t provide support for Full topic dialect), the decision was to test only the most common features and focus on key scenarios.
@@ -160 +160 @@
 [[Image(tests-deployment.png, center, width=540px)]]
 
-=== Test 1 - Notification Delivery without Active Subscriptions ==
-The first test concerned the measurement of the time of sending 1000 notifications while there were no active subscriptions in the tested system. That means the time was counted on a Publisher side and there were any Notification Consumers interested in receiving notifications.
+=== Test 1 - Notification Delivery without Active Subscriptions ===
+The first test concerned the measurement of the time of sending a bunch of notifications while there were no active subscriptions in the tested system. That means that the time was counted on the Publisher side and the notification was not forwarded by the brokers as there were any Notification Consumers interested in receiving notifications.
+* filtering based on: topics;
+* notification dialect: Simple;
+* notification Payload: 320 bytes;
+* number of notifications in one bunch: 1000.
+
+==== Notes ====
+
+''Pros:''
+* Possibility to compare :
+ * approximately constant number of tasks,
+ * "the task flow" (when one task is finished, another begins).
+* The program may be used to measure the overall capacity of the system.
+
+''Cons:''
+* The measured submitting time may be distorted (the response of the service on the submit request does not necessarily imply the submit to the queueing system).
+
 === Test 2 - Notification Delivery with Active Subscriptions ===