Changes between Version 74 and Version 75 of benchmarks

Show
Ignore:
Timestamp:
11/23/11 15:03:31 (12 years ago)
Author:
bartek
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • benchmarks

    v74 v75  
    150150The QCG-Notification performance was compared to the performance of two other services implementing brokered version of WS-Notification specification. These were Apache !ServiceMix (version 3.3.1) and IBM !WebSphere Application Server (version 7.0).  
    151151 
    152 A reliable performance tests of the notification systems are difficult to realise. Note that the proceeding time of a single, small message is very short, difficult to correct measurement and highly depends on many aspects, such us underlying best effort transport protocols, transport protocols or service configuration. Therefore the tests had to be  performed significant amount of times and the received results averaged.  
     152A reliable performance tests of the notification systems are difficult to realise. Note that the proceeding time of a single, small message is very short, difficult to correct measurement and highly depends on many aspects, such us underlying best effort transport protocols, transport protocols or service's configuration.  
    153153 
    154 Moreover, taking into account these objectives as well as the fact that the tested notification systems are different: each system provides a set of specific functions that is not always the same in the another systems (for example, !ServiceMix doesn’t provide support for Full topic dialect), the next decision was to test only the most common features and focus on key scenarios. 
    155  
     154Taking into account these objectives as well as the fact that the tested notification systems are different: each system provides a set of specific functions that may be unavilable in the another systems (for example, !ServiceMix doesn’t provide support for Full topic dialect), the decision was to test only the most common features and focus on key scenarios. 
     155The elementary tests were performed many times and the received results were averaged. 
    156156=== Testbed === 
    157157The testbed consisted of two homogenous machines connected over the 1Gb Ethernet (see the attached figure). The first machine was used to host the lightweight versions of notification systems clients, that are Publisher and !NotificationConsumer, while the second machine was dedicated for the three tested notification systems and additionally for the another instance of !NotificationConsumer to allow simple tests.