Changes between Version 74 and Version 75 of benchmarks
- Timestamp:
- 11/23/11 15:03:31 (12 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
benchmarks
v74 v75 150 150 The QCG-Notification performance was compared to the performance of two other services implementing brokered version of WS-Notification specification. These were Apache !ServiceMix (version 3.3.1) and IBM !WebSphere Application Server (version 7.0). 151 151 152 A reliable performance tests of the notification systems are difficult to realise. Note that the proceeding time of a single, small message is very short, difficult to correct measurement and highly depends on many aspects, such us underlying best effort transport protocols, transport protocols or service configuration. Therefore the tests had to be performed significant amount of times and the received results averaged.152 A reliable performance tests of the notification systems are difficult to realise. Note that the proceeding time of a single, small message is very short, difficult to correct measurement and highly depends on many aspects, such us underlying best effort transport protocols, transport protocols or service's configuration. 153 153 154 Moreover, taking into account these objectives as well as the fact that the tested notification systems are different: each system provides a set of specific functions that is not always the same in the another systems (for example, !ServiceMix doesn’t provide support for Full topic dialect), the nextdecision was to test only the most common features and focus on key scenarios.155 154 Taking into account these objectives as well as the fact that the tested notification systems are different: each system provides a set of specific functions that may be unavilable in the another systems (for example, !ServiceMix doesn’t provide support for Full topic dialect), the decision was to test only the most common features and focus on key scenarios. 155 The elementary tests were performed many times and the received results were averaged. 156 156 === Testbed === 157 157 The testbed consisted of two homogenous machines connected over the 1Gb Ethernet (see the attached figure). The first machine was used to host the lightweight versions of notification systems clients, that are Publisher and !NotificationConsumer, while the second machine was dedicated for the three tested notification systems and additionally for the another instance of !NotificationConsumer to allow simple tests.