Premium
Evaluating the sustained performance of COTS‐based messaging systems
Author(s) -
Tran Phong,
Gosper Jeffrey,
Gorton Ian
Publication year - 2003
Publication title -
software testing, verification and reliability
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.216
H-Index - 49
eISSN - 1099-1689
pISSN - 0960-0833
DOI - 10.1002/stvr.279
Subject(s) - middleware (distributed applications) , computer science , message broker , process (computing) , software , metric (unit) , software engineering , operating system , engineering , operations management
Messaging systems, which include message brokers built on top of message‐oriented middleware, have been used as middleware components in many enterprise application integration projects. There are many COTS‐based messaging systems on the market, but there is little concrete understanding in the software industry on the performance of these different technologies. The authors have carried out a scenario‐based evaluation of three leading messaging systems to provide insight into performance issues. The evaluation process includes a study of the sustained performance of the system under load. The result of this study is used to derive a generic metric for quantifying a messaging system's performance. The paper describes a synthetic transactional scenario, which is used for load tests and performance measurement. The results from executing this test scenario with three messaging systems are then presented and explained. Copyright © 2003 John Wiley & Sons, Ltd.