From Monolithic to Component-Based Performance Evaluation of Software Architectures: A Series of Experiments Analyzing Accuracy and Effort
Model-based performance evaluation methods for software architectures can help architects to assess design alternatives and save costs for late life-cycle performance fixes. A recent trend is component-based performance modelling, which aims at creating reusable performance models; a number of such methods have been proposed during the last decade. Their accuracy and the needed effort for modelling are heavily influenced by human factors, which are so far hardly understood empirically. Do component-based methods allow to make performance predictions with a comparable accuracy while saving effort in a reuse scenario? The authors examined three monolithic methods (SPE, umlPSI, Capacity Planning (CP)) and one Component-based Performance evaluation Method (PCM) with regard to their accuracy and effort from the viewpoint of method users.