Assessing System Software Performance in Complex System of Systems Environments
The characterization of SoftWare Performance (SWP) in complex, Service-Oriented Architecture (SOA)- based System of Systems (SoS) environments is an emergent study area. This paper focuses on both qualitative and quantitative ways of determining the current state of SWP in terms of both test coverage (what has been tested) and confidence (degree of testing) for SOA-based SoS environments. Practical tools and methodologies are offered to aid technical and programmatic managers in the form of a stepwise methodology toward SWP selection. Included are system architecture design considerations, resource limiters of SWP, test event design considerations, organizational and process suggestions toward improved SWP management and a matrix of measurement suggestions.