Articles about ROI of MBT
Industry is adopting MBT … or is at least thinking about it. Thus, the return on investment (ROI) needs to be estimated, as described in a previous post.
This post summarizes some of the articles about the benefits and costs of MBT that have been published recently. Interestingly, we found only little recent literature about this, and many of them in German:
- the German article mentioned in our previous post, as well as from imbus on openPR: “Wirtschaftlichkeitsberechnung für MBT: Wann sich modellbasiertes Testen lohnt” (Economics calculation: when is model-based testing profitable). It does not give calculated ROIs of real MBT projects, but is a tutorial on estimating ROIs and gives an example calculation (which is in fact based on a real project: Microsoft’s Protocol Documentation Program);
- the German article Modellbasiertes Testen in der Datenverarbeitung (page 8-11) introduces MBT and describes a four-year project for the German flat rate tax. It employed the MBT tool rapidrep Test Suite and led to many benefits usually associated with MBT: early fault detection, efficient test automation and management, and improved communication due to the models. The costs of MBT are, however, not mentioned;
- the English article Model-Based Testing: Achievements and Future Challenges, which aims at giving an overview of MBT and summarizes recent achievements in MBT. Experiences with MBT approaches are illustrated and some success stories are reported. Finally, open issues and future research challenges are discussed;
- the English article Industrial-Strength Model-Based Testing – State of the Art and Current Challenges, which mentions MBT’s advantages and difficulties in relation to coverage, modeling aspects and requirements tracing, and has a strong focus on the tool RT-Tester.
Please tell us if you know about any further recently published related article.
We wonder why there is so much literature on the ROI of test automation in general, but so little on the ROI of MBT, even though you hear more and more about industrial projects with MBT and news from MBT tool vendors. Do you know why? Maybe large companies that apply MBT do not report about it? But Siemens (Helmut Goetz) did so back in 2011. Maybe MBT tool vendors do not have recent ROI calculations? But ROI articles were published in 2010 for Conformiq’s Tool Suite and Microsoft’s Spec Explorer.