Improving Model Inspection Processes with Crowdsourcing: Findings from a Controlled Experiment

D. Winkler, R. Sabou, S. Petrovic, G. Carneiro, M. Kalinowski, S. Biffl:
"Improving Model Inspection Processes with Crowdsourcing: Findings from a Controlled Experiment";
Vortrag: 24th European Systems, Software&Service Process Improvement and Innovation (EuroSPI), Ostrava, Czech Republic; 06.09.2017 - 08.09.2017; in:"Proceedings of the 24th European Systems, Software&Service Process Improvement and Innovation (EuroSPI), CCIS", Springer, 748 (2017), ISBN: 978-3-319-64217-8; S. 125 - 137.

Zusätzliche Informationen


Abstract:


The application of best-practice software inspection processes for
early defect detection requires considerable human effort. Crowdsourcing
approaches can support inspection activities (a) by distributing inspection effort
among a group of human experts and (b) by increasing inspection control. Thus,
the application of crowdsourcing techniques aims at making inspection processes
more effective and efficient. In this paper, we present a crowdsourcing-supported
model inspection (CSI) process and investigate its defect detection effectiveness
and efficiency when inspecting an Extended Entity Relationship (EER) model.
The CSI process uses so-called Expected Model Elements (EMEs) to guide CSI
inspectors during defect detection. We conducted a controlled experiment on
defect detection effectiveness, efficiency, and false positives. While CSI effec‐
tiveness and efficiency is lower for CSI inspectors, the number of false positives
decreases. However, CSI was found promising for increasing the control of defect
detection and supports the inspection of large-scale engineering models.