Weibelzahl, S. (2005). Problems and pitfalls in the evaluation of adaptive systems. In S. Y. Chen & G. D. Magoulas (Eds.), Adaptable and Adaptive Hypermedia Systems (pp. 285-299). Hershey, PA: IRM Press
DOI: 10.4018/978-1-59140-567-2.ch015
Empirical studies with adaptive systems offer many advantages and opportunities. Nevertheless, there is still a lack of evaluation studies. This chapter lists several problems and pitfalls that arise when evaluating an adaptive system and provides guidelines and recommendations for workarounds or even avoidance of these problems. Among other things the following issues are covered: relating evaluation studies to the development cycle; saving resources; specifying control conditions, sample and criteria; asking users for adaptivity effects; reporting results. An overview of existing evaluation frameworks shows which of these problems have been addressed in which way.
@incollection{weibelzahl-aahs04,
author = {Stephan Weibelzahl},
title = {Problems and pitfalls in the evaluation of adaptive systems},
booktitle = {Adaptable and Adaptive Hypermedia Systems},
year = {2005},
editor = {Sherry Y. Chen and George D. Magoulas},
pages = {285--299},
publisher = {{IRM} Press},
address = {Hershey, {PA}},
doi = {10.4018/978-1-59140-567-2.ch015}
}