The Evaluation of Adaptive and User-Adaptive Systems: A Review
File Type:
PDFItem Type:
Journal ArticleDate:
2011Citation:
Catherine Mulwa, Séamus Lawless, Mary Sharp and Vincent Wade, The Evaluation of Adaptive and User-Adaptive Systems: A Review, International Journal of Knowledge and Web Intelligence, 2, 2/3, 2011, 138 - 156Download Item:
IJKWI202-303_Mulwa et al.pdf (Published (publisher's copy) - Peer Reviewed) 322.8Kb
Abstract:
A current problem with the research of adaptive systems is the inconsistency of evaluation applied to the adaptive systems. However, evaluating an adaptive system is a difficult task due to the complexity of such systems. Evaluators need to ensure correct evaluation methods and measurement metrics are used. This paper reviews a variety of evaluation techniques applied in adaptive and user-adaptive systems. More specifically, it focuses on the user-centred evaluation of adaptive systems such as personalised recommender systems and adaptive information retrieval systems. The review tackles the question of `How have user-centred evaluations of adaptive and user-adaptive systems been conducted and how can these evaluation practices be improved?? Based on the analysed results of the: (a) evaluation approaches, (b) user-centred evaluation techniques, and (c) evaluation metrics, we propose an evaluation framework for end-user experience in evaluating adaptive systems (EFEx).
Sponsor
Grant Number
Science Foundation Ireland (SFI)
07/CE/I1142
Author's Homepage:
http://people.tcd.ie/selawleshttp://people.tcd.ie/msharp
http://people.tcd.ie/vwade
Description:
PUBLISHEDType of material:
Journal ArticleCollections:
Series/Report no:
International Journal of Knowledge and Web Intelligence2
2/3
Availability:
Full text availableKeywords:
Computer Science and Engineering, adaptive information retrieval systems, user-adaptive systems, user-centred evaluationsSubject (TCD):
Intelligent Content & CommunicationsLicences: