Evaluating system utility and conceptual fit using CASSM

Blandford, A. and Green, T.R.G. and Furniss, D. and Makri, S. (2008) Evaluating system utility and conceptual fit using CASSM. International Journal of Human–Computer Studies, 66 (6). pp. 393-409. ISSN 10715819 06/2008; DOI: 10.1016/j.ijhcs.2007.11.005
Source: OAI

ABSTRACT There is a wealth of user-centred evaluation methods (UEMs) to support the analyst in assessing interactive systems. Many of these support detailed aspects of use—for example: is the feedback helpful? Are labels appropriate? Is the task structure optimal? Few UEMs encourage the analyst to step back and consider how well a system supports users’ conceptual understandings and system utility. In this paper, we present CASSM, a method, which focuses on the quality of ‘fit’ between users and an interactive system. We describe the methodology of conducting a CASSM analysis and illustrate the approach with three contrasting worked examples (a robotic arm, a digital library system and a drawing tool) that demonstrate different depths of analysis. We show how CASSM can help identify re-design possibilities to improve system utility. CASSM complements established evaluation methods by focusing on conceptual structures rather than procedures. Prototype tool support for completing a CASSM analysis is provided by Cassata, an open source development.

  • [Show abstract] [Hide abstract]
    ABSTRACT: The phrase "lifelong learning" places emphasis on the fact that learning continues beyond the classroom and formal educational environments, though it is often supported by training within the workplace. Continued professional development is particularly important within the context of healthcare, where technology is constantly evolving and errors run the risk of causing serious harm to patients. This paper considers the case of infusion device training within UK hospitals. Interviews were carried out with staff involved in medical device training and management across seven National Health Service trusts. The analysis indicates the range of training provided by different institutions and highlights important issues that influence how users develop their understanding of these devices. Further, the research indicates that while there is an increasing interest in e-learning as a way to overcome some of the challenges trainers face in relation to time and resources, there are also significant concerns which need to be addressed when considering this approach.
    Proceedings of the 31st European Conference on Cognitive Ergonomics; 08/2013
  • [Show abstract] [Hide abstract]
    ABSTRACT: Programming languages have been rarely discussed from the perspective of user-centered design when compared to GUIs or Human Interface Devices. We de-scribe our case study in user-centered design of a do-main-specific language (DSL) for computer music. Since the potential usability problems of a DSL is large-ly unforeseeable in the early phase of the design, we took an approach that begins with the analysis of the usability problems in an existing DSL and then use the analysis for redesign of the DSL and design of a new DSL. The frameworks provided by the previous HCI studies are introduced into the design process. Such an approach is also valuable for claim-evidence corre-spondences for usability claims, which have been lack-ing in language design today.
  • [Show abstract] [Hide abstract]
    ABSTRACT: What does it mean to "engineer" an interactive computer system? Is it about the team doing the work (that they are engineers), about the process being followed, about the application domain, or what? Is engineering about managing complexity, safety or reliability? For physical artifacts, it may be possible to achieve consensus on how well engineered a product is, but this is more difficult for digital artifacts. In this talk, I will offer some perspectives, both positive and negative, on the nature of engineering for interactive computer systems and, at least implicitly, the nature and future of the EICS conference series.
    Proceedings of the 5th ACM SIGCHI symposium on Engineering interactive computing systems; 06/2013

Full-text (3 Sources)

Available from
May 19, 2014