Table 1 - uploaded by Chris Bailey
Content may be subject to copyright.
Source publication
The Accessibility Evaluation Assistant (AEA) is a web accessibility knowledge management tool designed specifically to assist novice auditors in conducting an accessibility evaluation. The software incorporates a bespoke structured walkthrough approach designed to guide the auditor through a series of checks based on established accessibility princ...
Citations
... During our literature review, we found that multiple instructors attempted to use accessibility tools and guidelines in their courses. However, tools and guidelines can be difficult for novices to understand [2,6] which was reflected in some studies reporting on instructors' feedback. Resources that are hard to use and understand can negatively affect teaching. ...
... Kawas et al. [9] proposed that we can introduce accessibility content in four different ways: as (1) core topics, (2) examples, (3) context and (4) motivating problems. Most of the papers in our literature review focused on the first approach, introducing accessibility as a core topic in elective courses, though a few used the other approaches suggested (e.g. ...
... The evaluations produced by novices using the Structured Walkthrough method when compared to a WCAG 2.0 Conformance Review was found to be more effective, with higher levels of reliability and validity. Analysis of the qualitative data indicated that the students perceived the Structured Walkthrough method to be more useful and viable [5]. This paper presents the results of a third experiment designed to measure and compare the effectiveness of evaluations produced using the AEA by a number of experts as well as novices. ...
... The reliability level of novice evaluations of the Fitness First homepage was 62% while the reliability of the evaluations of the Pure Gym homepage was 67%; this gives an overall figure of 65%. This is consistent with the overall level of reliability of evaluations produced by novices using the Structured Walkthrough Method in previous studies which ranged from 63% -78% [4,5]. When looking at the results of the individual checks, generally, reliability was higher for experts, but in the results of three checks (Keyboard Navigation, Skip Navigation Link and Form Labels) reliability was higher in the novice evaluations. ...
... These issues are consistent with issues reported by novices in previous studies [4,5]. While this is clearly an issue that need resolving, the AEA itself is a working prototype and many issues will be resolved with a redevelopment of the user interface. ...
Effective evaluation of websites for accessibility remains problematic. Automated evaluation tools still require a significant manual element. There is also a significant expertise and evaluator effect. The Structured Walkthrough method is the translation of a manual, expert accessibility evaluation process adapted for use by novices. The method is embedded in the Accessibility Evaluation Assistant (AEA), a web accessibility knowledge management tool. Previous trials examined the pedagogical potential of the tool when incorporated into an undergraduate computing curriculum. The results of the evaluations carried out by novices yielded promising, consistent levels of validity and reliability. This paper presents the results of an empirical study that compares the reliability of accessibility evaluations produced by two groups (novices and experts). The main results of this study indicate that overall reliability of expert evaluations was 76% compared to 65% for evaluations produced by novices. The potential of the Structured Walkthrough method as a useful and viable tool for expert evaluators is also examined.