Table 3 - uploaded by Elaine Pearson
Content may be subject to copyright.
Source publication
The Accessibility Evaluation Assistant (AEA) is a web accessibility knowledge management tool designed specifically to assist novice auditors in conducting an accessibility evaluation. The software incorporates a bespoke structured walkthrough approach designed to guide the auditor through a series of checks based on established accessibility princ...
Context in source publication
Context 1
... this experiment we define reliability as the extent to which the novices' decisions matched each other. Table 3 shows the figures broken down by each group so we can examine if results are influenced by one of the independent variables: website or method used. Table 4 shows the overall figure for reliability averaged across each tool and site. ...
Similar publications
Effective evaluation of websites for accessibility remains problematic. Automated evaluation tools still require a significant manual element. There is also a significant expertise and evaluator effect. The Structured Walkthrough method is the translation of a manual, expert accessibility evaluation process adapted for use by novices. The method is...
The Accessibility Evaluation Assistant (AEA) is a web accessibility knowledge management tool designed specifically to assist novice auditors in conducting an accessibility evaluation. The software incorporates a bespoke structured walkthrough approach designed to guide the auditor through a series of checks based on established accessibility princ...
Citations
... The evaluations produced by novices using the Structured Walkthrough method when compared to a WCAG 2.0 Conformance Review was found to be more effective, with higher levels of reliability and validity. Analysis of the qualitative data indicated that the students perceived the Structured Walkthrough method to be more useful and viable [5]. ...
Effective evaluation of websites for accessibility remains problematic. Automated evaluation tools still require a significant manual element. There is also a significant expertise and evaluator effect. The Structured Walkthrough method is the translation of a manual, expert accessibility evaluation process adapted for use by novices. The method is embedded in the Accessibility Evaluation Assistant (AEA), a web accessibility knowledge management tool. Previous trials examined the pedagogical potential of the tool when incorporated into an undergraduate computing curriculum. The results of the evaluations carried out by novices yielded promising, consistent levels of validity and reliability. This paper presents the results of an empirical study that compares the reliability of accessibility evaluations produced by two groups (novices and experts). The main results of this study indicate that overall reliability of expert evaluations was 76% compared to 65% for evaluations produced by novices. The potential of the Structured Walkthrough method as a useful and viable tool for expert evaluators is also examined.
