Fig 2 - uploaded by Maximilian Speicher
Content may be subject to copyright.
Structure of usability derived from the guideline reviews. Struck through factors were removed, factors in dashed boxes were added after the expert interviews.

Structure of usability derived from the guideline reviews. Struck through factors were removed, factors in dashed boxes were added after the expert interviews.

Source publication
Article
Full-text available
Explicit user testing tends to be costly and time-consuming from a company’s point of view. Therefore, it would be desirable to infer a quantitative usability score directly from implicit feedback, i.e., the interactions of users with a web interface. As a basis for this, we require an adequate usability instrument whose items form a usability scor...

Contexts in source publication

Context 1
... the seven factors from Table 1, we could describe all of the relevant usability rules extracted from the reviewed guidelines. Subsequently, based on the definition given by ISO 9241-11 [14] and own experience with usability evaluations, we constructed a structure of usability as shown in Figure 2. ...
Context 2
... requirement R2 in mind. That is, showing positive and negative examples on the web, they should indicate factors that potentially directly affect patterns of user interaction. All statements were recorded accordingly (Fig. 3, bottom right). Second, we presented the experts with a pen and a sheet of paper showing the above structure of usability (Fig. 2) and asked them to modify it in such a way that it reflected their perception of usability (Fig. 3, top ...
Context 3
... from this, the experts generally agreed with the structure of usability that was given as a starting point (Fig. ...
Context 4
... on the findings from the interviews and careful review of existing research [1,15], we revised the structure of usability given in Figure 2. That is, we added user confusion as a sub-factor of efficiency. ...

Citations

... 10 Effectiveness relates to the "accuracy and completeness with which users achieve specific goals" 19 and includes, for example, the informativeness and understandability of the system. 22 Efficiency relates to "resources used in relation to the results achieved" 19 and includes, for instance, readability and reachability of the system. 22 To improve the effectiveness and efficiency of an eHealth system, usability evaluations are implemented. ...
... 22 Efficiency relates to "resources used in relation to the results achieved" 19 and includes, for instance, readability and reachability of the system. 22 To improve the effectiveness and efficiency of an eHealth system, usability evaluations are implemented. ...
Article
Full-text available
Background Electronic health (eHealth) usability evaluations of rapidly developed eHealth systems are difficult to accomplish because traditional usability evaluation methods require substantial time in preparation and implementation. This illustrates the growing need for fast, flexible, and cost-effective methods to evaluate the usability of eHealth systems. To address this demand, the present study systematically identified and expert-validated rapidly deployable eHealth usability evaluation methods. Objective Identification and prioritization of eHealth usability evaluation methods suitable for agile, easily applicable, and useful eHealth usability evaluations. Methods The study design comprised a systematic iterative approach in which expert knowledge was contrasted with findings from literature. Forty-three eHealth usability evaluation methods were systematically identified and assessed regarding their ease of applicability and usefulness through semi-structured expert interviews with 10 European usability experts and systematic literature research. The most appropriate eHealth usability evaluation methods were selected stepwise based on the experts' judgements of their ease of applicability and usefulness. Results Of these 43 eHealth usability evaluation methods identified as suitable for agile, easily applicable, and useful eHealth usability evaluations, 10 were recommended by the experts based on their usefulness for rapid eHealth usability evaluations. The three most frequently recommended eHealth usability evaluation methods were Remote User Testing, Expert Review, and Rapid Iterative Test and Evaluation Method. Eleven usability evaluation methods, such as Retrospective Testing, were not recommended for use in rapid eHealth usability evaluations. Conclusion We conducted a systematic review and expert-validation to identify rapidly deployable eHealth usability evaluation methods. The comprehensive and evidence-based prioritization of eHealth usability evaluation methods supports faster usability evaluations, and so contributes to the ease-of-use of emerging eHealth systems.
... In the design phase, automated usability tests [8,30,46] can play an important role in making the design process more user-centered and efficient at the same time. The fact that the context of use, i.e. the driving situation, is inherently contained in field data is another key advantage. ...
Conference Paper
We are interested in the role of field user interaction data in the development of In-Vehicle Information Systems (IVISs), the potentials practitioners see in analyzing this data, the concerns they share, and how this compares to companies with digital products. We conducted interviews with 14 UX professionals, 8 from automotive and 6 from digital companies, and analyzed the results by emergent thematic coding. Our key findings indicate that implicit feedback through field user interaction data is currently not evident in the automotive UX development process. Most decisions regarding the design of IVISs are made based on personal preferences and the intuitions of stakeholders. However, the interviewees also indicated that user interaction data has the potential to lower the influence of guesswork and assumptions in the UX design process and can help to make the UX development lifecycle more evidence-based and user-centered. CCS CONCEPTS • General and reference → Surveys and overviews; • Human-centered computing → HCI design and evaluation methods; Empirical studies in HCI. KEYWORDS interview study, user experience, in-vehicle information systems ACM Reference Format:
... In the design phase, automated usability tests [8,30,46] can play an important role in making the design process more user-centered and efficient at the same time. The fact that the context of use, i.e. the driving situation, is inherently contained in field data is another key advantage. ...
Preprint
We are interested in the role of field user interaction data in the development of IVIS, the potentials practitioners see in analyzing this data, the concerns they share, and how this compares to companies with digital products. We conducted interviews with 14 UX professionals, 8 from automotive and 6 from digital companies, and analyzed the results by emergent thematic coding. Our key findings indicate that implicit feedback through field user interaction data is currently not evident in the automotive UX development process. Most decisions regarding the design of IVIS are made based on personal preferences and the intuitions of stakeholders. However, the interviewees also indicated that user interaction data has the potential to lower the influence of guesswork and assumptions in the UX design process and can help to make the UX development lifecycle more evidence-based and user-centered.
... However, previous studies have overlooked this approach in investigating the usability of BIM library interfaces. Factors affecting the usability of an interface include informativeness, reachability of desired content, density, readability, and comprehensibility of the information (Speicher et al., 2015), and credibility of the website (Holliman & Rowley, 2014). Some usability problems are primarily system issues arising when information or functionality is missing, inadequate, misplaced, unnecessary, or misaligned (Tarkkanen et al., 2015). ...
Article
Full-text available
Building Information Modelling (BIM) objects represent buildingproducts in design, simulation, and procurement processes. This paper explores how BIM objects could be created and exchanged to enable the diffusion of innovative products with enhanced sustainability performance. Two BIM library platforms were examined by taking a new approach that integrates the concepts of sustainable value, diffusion of innovations, information, software usability, and platform ecosystems. The findings show that the diffusion of sustainable products can be inhibited due to problems with the mechanisms for creating and exchanging BIM objects, quality of BIM objects, the usability of BIM library platforms, and participation on the platforms. This study deepens understanding of the problems by focusing on ventilation products in Sweden. Identified shortcomings in the current practices of BIM platform owners and participants would be reduced by effective platform strategies, certification schemes for BIM objects, and BIM object creation processes integrated with product lifecycle management.
... Earlier versions of parts of this chapter have been published asSpeicher et al. (2013b) andSpeicher et al. (2015b). ...
Thesis
Full-text available
Over the past 25 years, search engines have become the entry point of the WWW. Therefore, search engine results pages (SERPs) are among the most important interfaces on the web. Since the kinds of available information as well as the needs of users and search engines are constantly evolving, it is crucial to continuously evaluate and optimize the usability of SERPs. Yet, established approaches are either not effective or perceived as costly and time-consuming by companies and therefore not thoroughly applied. Moreover, existing methods for predicting search result relevance, which are mostly based on clicks, are not tailored to the evolving kinds of SERPs. For instance, they fail if queries are answered directly on a SERP and no results need to be clicked. Applying Human-Centered Design principles, we propose a solution to the above in terms of a holistic approach: The Search Interaction Optimization toolkit. It provides novel concepts and automatic methods that make use of implicit user feedback for efficient and effective evaluation and optimization of usability as well as, in particular, search result relevance. The toolkit comprises six components and has been evaluated based on comprehensive user studies involving real-world search engines. The evaluations have shown that our approach is able to effectively detect shortcomings in usability and to significantly improve the usability of SERPs.
... In 2014, I submitted a research paper about a concept called Usability-based Split Testing 1 to a web engineering conference [10]. My evaluation involved a questionnaire that asked for ratings of different factors of usability based on a novel usability instrument specifically developed for web interfaces [11]. This instrument comprises the items informativeness, understandability, confusion, distraction, readability, information density and reachability, which have been identified as factors of usability in a confirmatory factor analysis [11]. ...
... My evaluation involved a questionnaire that asked for ratings of different factors of usability based on a novel usability instrument specifically developed for web interfaces [11]. This instrument comprises the items informativeness, understandability, confusion, distraction, readability, information density and reachability, which have been identified as factors of usability in a confirmatory factor analysis [11]. So obviously, I use the word "usability" in that paper a lot; however, without having thought of its exact connotation in the context of my research before. ...
... Moreover, I had already made use of the definition given in ISO 9241-11 [1] for developing the usability questionnaire (cf. [11]) used in my evaluation: ...
Technical Report
Full-text available
According to Brooke* "Usability does not exist in any absolute sense; it can only be defined with reference to particular contexts." That is, one cannot speak of usability without specifying what that particular usability is characterized by. Driven by the feedback of a reviewer at an international conference, I explore in which way one can precisely specify the kind of usability they are investigating in a given setting. Finally, I come up with a formalism that defines usability as a quintuple comprising the elements level of usability metrics, product, users, goals and context of use. Providing concrete values for these elements then constitutes the investigated type of usability. The use of this formalism is demonstrated in two case studies. * J. Brooke. SUS: A "quick and dirty" usability scale. In P. W. Jordan, B. Thomas, B. A. Weerdmeester, and A. L. McClelland, editors, Usability Evaluation in Industry. Taylor and Francis, 1996.
Article
Full-text available
The Interactions website (interactions.acm.org) hosts a stable of bloggers who share insights and observations on HCI, often challenging current practices. Each issue we'll publish selected posts from some of the leading and emerging voices in the field.
Conference Paper
This research Investigates how Task Analysis allows user to accomplish their task and obtain the information they require in an efficient and effective manner. Usability is the major factor for the use of any product or system and can be enhanced through many ways. Usability can be defined as necessity for web. If a website does not fulfill the needs of the user or it is difficult for a user to use, the user will leave the page. The research deals with the enhancement of user experience by task analysis. In this research issues related to usability of SME’s (Small and Medium Enterprise) websites would be highlighted and enlighten how Task Analysis would be helpful to remove the shortcomings or flaws of existing websites. This research will use survey method and card sorting technique along task analysis for redesigning. The proposed design would be according to the user’s need and easy for user to fulfill its goal.
Conference Paper
Full-text available
This research Investigated how Task Analysis allows user to accomplish their task and obtain the information they require in an efficient and effective manner. In this modern era Usability has become major factor for the use of any product or system can be enhanced through many ways. Usability of websites is the major issue user finds difficulties to find its desired stuff or information the website. Usability can be defined as necessity for web. If a website does not fulfil the needs of the user or it is difficult for a user to use, the user will leave the page. The research deals with the enhancement of user experience by task analysis. It would be helpful to remove the shortcomings or flaws of existing websites. Fig 1 highlight the framework of this research. Fig 1: Framework This research will use survey method and card sorting technique along task analysis for redesigning. The proposed design would be according to the user's need and easy for user to fulfil its goal.