Joseph 'Jofish' Kaye’s research while affiliated with Mountain View College and other places

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (75)


HCI 2020: Looking Back to the Future
  • Conference Paper
  • Full-text available

May 2021

·

75 Reads

·

1 Citation

Jofish Kaye

·

·

Yvonne Rogers

·

[...]

·

In March, 2007, a forum entitled HCI 2020: Human Values in a Digital Age, was held in Sanlúcar la Mayor, Spain, just outside Seville. Its purpose was to gather luminaries in computing, design, social sciences, and scientific philosophy to discuss, debate and help formulate an agenda for human-computer interaction (HCI) over the next decade and beyond. This resulted in a detailed report, released in April 2008, in the form of a book called Being Human: Human-Computer Interaction in the Year 20201, authored by 45 members of the wider HCI community. In this panel, we shall build from four core questions. How successfully did the HCI 2020 forum and report recognize trends and shape HCI? What major trends or issues did they fail to anticipate? How valuable to the HCI community, to the participants, and to the sponsoring organizations was the forum and the report? And finally, what does this history suggest about both the process and the ultimate value to HCI, to computing in general, and to the world, of creating a HCI 2035 vison?.

Download

Figure 1: Each participant read one of 6 articles, as detailed in Table 1. Shown above are the USA Today x Self-Driving Cars (left) and The Verge x Firefox Performance (right) articles.
Figure 2: Participants each viewed 4 videos: Mozilla Chrome opening a new window and a new tab and Google Chrome opening a new window and a new tab. Shown above are Google Chrome opening a new window (top) and Mozilla Firefox opening a new tab (bottom).
Participants in the control condition who endorsed Chrome, Firefox, or Neither as faster. More participants rated
"This Browser is Lightning Fast": The Effects of Message Content on Perceived Performance

March 2021

·

166 Reads

With technical performance being similar for various web browsers, improving user perceived performance is integral to optimizing browser quality. We investigated the importance of priming, which has a well-documented ability to affect people's beliefs, on users' perceptions of web browser performance. We studied 1495 participants who read either an article about performance improvements to Mozilla Firefox, an article about user interface updates to Firefox, or an article about self-driving cars, and then watched video clips of browser tasks. As the priming effect would suggest, we found that reading articles about Firefox increased participants' perceived performance of Firefox over the most widely used web browser, Google Chrome. In addition, we found that article content mattered, as the article about performance improvements led to higher performance ratings than the article about UI updates. Our findings demonstrate how perceived performance can be improved without making technical improvements and that designers and developers must consider a wider picture when trying to improve user attitudes about technology.




Fig. 1. Breakdown of command categories on Google Home and Amazon Alexa
Music, Search, and IoT: How People (Really) Use Voice Assistants

April 2019

·

3,743 Reads

·

385 Citations

ACM Transactions on Computer-Human Interaction

Voice has become a widespread and commercially viable interaction mechanism with the introduction of voice assistants (VAs), such as Amazon’s Alexa, Apple’s Siri, Google Assistant, and Microsoft’s Cortana. Despite their prevalence, we do not have a detailed understanding of how these technologies are used in domestic spaces. To understand how people use VAs, we conducted interviews with 19 users, and analyzed the log files of 82 Amazon Alexa devices, totaling 193,665 commands, and 88 Google Home Devices, totaling 65,499 commands. In our analysis, we identified music, search, and IoT usage as the command categories most used by VA users. We explored how VAs are used in the home, investigated the role of VAs as scaffolding for Internet of Things device control, and characterized emergent issues of privacy for VA users. We conclude with implications for the design of VAs and for future research studies of VAs.


Moving Towards a Journal-centric Publication Model for CHI: Possible Paths, Opportunities and Risks

April 2019

·

23 Reads

As a scholarly field, the ACM SIGCHI community maintains a strong focus on conferences as its main outlet for scholarly publication. Historically, this originates in how the field of computer science adopted a conference-centric publication model as well as in the organizational focus of ACM. Lately, this model has become increasingly challenged for a number of reasons, and multiple alternatives are emerging within the SIGCHI community as well as in adjacent communities. Through revisiting examples from other conferences and neighboring communities, this panel explores alternative publication paths and their opportunities and risks.


Accessible Voice Interfaces

October 2018

·

634 Reads

·

33 Citations

Voice interfaces such as in-home and mobile digital assistants, mobile screen readers, and chatbots are tools that can support communication, collaboration, and information seeking, and are becoming increasingly commonplace. Because they don't require the motor skills needed for text input through a keyboard, the barriers of entry and use for older adults and people with disabilities are lowered. Yet, accessibility of speech interaction can still be a challenge. Using and designing voice interfaces is radically different from graphical interfaces, redefining how we must think about accessibility and what it means for a conversation to be accessible. This workshop invites submissions from researchers whose work advances the study of, design, and use of voice-based interfaces by older adults and people with disabilities. At the workshop, we will 1) explore recent advances in accessibility and voice interface research, 2) situate voice-based accessibility in prior work and existing theoretical frameworks, 3) discuss open challenges in the design of voice-based systems, and 4) identify opportunities for interdisciplinary collaboration to continue research in this field.


Will Automatically Importing User Data Help Overcome the Blank Slate Problem?

April 2018

·

16 Reads

The 'blank slate problem' - the difficulty of initial use upon using a new program - is a common user experience problem. In this paper, we explore one solution: importing data from a similar product. Our team created a feature for our browser onboarding process that automatically imports data from the user's pre-existing browser. We then conducted remote, unmoderated usability studies and quantitative experiments. Our initial findings show that autoimport can solve the blank slate problem by getting users started quickly with the browser, but introduces issues related to perceived privacy and performance. We provide recommendations that can impact design decisions related to user data and user perceptions of their privacy, particularly as it relates to tech proficiency.


Panel: Voice Assistants, UX Design and Research

April 2018

·

2,103 Reads

·

23 Citations

In this panel, we discuss the challenges that are faced by HCI practitioners and researchers as they study how voice assistants (VA) are used on a daily basis. Voice has become a widespread and commercially viable interaction mechanism with the introduction of VAs such as Amazon's Alexa, Apple's Siri, the Google Assistant, and Microsoft's Cortana. Despite their prevalence, the design of VAs and their embeddedness with other personal technologies and daily routines have yet to be studied in detail. Making use of a roundtable, we will discuss these issues by providing a number of VA use scenarios that panel members will discuss. Some of the issues that researchers will discuss in this panel include: (1) obtaining VA data & privacy concerns around the processing and storage of user data; (2) the personalization of VAs and the user value derived from this interaction; and (3) the relevant UX work that reflects on the design of VAs?


The Effect of Ad Blocking on User Engagement with the Web

April 2018

·

398 Reads

·

51 Citations

Web users are increasingly turning to ad blockers to avoid ads, which are often perceived as annoying or an invasion of privacy. While there has been significant research into the factors driving ad blocker adoption and the detrimental effect to ad publishers on the Web, the resulting effects of ad blocker usage on Web users' browsing experience is not well understood. To approach this problem, we conduct a retrospective natural field experiment using Firefox browser usage data, with the goal of estimating the effect of adblocking on user engagement with the Web. We focus on new users who installed an ad blocker after a baseline observation period, to avoid comparing different populations. Their subsequent browser activity is compared against that of a control group, whose members do not use ad blockers, over a corresponding observation period, controlling for prior baseline usage. In order to estimate causal effects, we employ propensity score matching on a number of other features recorded during the baseline period. In the group that installed an ad blocker, we find significant increases in both active time spent in the browser (+28% over control) and the number of pages viewed (+15% over control), while seeing no change in the number of searches. Additionally, by reapplying the same methodology to other popular Firefox browser extensions, we show that these effects are specific to ad blockers. We conclude that ad blocking has a positive impact on user engagement with the Web, suggesting that any costs of using ad blockers to users' browsing experience are largely drowned out by the utility that they offer.


Citations (67)


... Laying a high-level tangible roadmap can provide the opportunity to effectively solve problems by uniting researchers to move towards a common goal. Examples of such visionary goals have been proposed (e.g., [2,3]) and discussed (e.g., [1,7]) in our research community. We trust that the Human-Computer Interaction (HCI) and related research communities, including computer-supported cooperative work and social computing (CSCW) need a research roadmap. ...

Reference:

Telelife: A Vision of Remote Living in 2035
HCI 2020: Looking Back to the Future

... from the Berkman Klein Center for Internet & Society at Harvard University and another byHagendorff (2019). Other recent reports include the general framework developed inRicks et al. (2020) and faith-based frameworks includingMoore et al. (2019) for the Ethics and Religious Liberty Commission of the Southern Baptist Convention or the Catholic Church in the Rome Call for AI Ethics (2020), signed by IBM and Microsoft 3 . These frameworks address different overlapping principles, some of which are relevant to medical ethics as described below.Fjeld et al. (2020), for example, classify 35 different ethical frameworks in the context of AI, in eight themes: Privacy, Accountability, Safety and Security, Transparency and Explainability, Fairness and Non-discrimination, Human Control of Technology, Professional Responsibility, and Promotion of Human Values. ...

Creating Trustworthy AI: A Mozilla white paper on challenges and opportunities in the AI era

... Researchers usually forget this perspective when focusing on "end-user developers" [39], "conversational content curators" [90], and "builders" [62]. Most of the studies published in HCI and conversational user interfaces conferences and journals [1,14,19,51,57] direct their attention to final user challenges and neglect the invisible work of data curators. ...

CUI@CSCW: Collaborating through Conversational User Interfaces
  • Citing Conference Paper
  • October 2020

... Incorporation as a second sub-category of appropriation is described as a longer process whereby devices get incorporated into routines. For smart speakers, a number of studies have shown that routinization is often primarily about reducing the number of use cases: after an initial phase of extensive testing of a wide range of tasks, users tend to limit their usage to rather simple commands, mostly to operate other smart home devices, play music, and obtain information, while other use cases rarely seem to get established (Ammari et al. 2019;Pins et al. 2020). These observed tendencies even fed rumors that Amazon's Alexa, the most widely used smart speaker on the market, was proving not monetizable because 'consumers' were not using the affordances that generated revenue for the provider (e.g., voice shopping). ...

Music, Search, and IoT: How People (Really) Use Voice Assistants

ACM Transactions on Computer-Human Interaction

... The first approach achieved a recognition rate of 98.7%, while the second achieved a rate of 98.86%, offering higher accuracy but slower processing [13]. In order to explore recent advancements in accessibility research, Brewer, R. N. et al. situates voice-based accessibility within existing theoretical frameworks, discusses design challenges, and identifies opportunities for interdisciplinary collaboration in this area [14]. In the same context, Kuhn [7]. ...

Accessible Voice Interfaces
  • Citing Conference Paper
  • October 2018

... The design of CUIs [22,28,58] requires a deep understanding of HCI principles, ensuring that these systems can handle the nuances of human dialogue, such as turn-taking, repair mechanisms, and emotional engagement [23,52,58]. ...

Panel: Voice Assistants, UX Design and Research

... Miroglio et al. further explore the effect of ad-blocking on user engagement, demonstrating that sites free from intrusive ads see higher engagement levels and improved performance. By blocking resource-heavy ads, these adblockers help conserve device energy, which is especially important in maintaining battery life and reducing the overall energy footprint of digital interactions [14]. ...

The Effect of Ad Blocking on User Engagement with the Web
  • Citing Conference Paper
  • April 2018

... One of the primary functions of photography for nearly all photographers is that photos help them to recall events (Markwell, 1997;Boulanger et al., 2016). It has been well-documented that people value and get more out of experiences than physical objects (Packer, 2006;Ballantyne et al., 2010;Kruger & Saayman, 2010). ...

The Design, Perception, and Practice of Tablet Photography
  • Citing Conference Paper
  • June 2016

... Although such an approach has been effectively used for detecting new stories[39]and streaming similarity self-join[34], it is less ideal for search and recommendations, where old items are known to be valuable to users[27,42,11]. We suggest instead Smooth – a randomized retention policy that gradually eliminates index entries over time. ...

The 32 Days of Christmas: Understanding Temporal Intent in Image Search Queries
  • Citing Conference Paper
  • May 2016

... Recently, a growing body of research has examined the imagery shared on social media. For instance, Bakhshi et al. (2015Bakhshi et al. ( , 2016 found visual features like exposure, entropy, and color palette contribute to online social engagement and connections. Manikonda and De Choudhury (2017) suggested that minimalist visual cues (e.g., brightness, contrast) selected by individuals may reflect a desire to draw attention to their psychological states in mental health disclosures, which are also known to attract involuntary attention due to visual salience (Prinzmetal, Long, and Leonhardt 2008). ...

Fast, Cheap, and Good: Why Animated GIFs Engage Us
  • Citing Conference Paper
  • May 2016