Stephanie Ludi’s research while affiliated with University of North Texas and other places

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (84)


Study overview
Example of Stack Overflow’s duplicate post handling. The highlighted section shows how a duplicate question is merged with an existing post
of Stack Overflow growth over the years
Count of accessibility questions and accepted answers per year
Taxonomy of accessibility-related aspects discussed by developers in Stack Overflow
Understanding developer challenges and trends in web accessibility: a stack overflow analysis
  • Article
  • Publisher preview available

November 2024

·

33 Reads

·

·

·

[...]

·

Many standards and guidelines are available to promote the accessibility of digital products and services, yet developers may still struggle to comprehend how they can be applied. In this study, we investigate Stack Overflow posts in order to comprehend the challenges developers confront in the context of web accessibility. Our analysis involved manually labeling 5,092 posts associated with web accessibility to ensure the credibility and consistency of our results. In addition, a formal open-coding approach was employed to generate a taxonomy that delineates the various aspects developers discuss concerning accessibility in web applications. Our analysis revealed that accessibility posts had increased significantly through the years and that approximately 18.36% of the accessibility issues were associated with screen reader behavior. Our study also indicates that most discussions are a call to assistance to improve their application accessibility for visual impairments. The analysis of developers’ queries on Stack Overflow reveals several distinct trends. These findings provide a more comprehensive understanding of the challenges that developers face when it comes to web accessibility.

View access options




Figure 2. Dataset.
Figure 3. Prediction times of each model.
Figure 4. Validation loss of each model.
Figure 5. LIME plot for predicting satisfaction class.
Figure 6. LIME plot for predicting effectiveness class.
LIME-Aided Automated Usability Issue Detection from User Reviews: Leveraging LLMs for Enhanced User Experience Analysis

Mobile applications have become essential in today's digital landscape so optimizing their User eXperiences (UX) is essential. Our study explored the application of Large Language Models (LLMs), including some Bidirectional Encoder Representations from Transformers (BERT) family architectures and advanced pre-trained models like Generative Pre-trained Transformer (GPT) by OpenAI GPT-3.5, GPT-4, and Llama 2 by Meta (zero and few-shot), for detecting usability issues in user reviews. The methodology encompassed data preprocessing, sentiment analysis, fine-tuning LLMs, and interpretability techniques, notably Local Interpretable Model-Agnostic Explanations (LIME). The findings indicated that the fine-tuned LLMs, particularly, Robustly Optimized BERT Approach (RoBERTa), XLNet, and DistilBERT were relatively successful in identifying the usability issues, achieving an accuracy rate of 96%. The study also assessed advanced pre-trained models Llama 2, GPT-3.5, and GPT-4, which generally fell short of the performance achieved by fine-tuned models. Finally, we also discovered the use of LIME that helped in understanding the decision-making processes of the fine-tuned models.





Overview of Assets 2022

October 2023

·

7 Reads

ACM SIGACCESS Accessibility and Computing

The 24th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2022), was held in Athens, Greece between October 23rd to 26th, 2022. ASSETS continues to be the premier computing research conference exploring the design, evaluation, and use of computing and information technologies with and for people with disabilities and older adults. ASSETS 2022 was held in-person for the first time since 2019. Due to the continuing COVID-19 pandemic, a lightweight online component for virtual conference attendees was conducted as well. In order to support both accessibility and inclusivity, and balancing technical infrastructure and time-zone constraints, all presentations were also pre-recorded and captioned to support both virtual and in-person conference attendees. There were additional creative opportunities for hybrid connections and socializing across modalities, including online trivia and roundtable social networking events. We acknowledge that future ASSETS organizing committees will need to make their own decisions about the length and format of the conference, and so the decision to have an in-person with light-weight online component is not a permanent decision. Overall, ASSETS 2022 had 161 in-person and 146 virtual attendees from 38 countries and 6 continents. For the first time, we hosted 5 virtual workshops, with 94 workshop-only attendees.



Citations (57)


... Stack Overflow datasets are a particular source of information that has gained popularity in numerous research studies owing to their comprehensive coverage of technical and practical programmer issues and concerns. For example, Alghamdi et al [2] examined 5,092 Stack Overflow posts to identify developers' challenges with web accessibility guidelines. The findings revealed that about 60% of the discussions on the perceivable guideline focused on customizing time-based media and screen reader accessibility. ...

Reference:

Understanding developer challenges and trends in web accessibility: a stack overflow analysis
Accessibility Guidelines and Standards: Analyzing Stack Overflow Posts
  • Citing Conference Paper
  • October 2024

... Usability questions were based on Jakob Nielsen's 10 HCI heuristics [11]. We selected this framework based on its relevance in other studies analyzing the usability of educational applications for children, including IDEs [16], [35]. Prior to conducting the interviews and thematic analysis, the researchers familiarized themselves with Nielsen's heuristics and their applications [36]. ...

Impact of Usability Heuristics on User Satisfaction Among Coding Apps for Children

... However, assertion methods can also negatively impact code quality. Specifically, the test smell Assertion Roulette, where a test method contains multiple assertions without providing context for failures [10], is associated with increased change-proneness in test code [11], [12] and challenges in code comprehension [13]. These problems cannot be addressed without a stronger understanding of assertion messages, including how they are used and how they support comprehension. ...

Do the Test Smells Assertion Roulette and Eager Test Impact Students’ Troubleshooting and Debugging Capabilities?

... Login plays a critical role in Android apps, typically representing the first point of interaction between the application and the users [1]. Issues in login processes can significantly degrade the user experience [2]- [5]. ...

Investigating the User Experience and Evaluating Usability Issues in AI-Enabled Learning Mobile Apps: An Analysis of User Reviews

International Journal of Advanced Computer Science and Applications

... They found 2,157 accessibility bug reports considering the mobile app of both iOS and Android platforms. A similar study of Aljedaani et al [6] analyzed the reviews to extract accessibility issues on the Blackboard mobile app. ...

The State of Accessibility in Blackboard: Survey and User Reviews Case Study

... Hearing impairments, for instance, pose significant communication barriers. Traditional and online classrooms often rely heavily on auditory instruction, leaving students with hearing impairments struggling to access information and fully engage in discussions [7]. The lack of consistent availability and integration of assistive technologies, such as real-time captioning, further exacerbates these challenges, leading to feelings of isolation and exclusion from classroom interactions critical for learning and social development. ...

Teachers Perspectives on Transition to Online Teaching Deaf and Hard-of-Hearing Students during the COVID-19 Pandemic: A Case Study

... Na pesquisa de [Tseng et al. 2022], estudantes foram envolvidos em atividades práticas de processamento de texto através de tarefas de programação e projetos no curso de Processamento de Linguagem Natural (PLN). O curso focou em conceitos fundamentais, como os algoritmos e as suas aplicabilidades, com projetos que envolviam sumarização, classificação, simplificação de texto, extração de informações e criação de chatbots. ...

Exploration on Integrating Accessibility into an AI Course

... However, as participants gained familiarity with the InerSens interface over time, they started to view it as intuitive. This corresponds with the findings from Mountapmbeme et al. (2022) where users initially faced challenges but eventually found the blocks and connections intuitive as they worked along the subsequent tasks. However, the increased number of fixations in InerSens during the Chart Evaluation step should be attributed to its interactive interface rather than to participants still learning the new interface. ...

Accessible Blockly: An Accessible Block-Based Programming Library for People with Visual Impairments
  • Citing Conference Paper
  • October 2022

... Finally, future research on Parsons problems should explore paradigms such as Grid-Coding, speech-driven programming, and the use of problem-solving stages to improve accessibility for neurodiverse programmers, sighted, blind, and low-vision (BLV) programmers, and programmers with motor impairments [15,43]. ...

Voice-Enabled Blockly: Usability Impressions of a Speech-driven Block-based Programming System
  • Citing Conference Paper
  • October 2022

... Accessibility in digital environments refers to designing and developing products, services, and content that can be perceived, understood, and operated by a wide range of users, regardless of their physical, intellectual, or cognitive abilities [7,23,33]. Despite the widespread accessibility adoption in web applications over the years, studies have shown that most web applications still present many accessibility violations. 1 Accordingly, some researchers surveyed people involved in software development and identified many barriers to the adoption of accessibility during the development process: lack of awareness or knowledge, lack of time and support from high-level management, lack of accessibility requirements, and lack of understanding of accessibility standards and guidelines [9,14,18,25,28]. Most barriers are related to the development process or individual perspectives, leaving a gap in the technical challenges developers find when they try to incorporate accessibility into their design. ...

Comparative Analysis of Accessibility Testing Tools and Their Limitations in RIAs
  • Citing Chapter
  • October 2022

Lecture Notes in Computer Science