Publications (4)0 Total impact
Conference Paper: Designing an Assistive Dialog Agent for a Case of Spinal Cord Injury[Show abstract] [Hide abstract]
ABSTRACT: In this study, a case of spinal cord injury needs to communicate with other people through text-voice conversation and control the home appliances effectively. An assistive dialog agent was therefore designed for the case using a dialog agent requirements modeling methodology with the support of PTK CASE tool. The methodology is composed of three models. The dialog agent society model was applied to establish the conceptual and linguistic ontologies of spoken dialog. It was demonstrated that the scenario-based dialog agent requirements model and the dialog agent PAC model in this study can help to elicit requirements from a service oriented and human-computer interaction point of view, especially useful for the case of special needs. The usability testing during development was also conducted to experience the case, correct usability problems, and evaluate the used methodology and its effectiveness.
Conference Paper: MDA-based UI Modeling and Transformation of Spoken Dialog Systems[Show abstract] [Hide abstract]
ABSTRACT: Traditional model driven architecture (MDA) approaches to software application development are appropriate for building systems with visual user interfaces. However, they are not suitable for designing of dialog systems. A more effective approach to modeling and transforming these complex characters of dialog systems is required. In this paper, we present a model-driven approach which first constructs platform independent model (PIM) using use case diagram, activity diagram, Net-PAC model and sequence diagram. Once the use case diagrams and activity diagrams are constructed, the voice user interfaces can be identified and specifies their structure and behavior specification by Net-PAC model and sequence diagram respectively. Then the PIM is transformed to the platform specific model (PSM) according to the transformation rules we develop. After the PSM is obtained, it can be used to generate the code model in VoiceXML. Through the approach, dialog systems can be developed effectively.
- [Show abstract] [Hide abstract]
ABSTRACT: This study presents a spoken dialogue agent interface requirements modeling approach based on PASSI methodology with the support of PTK CASE tool. Our approach is composed of three models, including the dialogue agent requirements, the dialogue agent society, and the dialogue agent PAC models. The dialogue agent PAC model provides a visual and effective approach for the agent-based user interface modeling and specification by integrating sound design principles and experiences. To support mixed-initiative dialogue modeling, a dialogue agent may participate in different dialogue scenarios playing distinct dialogue roles. To demonstrate our methodology, a case study is applied.
- [Show abstract] [Hide abstract]
ABSTRACT: This study proposes a multi-agent based architecture to support the intelligent home environment (IHE) control with an assistive user interface. The architecture is composed of six different agents (including assistive user interface, broke, appliance control, security surveillance, environmental monitoring, and communication agents) and an IHE controller. They interact in coordination and cooperation with each other to achieve the multi-goals of IHE control. The assistive user interface agent is designed to accommodate special dialogue needs such as screen reading, text conversation, and graphic user interface adapting. The hardware design is also proposed to support easy deployment. The JADE framework is employed in the multi-agent system development process with the support of PTK CASE tool. A case application is conducted thereafter by our research group for a case with severe spinal cord injuries.