No full-text available
To read the full-text of this research,
you can request a copy directly from the authors.
Bipolar laddering (BLA): A participatory subjective exploration method on user experience
Abstract
Normally, the paradigm used to study user experience is based on the hypothetic-deductive method but this paradigm can present disadvantages like low results reliability or difficulties to carry out field studies. In this article, a method based on the Socratic paradigm is suggested for analyzing the user-product psychological relationship. Nowadays the Socratic paradigm is only used in some post-modern psychology schools, which applies Socratic techniques for psychological exploration and treatment. Based on this principle an expert-to-expert conversation is established between psychologist and patient. The user can be an expert in the usage of a product whilst the interviewer is an expert in UX studies. Thus, much more reliable information of the user-product relationship can be obtained. Applying this paradigm as a constructive and systematic event allows for increasing the reliability in qualitative user experience studies.
... In the present paper, from the presentation of the main methods of drawing and digital graphic representation that are relevant in architectural teaching, the result of a quantitative study based in the technique of Bipolar Laddering (BLA [6]) is presented. The results have not only focused on the technologies used (DS, Digital Sketching, and AR, Augmented Reality), but also in the structure of the course, which was designed for students to be able to investigate new systems for the visualization of urban proposals. ...
... Nevertheless, the Socratic paradigm from postmodern psychology is also applicable and useful in these usability studies because it targets details related to the UX with high reliability and uncovers subtle information about the product or technology studied [6]. This migration from the hypothetical-deductive paradigm to the Socratic paradigm was inspired by the paradigm shift in clinical psychology away from constructivism and toward other postmodern schools of psychotherapy. ...
... This psychological model defends the subjective treatment of the user, unlike the objective hypothetical-deductive model [36]. Starting from the Socratic paradigm basis, the BLA system (Bipolar Laddering) has been designed [6]. BLA method could be defined as a psychological exploration technique, which points out the key factors of user experience. ...
The current paper presents a qualitative assessment of using augmented reality (AR), and digital sketching (DS) as dynamics, hybrid and ubiquitous visualization systems of urban solutions designed inside of an architecture master education. We will discuss about the main advantages and disadvantages perceived by the students of applying this type of technologies in the visualization of urban teaching projects. The proposed method of assessment, in addition to adapting perfectly to small samples of users, allowed us to accurately characterize the main aspects of the designed practical experience, especially the high degree of satisfaction and accomplishment of the students in the use of mobile technologies with teaching purposes, and its adaptation for the visualization of models and urban and architectural projects.
... In this paper, a mixed-methods study evaluating the motivation, satisfaction, and academic performance of university students is presented. The methodology was both quantitative (through a structured test) and qualitative (using the Bipolar Laddering, BLA [14]), and was based on using gamification and virtual reality for 3D arts creation for building engineers and architects. ...
... This psychological model defends the subjective treatment of the user, unlike the objective hypothetical-deductive model [26]. Starting from Socratic paradigm basis, the BLA system (Bipolar Laddering) [14] has been designed. BLA method could be defined as a psychological exploration technique, which points out the key factors of user experience. ...
In this paper the researchers describe the use of gamification and virtual reality-enhanced learning in university engineering and architecture classes. Our goal is to increase student motivation and engagement through various technologies and learning methodologies based on game mechanics, called gamification, and the use of virtual reality.
Gamification is used to engage students in the learning process and stretch their retention of the knowledge and skills received beyond a single lecture. Engagement is the main objective in applying gamification. The use of gamification and new technologies for enhancing the learning process will boost achievement in 3D architectural subjects for design, and convey and validate any architectural project.
The researchers used virtual reality and software like Sketchfab, Unity, and Oculus Rift VR to enter virtual and immersive worlds that students used to enhance their architectural designs. To connect the technologies, the researchers used Unity for programming all the viewer behaviors and the virtual world interactivity. The researchers used Oculus Rift, a heads-up display for virtual reality with a high immersive presence, to design a pavilion and create a virtual island from scratch.
... Laddering Theory has to deal with one-to-one in-depth interviews to obtain users' evaluations of products or services, in order to identify the most important attributes [78,79]. Bipolar Laddering (BLA) is a tool designed to extract value from user experience by means of Socratic survey, once the user has completed the experience related with a product or a service [80]. BLA can be described as a process that requires different steps [80,81], as follows: Firstly, using a Socrates' Tabula Rasa (i.e., without previous conditionings), users spontaneously identify the strong and weak points of the experience according to their perceptions and they justify their selection; secondly, users assess each one of the identified elements (out of 10; being 0 no satisfaction, extending to 10, the maximum level of satisfaction); finally, users are asked to give their suggestions about how to improve each one of all the items that they have mentioned. ...
... Bipolar Laddering (BLA) is a tool designed to extract value from user experience by means of Socratic survey, once the user has completed the experience related with a product or a service [80]. BLA can be described as a process that requires different steps [80,81], as follows: Firstly, using a Socrates' Tabula Rasa (i.e., without previous conditionings), users spontaneously identify the strong and weak points of the experience according to their perceptions and they justify their selection; secondly, users assess each one of the identified elements (out of 10; being 0 no satisfaction, extending to 10, the maximum level of satisfaction); finally, users are asked to give their suggestions about how to improve each one of all the items that they have mentioned. ...
Qualitative research activities, including first-day of class surveys and user experience interviews on completion of a subject were carried out to obtain students’ feedback in order to improve the design of the subject ‘Information Systems’ as a part of a general initiative to enhance ICT (Information and Communication Technologies) engineering programs. Due to the COVID-19 (corona virus disease 2019) pandemic, La Salle URL adopted an Emergency Remote Teaching tactical solution in the second semester of the 2019–2020 academic year, just before implementing a strategic learning approach based on a new Smart Classroom (SC) system deployed in the campus facilities. The latter solution was developed to ensure that both on-campus and off-campus students could effectively follow the course syllabus through the use of new technological devices introduced in classrooms and laboratories, reducing the inherent difficulties of online learning. The results of our findings show: (1) No major concerns about the subject were identified by students; (2) Interaction and class dynamics were the main issues identified by students, while saving time on commuting when learning from home and access to recorded class sessions were the aspects that students considered the most advantageous about the SC.
... To assess students' experience, the Bipolar Laddering technique was employed. This instrument is based on a Socratic interview/survey, where the respondents provide their own ideas [74]. Several steps must be taken to perform the BLA [74,75]: (1) users explain all the strong and weak points once the user has completed the experience; (2) users assess (from 0, minimum; to 10, maximum) each one of the identified strong and weak points; ...
... This instrument is based on a Socratic interview/survey, where the respondents provide their own ideas [74]. Several steps must be taken to perform the BLA [74,75]: (1) users explain all the strong and weak points once the user has completed the experience; (2) users assess (from 0, minimum; to 10, maximum) each one of the identified strong and weak points; ...
The COVID-19 pandemic significantly disrupted traditional face-to-face teaching worldwide and forced education institutions to adopt new, online teaching formats to enable students to continue with their studies. This research focuses on students’ perceptions of three teaching different modalities: face-to-face (F2F), Emergency Remote Teaching (ERT) and Smart Classroom (SC), which were implemented in response to the restrictions enforced to combat the spread of COVID-19. A qualitative study based on two user experience techniques, Pocket Bipolar Laddering and Emotional Appraisal, was carried out on a group of second-year ICT engineering university students at La Salle Campus Barcelona. The former technique consists in identifying a maximum of three positive and three negative salient items, while the latter is intended to rate pairs of opposite feelings. In the SC format, saving time on travel to university was considered an advantage of online learning, while disadvantages included less effective instructor–student interaction, distractions when off-campus and teamwork issues. These shortcomings can be addressed by specific online teaching training to develop a more active form of learning and foment student participation. However, both ERT and SC modalities were considered effective solutions to cope with the social and mobility restrictions imposed during the pandemic.
... The study consisted in two main analyses: (i) a quantitative analysis through the application of a 185 user testing session with two tasks to be completed with both tools (Project Ukko and redesign), 186 and (ii) a qualitative analysis of the positive versus the negative aspects for both tools through 187 the application of a bipolar laddering pocket methodology (Pifarré and Tomico 2007). We also 188 implemented a brief two-question quiz (Schreep, 2017) to determine which visualization needed 189 more mental effort, and which was the tool preferred by participants for decision-making 190 processes. ...
... Then the users rate (from 1 246 to 10) the aspects mentioned regarding their importance (for the positive ones) or their severity 247 (for the negative ones). By evaluating users' subjective opinions using a scale from 1 to 10 we 248 are able to better quantify input results that are qualitative, which helps identify the key aspects 249 to work with or prioritize the problems that need to be solved (Pifarré and Tomico 2007). 250 ...
The visual communication of climate information is one of the cornerstones of climate services. It often requires the translation of multidimensional data to visual channels by combining colors, distances, angles, and glyph sizes. However, visualizations including too many layers of complexity can hinder decision-making processes by limiting the cognitive capacity of users, therefore affecting their attention, recognition, and working memory. Methodologies grounded on the fields of user-centered design, user interaction and cognitive psychology, which are based on the needs of the users, have a lot to contribute to the climate data visualization field. Here, we apply these methodologies to the redesign of an existing climate service tool tailored to the wind energy sector. We quantify the effect of the redesign on the users’ experience performing typical daily tasks, using both quantitative and qualitative indicators that include response time, success ratios, eye-tracking measures, user perceived effort and comments among others. Changes in the visual encoding of uncertainty and the use of interactive elements in the redesigned tool reduced the users’ response time by half, significantly improved success ratios, and eased decision making by filtering non-relevant information. Our results show that the application of user-centered design, interaction, and cognitive aspects to the design of climate information visualizations reduces the cognitive load of users during tasks performance, thus improving user experience. These aspects are key to successfully communicating climate information in a clearer and more accessible way, making it more understandable for both technical and non-technical audiences.
... In this paper, a mixed-methods study evaluating the motivation, satisfaction and academic performance of degree students is presented. The methodology is both quantitative (through a structured test) and qualitative (using the Bipolar Laddering, BLA (Pifarré, 2007)), and it is based in the use gamification and the use of technology for 3D arts creation for multimedia purposes such videogames or films. ...
... The methodology to evaluate both quantitative (through a structured test), and qualitative (using the Bipolar Laddering (Pifarré, 2007), using gamification. We used two methods to evaluate the results in applying all methodologies: ...
This paper describes the use of gamification and visual technologies in a classroom for higher education, specifically for university students. The goal is to achieve a major increase in student motivation and engagement through the use of various technologies and learning methodologies based on game mechanics called gamification. Gamification is used to engage students in the learning process. This study adds learning methodologies like Learning by Doing to students' collaborative work, and mixes teacher support with new, accessible technology, such as virtual reality and visualization 3D on the web thanks to webGL. This creates a new management tool, called GLABS, to assist in the gamification of the classroom. Understanding the role of gamification and the technology in education means understanding under what circumstances game elements can drive a student s learning behavior so that he or she may achieve better results in the learning process. Copyright © 2014, IGI Global. Copying or distributing in print or electronic forms without written permission of IGI Global is prohibited.
... This was done in the first step by asking the participants to reflect on their individual contributions and filling in their finding on individual forms. During the second step of the workshop the participants where asked to indicate positive and negative aspects of the current prototype on individual forms, this exercise was based on bi-polar laddering (Pifarré & Tomico 2007). Based on the ideation phase of co-reflection, in the third step of the meeting the participants where asked to individually use these positive and negative aspects to generate an ideal future service and each sketch it out on separated papers. ...
Stakeholders who are part of the development process of a new Product-Service System (PSS) could use interactive prototypes during meetings to exchange different point of views. Based on the findings of a conversation analyst and the reflections of a design researcher we compared three explication techniques of how a prototype was involved during such a meeting (for pointing and manipulating, for demonstrating its function and for imitating and/or demonstration through body movement and gesture) with the phases of a co-reflection session (exploration, ideation and confrontation). We found that the prototype was especially useful during the exploration and confrontation phases. Pointing and manipulating helped to make reflections concrete, made it easier to propose small design changes and helped the participants to reach common goals. Interactive prototypes do have their limits, during the ideation phase the prototype did not play an important role.
... For the qualitative approach, we will use the BLA (Pifarre´& Tomico, 2007). Following the Socratic paradigm stated earlier, we adopted the BLA system (BLA), which works on positive and negative poles to define the strengths and weaknesses of the proposal. ...
The main aim of this study is to assess the spatial perception of historical world heritage buildings using wearable technologies in an educational framework. The proposal seeks to complement the real experience of visiting the Casa Batlló Museum, an emblematic space (1904–1906, Antonio Gaudí, Barcelona). The main innovative feature of the project is focused on the usability assessment of the video-guide indoor location-based system. The article addresses the first phase of a more complex project, analyzing the behavior of architecture students previously trained in modeling of complex buildings, in order to improve the system for a second phase that will be developed with students with special needs. Using an indoor location system for watching multimedia contents, we can improve the access, the visit, and the spatial perception of historical places for all kinds of students, with or without any special requirements. The results show a lack of usability of the system, especially due to the design of the mobile interface and to some loss of synchronization between the student position and the multimedia contents. However, the students have a better understanding of the museum’s characteristics because of multimedia content, as a clear improvement compared with the classic audio-guide.
... An initial pretest was conducted to obtain the student's profile and starting level of motivation/knowledge about the use of selected technologies. At the end of the course, a post-test was conducted to assess the level of satisfaction and completed use of each system, and a personal interview was conducted using the Bipolar Laddering (BLA) technique (Pifarré & Tomico, 2007), which allows us to identify and quantify the strong and weak points of the proposed methods. The current proposal has a clear line of continuation in future iterations because it reveals correlations between statistical results and final grades in a way that allows us to evaluate the relationships between different variables in the study and the student's improvement. ...
... An initial pre-test was conducted to obtain the student's profile and starting level of motivation/knowledge about the use of selected technologies. At the end of the course, a post-test was conducted to assess the level of satisfaction and completed use of each system, also a personal interview was conducted using the Bipolar Laddering (BLA) technique [20], which allows us to identify and quantify the strong and weak points of the proposed methods. The current proposal has a clear line of continuation in future iterations because it reveals correlations between statistical results and final grades in a way that allows us to evaluate the relationships between different variables in the study and the student's improvement. ...
This paper aims to design a mixed-method evaluation study. The target of this study is to analyze the implementation of the Building Information Modeling/Management technology in the Architectural Engineering Curriculum. We will use the mixed-method evaluation process based on quantitative and qualitative approaches to measure the level of motivation, satisfaction and performance of the students with Building Information Modeling/Management (BIM) technology and obtaining the proper feedback to optimize the implementation of BIM in the Architectural, Engineering and Construction Management (AEC) curriculum.
... Examples of qualitative methods to explore the user experience include the Think Aloud technique, which allows gathering users' comments and impressions during the tests (Charters 2003). The Bipolar Laddering method is also useful to quantify users' insights and their impact, by evaluating the positive and negative aspects found in the visualisation and rating them according to their importance (for positive aspects) and severity (for negative aspects) (Pifarré and Tomico 2007). Additionally, questionnaires such as the NASA-TLX also provide subjective but valuable opinions on cognitive load, perceived effort and frustration (Cao et al. 2009). ...
Visualisations are often the entry point to information that supports stakeholders’ decision- and policy-making processes. Visual displays can employ either static, dynamic or interactive formats as well as various types of representations and visual encodings, which differently affect the attention, recognition and working memory of users. Despite being well-suited for expert audiences, current climate data visualisations need to be further improved to make communication of climate information more inclusive for broader audiences, including people with disabilities. However, the lack of evidence-based guidelines and tools makes the creation of accessible visualisations challenging, potentially leading to misunderstanding and misuse of climate information by users. Taking stock of visualisation challenges identified in a workshop by climate service providers, we review good practices commonly applied by other visualisation-related disciplines strongly based on users’ needs that could be applied to the climate services context. We show how lessons learned in the fields of user experience, data visualisation, graphic design and psychology make useful recommendations for the development of more effective climate service visualisations. This includes applying a user-centred design approach, using interaction in a suitable way in visualisations, paying attention to information architecture or selecting the right type of representation and visual encoding. The recommendations proposed here can help climate service providers reduce users’ cognitive load and improve their overall experience when using a service. These recommendations can be useful for the development of the next generation of climate services, increasing their usability while ensuring that their visual components are inclusive and do not leave anyone behind.
... Qualitative methods are commonly employed in usability studies and, inspired by experimental psychology and the hypothetical-deductive paradigm, employed samples of users who are relatively limited. Nevertheless, the Socratic paradigm from postmodern psychology is also applicable and useful in these studies of usability because it targets details related to the UX with high reliability and uncovers subtle information about the product or technology studied (Pifarré & Tomico, 2007). This psychological model defends the subjective treatment of the user, unlike the objective hypothetical-deductive model (Guidano, 1989). ...
En el presente artículo discutimos los resultados de evaluar el grado de motivación, el perfil y el nivel de satisfacción de los estudiantes en flujos de trabajo que utilizan la visualización aumentada de modelos complejos en 3D. El estudio muestra los resultados de experimentos realizados con alumnos de grado a lo largo de los dos primeros cursos de Arquitectura y el actual grado de Ciencias y Tecnologías de la Construcción (antiguo grado español de Ingeniería de la Construcción, y con cuyo nombre se reconoce a nivel europeo). Hemos utilizado un método mixto que combina el uso de técnicas cuantitativas y cualitativas de evaluación de la respuesta del estudiante, con el fin de completar una visión más global del uso de nuevas tecnologías, dispositivos móviles y métodos visuales avanzados en campos académicos. Los resultados nos muestran cómo los estudiantes partícipes de dichos experimentos han mejorado sus resultados académicos y su implicación con la materia, un punto clave en el actual marco educativo compuesto por estudiantes nativos digitales y un gran número de aplicaciones y dispositivos para la enseñanza y el aprendizaje
... In this paper, a mixed-methods study was used to evaluate the motivation, satisfaction and academic performance of degree students. The methodology is both quantitative (through a structured test) and qualitative (using the Bipolar Laddering, BLA [5]), and it is based on the use of Augmented Reality (AR) to present, visualize and discuss 3D complex models realized using CAD tools (Computer Assisted Design). Whether this type of exercise can help students understand and improve their 3D skills will be evaluated. ...
This paper presents a mixed-method study that combines quantitative and qualitative techniques to evaluate the technological profile and the motivation and satisfaction of Multimedia Engineering degree students using augmented visualization methods. New uses of technology in the education framework have been extended to all levels and sectors, but these innovations require approval, validation and evaluation by the final users (i.e., the students) to ensure that they are suitable. In this paper, we will discuss the advantages and disadvantages of applying mixed evaluation technology in a case study of the use of interactive and collaborative tools for the visualization of 3D virtual models in a subject related to a Multimedia Engineering degree. The main objective is to evaluate whether our students are prepared to use the systems proposed, and to determine if the designed experiment generates an increase in the motivation and satisfaction using new devices and systems to visualize complex models. Results showed that the combination of mixed-methods allowed us to obtain adequate feedback to improve future iterations of this type experiment.
... For our qualitative approach, we have used a modification (with some closed issues to assess) of the BLA (Bipolar Laddering Assessment, [25]. Following the Socratic paradigm stated previously, we adopted the BLA method, which works on positive and negative poles to define the strengths and weaknesses of the proposal. ...
In the last years, the use of interactive virtual systems has been starting to be used in multiple sectors, led especially by leisure and video games, but also professional and educational sectors. The capabilities of virtual systems allow users a closeness to the recreated space, while allowing a rapid flow of changes and updates of the models. Based on these premises, this article focuses on the qualitative design and evaluation of a new visualization and virtual interaction proposal based on tactical urban projects. The perceived usefulness in the field of architecture that these systems can have for understanding the three-dimensional space is also evaluated and compared with other current CAD / BIM systems. The results show a high degree of interest and user satisfaction but with a need to improve the interaction and the qualities of the contents.
... The object of a laddering interview is to uncover how product attributes, usage consequences, and personal values are linked in a person's mind. BLA performing consists in three steps: Elicitation of the elements, marking of elements, elements definition [51]. ...
This paper describes the integration of hybrid interfaces in the workflow using three-dimensional models, and presents the results of a preliminary study based on the profile and the student motivation. The study is conducted with first year Building Engineering degree students in order to use mobile technologies, augmented reality (AR) and digital sketching (DS) in different case studies. The resources developed combine traditional methods with interactive visualization of building and civil virtual models using mobile devices to show this type of content with the purpose of enhancing the student's visualization and their spatial skills and motivation. We have used a mixed method research with quantitative evaluations, and personal qualitative assessment. The conclusions show us a positive student motivation to use this technology and the preliminary results show us an improvement of their academic results.
... Qualitative methods are commonly employed in usability studies and, inspired by experimental psychology and the hypothetical-deductive paradigm, employ samples of users who are relatively limited. Nevertheless, the Socratic paradigm from postmodern psychology is also applicable and useful in these studies of usability because it targets details related to the UX with high reliability and uncovers subtle information about the product or technology studied [62]. ...
This paper describes the evolution and integration of hybrid interfaces in the visualization of three-dimensional models, and presents the results of a preliminary study based on the profile and the student motivation. The study is conducted with first and second year Building Engineering degree students in order to incorporate the augmented reality technology in different subjects and case studies. The resources developed combine traditional methods with interactive visualization of complex virtual models and mobile systems to present this type of content with the purpose of enhancing the student's visualization and spatial analysis skills and their motivation. We have used a mixed method research with quantitative evaluations (using a pre and post-test), and personal qualitative assessment (using the Bipolar Laddering technic) to further strengthen the results. In general, the student motivation to use this technology at classroom is positive and the preliminary results show us an improvement of thei
... The result of this process was an experience that allowed to move freely around a realistic 3d recreation of the original square, and perceive two distinctly different audio environments: one that recreated concert hall conditions, and a second one that allowed to experience as close as possible the square sound conditions. Using complementary qualitative research, it is possible to obtain new variables to study in future iterations and more detail for the quantitative data [24]. ...
The role of acoustics in architectural planning processes is often neglected if the designer lacks necessary experience in acoustics. Moreover, few experiments till the date have brought audio design tools to the classrooms. A basic BLA (Bipolar Laddering Assessment) experiment is presented with architectural degree students showing that sound aspects of urban design are as important as visual ones. Additionally, this experiment indicates the basic guidelines for the improvement of a urban acoustic education tool which pretends to broaden architecture students insight into urban acoustic problems.
... Durante la ejecución de los proyectos de estudio se analizó la eficacia de nuevas metodologías basadas en la tecnología, la facilidad en su utilización, la experiencia del usuario y otros factores como la obtención o no de resultados satisfactorios por parte de los estudiantes (Fonseca, Martí, Redondo, Navarro, Sánchez, 2014). Este tipo de evaluaciones se obtiene con encuestas de tipo test y en otros casos con cuestionarios como el BLA -Bipolar Laddering- (Pifarré, & Tomico, 2007), un tipo de estudio cualitativo que nos ha demostrado su fiabilidad, en especial para casos de trabajo con pocas muestras. Muchos factores pueden influir en estos resultados, desde el tipo de recursos (software y hardware) hasta la metodología (guías docentes, pautas temporales, pruebas de campo u otras). ...
This paper presents several studies focused on the representation of three-dimensional space and architectural projects developed in the academic framework of the Architecture and Technical Architecture degrees. The objective is to analyse the improvement in graphical and spatial expression of the students, using technologies such as Augmented Reality (AR) and Virtual Reality (VR). This work has been carried out through case studies carried out in the last five years in the subjects of Representation Systems I and II. The proposals have been studied from the point of view of universal accessibility using new technologies and three-dimensional models for users with disabilities. The adoption of the technological innovations has modified substantially the methods of work in the teaching field. In addition, the students have expressed a high attraction and engagement using these technological approaches, which has finally led to a curricular improvement.
... By using complementary qualitative research, it is possible to obtain variables to study in future iterations and more detail for quantitative data [Pifarré and Tomico 2007]. ...
Optimizing room acoustics teaching for architects and building engineers is an unfinished business. Moreover, theoretical explanations about acoustic concepts hardly support the understanding of basic concepts of acoustics on these students. A basic BLA (Bipolar Laddering Assessment) experiment is presented with students showing that an active learning method can be accepted by them more easily when ‘‘sonification’’ is included in the course. This process, which converts data into non-speech audio to make acoustic concepts audible, is suggested as a possible solution for this problem. Additionally, the experiment indicates the basic guidelines for the improvement of a project-based pedagogy, which pretends to broaden architecture student’s insight into acoustic problems.
... Qualitative methods are commonly employed in usability studies and, inspired by experimental psychology and the hypothetical-deductive paradigm, employ samples of users who are relatively limited. Nevertheless, the Socratic paradigm from postmodern psychology is also applicable and useful in these usability studies because it targets details related to the UX with high reliability and uncovers subtle information about the product or technology studied (Pifarré & Tomico, 2007). Starting from the Socratic paradigm basis, the BLA system (Bipolar Laddering) has been designed. ...
The main aim of this study is to improve the understanding of historical buildings through the use of advanced visual technologies. The main innovative features of the project are focused on the use of mobile and wearable technologies, the indoor location, and their mixed assessment an educational project. We will use smartphones, virtual reality and indoor positioning systems. Both the devices and the users' experience will be assessed with a quantitative and a qualitative approach. The proposal seeks to complement, the real experience of visiting an emblematic space (our case study: the Casa Batlló Museum, 1904-1906, Antonio Gaudí, Barcelona, Spain), in order to improve the spatial skills of architecture students and general visitors of this type of architectural landmarks.
... Qualitative approach was also used for assessing the group satisfaction on the Flipped Classroom methodology, using the Bipolar Laddering Assessment, BLA [82]. BLA methodology is based in a Socratic Questionnaire with open questions to be answered in three steps and has demonstrated its validity in several studies with both qualitative approach and with mixed approach [83][84][85][86]. ...
A sudden lockdown was declared on 14 March 2020 due to COVID-19 crisis, leading to an immediate change from face-to-face to online learning in all universities within Spanish jurisdiction. At La Salle School of Architecture, the Concrete and Steel Structures subject started online classes immediately after the lockdown law was published, using a methodology based on the flipped classroom approach and adapting the monitoring of the student to the virtual environment. This article presents a pilot study to analyze the adaptation of the model to the online format using a mixed approach in which qualitative and quantitative surveys were conducted at the end of the course with 48 participants. Responses from both surveys were organized according to six categories (teachers, assessment, methods, class development, students and documents) and 14 subcategories, as developed in an undergoing research project involving the subject since the academic year 2017/2018. Thus, the open responses of the students have been analyzed alongside with the quantitative data. The results demonstrate a proper adaptation of the model, as well as the negative perception of the students of the online format due to the loss of face-to-face benefits of the flipped classroom.
... In these types of studies, the Socratic model of postmodern psychology is also applicable and valuable because it targets highly accurate UX-related data and addresses complex information about the product, experience or technology studied [130,131]. Unlike the empirical hypothetical-deductive model, this psychological model defends the user's subjective treatment, and it is the basis for BLA system implementation [132]. ...
The creation and usage of serious games on virtual reality (VR) and/or interactive platforms for the teaching of architecture, construction, urban planning, and other derived areas, such as security and risk prevention, require design processes, studies, and research that lead to further consolidation expansion. In that sense, this paper presents two main aims developed: the improvement of a virtual navigation system through the results of previous user studies and mixed research (quantitative and qualitative) improved based on the user perception for educational and professional uses. The VR system used is based on Unreal Engine programming of the HTC Vive sensor. This study is related to the GAME4City 3.0 and a broader project focused on gamified visualization and its educational uses in architectural and urban projects. The results reflect great interest, good usability, and high motivation for further usage for all types of users. However, an apparent resistance to deepen its use continues to be perceived in academia. Based on the research results, weak points of educational gamified systems have been identified, and the main differences and needs in user profiles’ function. With these data, progress regarding implementing this kind of system at the teaching and professional levels must be pursued.
... (accessed on 1 March 2021)), which integrates game mechanics, dynamics and aesthetics in the study plan. The project measures satisfaction and usability based on user experience methodologies [59]. The techniques carried out from evaluation systems with users allow the project to evaluate a minimum of five users of the same profile, and an evaluation based on qualitative results allows results obtained from User 6 to be repeated with previous users [60]. ...
This research focuses on the study and qualitative assessment of the relationships between motivators and game mechanics per the ratings of expert gamification consultants. By taking this approach, it is intended that during the design phase of a gamified system, decisions can be made about the design of the system based on the motivators of each of the profiles. These motivators can be determined from the information provided by the potential players themselves. The research presented starts from a previous analysis in which, based on the three most used gamification frameworks and through a card sorting technique that allows the user to organize and classify the content, a set of mechanics are determined. In the present study, each of the mechanics is analyzed, and a more precise motive is decided. As a result, a higher level of personalization is achieved and, consequently, approximates a higher level of gamification effectiveness. The main conclusions are implemented in the development of the Game4City 3.0 project, which addresses gamified and interactive strategies to visualize urban environments in 3D at an educational and social level.
... Given that the inquiry or inspection techniques are used to define requirements and identify certain aspects of the usability of the product, it is with these test techniques that we can find the specific usability problems that users have. The evaluation techniques are composed of general tests with users, thinking aloud protocol, the method set discovery, the protocol of questions, the measure of performance, the pencil test, eye-tracking, Bipolar Laddering interview (BLA; Pifarré & Tomico, 2007) and the task test. ...
There are numerous examples from recent years of the incorporation of all types of applications and technological systems into the classroom at all educational levels, with the aim to improve both student motivation and academic performance; we can group these initiatives under the term technology-enhanced learning, TEL. The TEL research field has been profoundly involved with the development and application of collaboration apps. Computers, mobile devices, and applications play diverse roles at different times along the project lifecycle. The most common lifecycle comprises four distinct phases: design, implementation, approval, and final assessment. In this chapter, the authors discuss key concepts of these TEL phases as well as some different approaches that can be defined as “good technological practices” and their main results in order to implement technologies in the formative process.
... By using complementary qualitative research, it is possible to obtain variables to study in future iterations and more detail for quantitative data [29]. ...
Optimizing room acoustics teaching for architects and building engineers is an unfinished business. Moreover, theoretical explanations about acoustic concepts hardly support the understanding of basic concepts of acoustics on these students. A basic BLA (Bipolar Laddering Assessment) experiment is presented with students showing that an active learning method can be accepted by them more easily when ''sonification'' is included in the course. This process, which converts data into non-speech audio to make acoustic concepts audible, is suggested as a possible solution for this problem. Additionally, the experiment indicates the basic guidelines for the improvement of a project-based pedagogy, which pretends to broaden architecture student's insight into acoustic problems.
... Consequently, different interviews are conducted with different profiles to ensure a result that is consistent with the observations and perceptions of users in VLEs. This process consists of direct questioning interviews, online questionnaires and finally, Bipolar Laddering (BLA) [18], a mixed combination that has previously demonstrated its scientific validity in the evaluation of all types of methodology and systems applied to education without the need of a large sample of participants [19][20][21][22]. This first approach will serve to analyze the validity of the use of aliases in relation to the GDPR. ...
The privacy policies, terms, and conditions of use in any Learning Management System
(LMS) are one-way contracts. The institution imposes clauses that the student can accept or decline.
Students, once they accept conditions, should be able to exercise the rights granted by the General
Data Protection Regulation (GDPR). However, students cannot object to data processing and public
profiling because it would be conceived as an impediment to teachers to execute their work with
normality. Nonetheless, regarding GDPR and consulted legal advisors, a student could claim
identity anonymization in the LMS, if adequate personal justifications are provided. Per contra, the
current LMSs do not have any functionality that enables identity anonymization. This is a big
problem that generates undesired situations which urgently requires a definitive solution. In this
work, we surveyed students and teachers to validate the feasibility and acceptance of using aliases
to anonymize their identity in LMSs as a sustainable solution to the problem. Considering the
positive results, we developed a user-friendly plugin for Moodle that enables students' identity
anonymization by the use of aliases. This plugin, presented in this work and named Protected users,
is publicly available online at GitHub and published under GNU General Public License.
... • Evaluation through a test. The evaluation was conducted through test surveys and BLA (Bipolar Laddering) questionnaires (Pifarré & Tomico, 2007). Navarro Delgado & Fonseca Escudero (2017) proposed the use of tests (from 0 to 5) to evaluate the implementation of these technologies as well as for selecting the sample model and the type of analysis. ...
Virtual reality (VR) has achieved an adequate level of development in education and research in higher education The training in Architecture requires a reflection on the incorporation of new design technologies at the Degree and Master’s level, due, in part, to the dissatisfaction of the students with the poor implementation of these technologies. The pedagogical possibilities of VR are very high. The aim of this paper is to propose a transversal methodology for several subjects in the same semester. It consists of the virtual recreation of a work of relevant architecture in the history of contemporary Architecture. The possibilities of implementing VR in the architectonic subjects are analyzed. This methodology takes advantage of the potential of this technology to create a transversal educational activity, for different subjects and areas of knowledge in the same academic year. Subsequently, the different phases for its implementation are described in terms of activities and scenarios. The paper concludes that transversal methodology offers the opportunity to analyze the same building from different disciplines, checking the interrelation between them, and saves time for the student in completing teaching assignments.
... A qualitative study evaluating the motivation, satisfaction and academic performance of degree students is presented. The methodology is qualitative (using the Bipolar Laddering [40] and combines the use of gamification with technology suitable for 3D arts. The working hypothesis to be confirmed is whether students who learn 3D techniques via gamification techniques obtain better academic results because they are more motivated and satisfied than those taught under the classic working system. ...
... Para la evaluación cualitativa, nos hemos basado en la realización de una entrevista BLA (Bipolar Laddering Assessment) (Pifarré & Tomico, 2007). Esta metodología previamente validada y utilizada en otros experimentos educativos en combinación con análisis cuantitativos (Fonseca, Martí, Redondo, Navarro, & Sánchez, 2014;Fonseca et al., 2018;Fonseca, Redondo, Valls, & Villagrasa, 2017;Fonseca, Redondo, & Villagrasa, 2015), nos permite obtener de forma rápida y abierta una identificación de variables personales que por el mero hecho de su repetición se posicionan como variables comunes, a las cuales hay que hacer referencia en futuras iteraciones de mejora. ...
... Evaluand-oriented Responsive Evaluation Model (EREM) [130] [23] Cognitive walkthrough [78] Qualitative Bipolar Laddering (BLA) based on [122] [67] Heuristic (Nielsen) [131] [69] Think aloud protocol [69] Expert Reviews were used as the Nielsen heuristic evaluation (HE) method [131] [83] ...
The implementation of usability in mobile augmented reality (MAR) learning applications has been utilized in a myriad of standards, methodologies, and techniques. The usage and combination of techniques within research approaches are important in determining the quality of usability data collection. The purpose of this study is to identify, study, and analyze existing usability metrics, methods, techniques, and areas in MAR learning. This study adapts systematic literature review techniques by utilizing research questions and Boolean search strings to identify prospective studies from six established databases that are related to the research context area. Seventy-two articles, consisting of 45 journals, 25 conference proceedings, and two book chapters, were selected through a systematic process. All articles underwent a rigorous selection protocol to ensure content quality according to formulated research questions. Post-synthesis and analysis, the output of this article discusses significant factors in usability-based MAR learning applications. This paper presents five identified gaps in the domain of study, modes of contributions, issues within usability metrics, technique approaches, and hybrid technique combinations. This paper concludes five recommendations based on identified gaps concealing potential of usability-based MAR learning research domains, varieties of unexplored research types, validation of emerging usability metrics, potential of performance metrics, and untapped correlational areas to be discovered.
... Evaluations were conducted through a case study focused on professional consultants with more than 10 years of experience. This study was carried out using the BLA (Bipolar Laddering) technique [37,38], a technique that allows obtaining data generated spontaneously by users and a subsequent qualitative and quantitative analysis. Based on the positive results, it was decided to continue with the proposal. ...
The article is based on the development of a new methodology that promotes and contributes to a workshop, incorporating user experience as an evaluation of user’s behavior, and includes the application of gamification as a method of increasing motivations. The study that is presented is based on the explanation of the method used for its creation and in the evaluation of the first results obtained before its application. The evaluation of the design took into account the initial assessment to connect the field of user experience with gamification, assessed a first version and evaluated a second version, and applied it in the context of a workshop. One of the aims that is addressed within the user experience is to evolve in the search of systems, where a starting point is developed from a hypothetico-deductive system, where the consultant established the hypothesis to be solved based on the possible behavior of the user to a system, where users also participate in decisions; therefore, the methodology applied for the design is based on a user-centered design process. The application allows to reveal useful information to design a workshop that can improve the quality of the results, increase the relevance of the resulting report and contribute efficiency compared to the current systems. To illustrate this technique, a use case is presented applied to the redesign of a subject of Master in user experience. The strengths and weaknesses of the system’s applicability as a standard are taken into account.
... Thus, this work is both novel and justified.! In this paper, a mixed-methods study evaluating the motivation, satisfaction and academic performance of degree students is presented. The methodology is both quantitative (through a structured test) and qualitative (using the Bipolar Laddering, BLA [5]), and it is based in the use of Augmented Reality (AR) to present, visualize and discuss an architecture project realized using CAD tools (Computer Assisted Design). Whether this type of exercise can help students understand and improve their 3D skills will be evaluated. ...
A mixed-methods study evaluating the motivation and satisfaction of Architecture degree students using interactive visualization methods is presented in this paper. New technology implementations in the teaching field have been largely extended and developed; however, these innovations require approval validation and evaluation by the final users, in our case the students. In this paper, we will discuss the advantages and disadvantages of applying mixed evaluation technology in a case study centered in the use of interactive and collaborative tools for the visualization of 3D architectonical models, the evaluation of the motivation and the students' degree of satisfaction using friendly technology as mobile phones and Augmented Reality.
The main aim of this study is to improve the understanding of historical buildings through the use of advanced visual technologies. The main innovative features of the project are focused on the use of mobile and wearable technologies, the indoor location, and their mixed assessment an educational project. We will use smartphones, virtual reality and indoor positioning systems. Both the devices and the users' experience will be assessed with a quantitative and a qualitative approach. The proposal seeks to complement, the real experience of visiting an emblematic space (our case study: The Casa Batlló Museum, 1904-1906, Antonio Gaudí, Barcelona, Spain), in order to improve the spatial skills of architecture students and general visitors of this type of architectural landmarks.
This paper describes an educational experience in the field of Geographic Information Systems (GIS) teaching in architecture with a double objective: (1) implement a peer-review exercise to promote critical thinking through the evaluation of the work of fellow students, and (2) explore the capacity of the group to assess the exercise with the support of a rubric. In addition to the outline of the experience, preliminary data showing a significant coincidence between self and peer-evaluation is discussed.
This paper describes the use of gamification in a classroom for higher education, specifically for university students. Our goal is achieve a major increase in student motivation and engagement through various technologies and learning methodologies based on game mechanics called gamification [1--2].
Gamification is used to engage students in the learning process [3] and stretch their retention of the knowledge and skills received beyond a single lecture [4]. This study adds Problem-Based Learning (PBL) and Quest-Based Learning (QBL) to students' collaborative work, and mixes teacher support with new, accessible technology, such as virtual environments and visualization 3D on the web thanks to webGL.
Understanding the role of gamification in education means understanding under what circumstances game elements can drive a student's learning behavior so that he or she may achieve better results in the learning process.
This paper presents the game mechanics-based learning management platform called GLABS (acronym created from "Gamified LABoratorieS"). Currently we can find different educational management systems, but are based on the management of qualifications, support, discussions, or work assignments. The application of game mechanics in some of them there, but is very limited, allowing the inclusion of a point system or awarding medals for achievements. The system described in this paper uses a standard educational management as Schoology tool to incorporate techniques of play called gamification, which allows to unify all the student tasks in a web/app. This form creates a more attractive and motivating system whereby you can create missions, view maps of missions, alert of points earned and even create portfolios of completed works. In conclusion, our proposal uses Schoology as a system of educational management plus gamification, which could be defined as a G-LMS (Learning Management System Gamified).
A mixed-methods study evaluating the motivation and satisfaction of Architecture degree students using interactive visualization methods is presented in this paper. New technology implementations in the teaching field have been largely extended to all types of levels and educational frameworks. However, these innovations require approval validation and evaluation by the final users, the students. In this paper, the advantages and disadvantages of applying mixed evaluation technology are discussed in a case study of the use of interactive and collaborative tools for the visualization of 3D architectonical models. The main objective was to evaluate Architecture and Building Science students’ the motivation to use and satisfaction with this type of technology and to obtain adequate feedback that allows for the optimization of this type of experiment in future iterations.
The cities in which we live are changing rapidly, presenting the scenery to debate future visions of transformative designs and its impact on the city. In order to take advantage of the changes and opportunities offered by the inclusion of digital technologies, an accommodation of the digital transformation into the visualization of Urbanism is required. It is a challenge for organizations and society to question the status quo and experiment often. The discussion about the increasing integration of digital technologies in urban spaces involves a number of questions relating to the complex processes of transformation that impact cities, like economic, social, political, and environmental. The main goal of the paper is to present the use of Digital Transformation in processes of urban design through technological innovation in which the diverse forms of active citizenship operate from below as agents of innovation, inclusion and social development. The results showed that it is possible to empower Digital Transformation – as for example the use Augmented and Virtual Reality (AR/VR) systems in collaborative urban design – to improve public motivation, implication, and satisfaction in urban decision-making processes.
Punkte, Abzeichen, Bestenlisten – und schon fällt der Begriff der Gamifizierung. Die fortschreitende Digitalisierung vereinfacht den Einsatz sogenannter Spielelemente in der akademischen Bildung erheblich. Dabei bietet der Trend der Humifizierung neben Punkten, Abzeichen und Ranglisten viele niedrigschwellige und technisch wenig aufwendige Möglichkeiten der Lernmotivationssteigerung. Gamifizierung – verstanden als Designstrategie – kann helfen, motivations- und partizipationsförderliche Lernumgebungen an Hochschulen zu kreieren, in denen Studierende berufliche Kompetenzen individuell oder gemeinsam aufbauen können. Dafür muss die Gamifizierung pädagogischen Prinzipien folgen. Der vorliegende Beitrag thematisiert dies und setzt sich mit der Idee der Gamifizierung, den wesentlichen Merkmalen von Spielen und deren Potenzialen für das Lernen und Lehren in der Hochschule auseinander. Zur Verdeutlichung dessen werden hochschulische Entwicklungstendenzen wie die Anregung der Studienmotivation, vertiefendes Lernen und Senkung der Abbrecherzahlen fokussiert. Abschließend werden praktische Umsetzungsbeispiele und deren Effekte für das Lernen in der Hochschule aufgezeigt.
The main focus of this study was the inclusion of informal methods in the educational frameworks of architectural and urban design. The project used is based on the 3D representation of virtual models of new urban proposals in order to re-organize a local market in Tonalá, Mexico. Starting from a formal course, where the students had to develop solutions to real architecture and urban problems, a second phase was designed, based on feedback in an informal environment by the end-users (citizens and professionals). The key objectives of the experiment were to show students to connect and receive feedback through technology, evaluate how these interactions can define new informal ways of learning, and discuss how this informal data can be incorporated into an academic curriculum. The results confirm how the informal interaction constitutes a great contribution in the improvement of student’s skills, even considering that the incorporation of informal data into their evaluation still remains challenging.
This paper describes a professional practice in user-centred product concept design that is embedded in a method called resonance testing. It is a nimble method used and developed in industry to ensure that desired properties of design are communicated to the user through the design. It tests product concepts for emotional and functional design attributes such as personal needs, believability, and differentiation. In resonance testing, the users of a specified segment experience design artefacts of variable abstraction levels to see how they perceive the qualities of a concept and how it matches their preferences and expectations. We find that literature lacks both effective user feedback solutions for early product decisions and discussion of the known challenges for doing that. The paper describes how resonance testing generates qualitative insights, builds confidence in new concepts and helps designers to develop the right concept for further development. We present two cases studies of utilising this method.
The main goal of this report is to address the implementation of Augmented Reality (AR) technology in a university teaching context using different mobile devices. The specific contents and evaluation methodologies have been developed in the field of building engineering degree, where this technology offers potential advantages in the spatial training processes. The objective is to evaluate the system usability and measure academic performance improvement by using Hand-Held AR (HHAR) in educational environments related with the field of architecture, civil and building engineering. This method is validated through a case study where building engineering students were able to visualize a virtual complex models process overlapped onto a real environment. The results obtained from the students' PRE and POST tests as well as questionnaire responses show high qualification levels in effectiveness, efficiency and satisfaction. In addition, a significant improvement was found in the overall performance of the students of the experimental group.
Spatial vision is critical to understanding all other knowledge to be taught in all technical fields. Students need the ability to determine the three-dimensional shape of an object from its two-dimensional graphic representation. After using drawings in both two and three dimensions on the backboard, an opportunity to use digital media in various more interactive ways is proposed to change the ways in which the content is presented. Such digital tools include augmented reality, PDF3D or 3D visualization software like SketchUp. This article shows how 3D ICT objects can help communication for the compression of terrains represented by contours when they are not completely understood. It also discusses how to proceed to obtain them and the advantages and disadvantages of the three ways of visualization chosen. Conducting classes in Vocational training with the help of 3D models can ensure the achievement of the general objectives of the course of work with contours; with graphic origin, (obtaining profiles, earthworks, embankments, design vials or zoning), or mathematical origin, (sloping, modules, height differences, dimensions). The evaluation of these elements has been done to observe their acceptance and usability, not only in an educational environment, but also in a professional environment, since these models have been used to develop projects of urbanization, in internships in companies in real environments to explain these projects to customers.
Graphical Abstract
Open image in new window
This paper describes the experiences made and lessons learned in an Extreme Programming (XP) software development project. We investigate the potential of XP to produce user experience-optimized products by including HCI experts in the team. We relate the software development method to user-centered design instruments and propose solutions to different user experience integration problems. Additionally, the practicability of different HCI instruments regarding solving those problems is examined. The analyzed instruments and methods are: user studies, personas, usability tests, user experience expert evaluations, and extended unit tests. The conclusion provides tips and tricks for practitioners.
This paper describes the use of gamification and visual technologies in a classroom for higher education, specifically for university students. The goal is to achieve a major increase in student motivation and engagement through the use of various technologies and learning methodologies based on game mechanics called gamification. Gamification is used to engage students in the learning process. This study adds learning methodologies like Learning by Doing to students’ collaborative work, and mixes teacher support with new, accessible technology, such as virtual reality and visualization 3D on the web thanks to webGL. This creates a new management tool, called GLABS, to assist in the gamification of the classroom. Understanding the role of gamification and the technology in education means understanding under what circumstances game elements can drive a student’s learning behavior so that he or she may achieve better results in the learning process.
This paper presents the application of Lesson Study technique to seven subjects in different faculties in three Spanish universities. Lesson study is a methodology for the improvement of any teaching activity based on the detailed observation of lessons and analysis, carried out mainly by team of teachers. This technique has been extensively used for schools and high schools in particular in Japan and UK, but its use at University is not that common. In order to make a comparison of the a pplication of the technique, a set of surveys were designed including two surveys for teachers (before and after the session) and one for students (only after the session). This paper makes an overall description of the experience and presents some of the results of the students’ survey. The survey includes questions about usefulness, motivation, and attention of the session and an overall assessment of the lesson study technique. It also contents qualitative questions using a Bipolar Laddering Assessment (BLA). The comparison of the results of the different subjects provides interesting insight about the strong and weak points of the use of the methodology in the different areas and allows for a faster improvement of the sessions in the framework on Lesson Study.
This paper aims to provide the theoretical framework and methodology for the definition of data collection tools designed to assess the effectiveness and impact of training envisaged by the LEARNING4WORK project. This project is based on the development of learning strategies within the framework of Vocation Training, in order to improve learning processes and make them more applicable in the real working world while minimizing the number of student drop-outs. Learning methods are re-conceptualized through the use of immersive worlds and role and project-orientated-learning. Scenario Centered Curriculum (SCC) was applied to promote the acquisition and development of international cooperation skills through the use of Information Communication Technologies (ICT) tools and systems. The paper focuses on the design process of the evaluation initial questionnaires (or Pre-test), starting from the theoretical framework established in the field of learning in formal, informal and non-formal educational contexts, applied to an innovative vision of education and training, centered on the learner’s future professional role.
Using enhanced learning technologies (TEL) including immersive virtual reality environments, we are seeking to achieve a new way of assessing subjects of 3D arts. We have developed a project based on Scenario Centered Curriculum (SCC), where the students have to think, design, convey, validate, and build a civil project using new technologies that help in the assessment process. We have used gamification techniques and game engines to evaluate planned tasks in which students can demonstrate the skills they developed in the scenarios. The assessment is integrated in the creation of a 3D complex model focused on the construction of a building in a virtual space. This whole process will be carried out by gamification techniques to embed the assessment of the 3D models with the objective of improving students learning.
We are experiencing today the co-evolution of two distinct approaches to human-centered design research in practice: research that informs the design development process and research that inspires the design development process. Research that informs the design development process has been evolving for many years and is by now well established. Thus, this paper will describe the patterns leading to the emergence of research that inspires the design development process. It will also describe the design spaces (i.e., consuming, experiencing, adapting and co-creating) that are emerging at the intersection of the co-evolution.
Includes bibliographical references,index
Thesis (Ph. D.)--Ohio State University, 1965.
Constructivist psychotherapy: A theoretical framework
- V F Guidano
Guidano, V. F.: Constructivist psychotherapy: A
theoretical framework. In Neimeyer, R. A.,
Mahoney, M. J. (Eds.): Constructivism in
Psychotherapy. Cambridge: Cambridge University
Press, 1989.
Subjective experience gathering techniques for interaction design
- O Tomico
Tomico, O.: Subjective experience gathering
techniques for interaction design. Doctoral
dissertation (Technical University of Catalunya,
2007).
Features, foundations and future directions
- R A Neimeyer
Neimeyer, R. A. Features, foundations and future
directions. In Neimeyer, R. A., Mahoney, M. J.
(Eds.): Constructivism in Psychotherapy.
Washington: American Psychological Association,
1995.
Virtuosos of the experience domain
- E Sanders
Sanders, E.: Virtuosos of the experience domain.
In Proceedings of the 2001 IDSA Education
Conference (2001)
Quasi- Experimentation: Design and Analysis Issues for Field Settings Information, Inspiration and Cocreation
- T D Cook
- D T Campbell
- E Sanders
Cook, T. D., Campbell, D.T.: Quasi-
Experimentation: Design and Analysis Issues for
Field Settings. Boston: Houghton-Mifflin Co, 1979.
[3] Sanders, E.: Information, Inspiration and Cocreation. In Proceeding of the 6th International
Conference of the European Academy of Design.
(Bremen, University of the Arts, 2005).
Experience landscapes
- O Tomico
- M Pifarré
- J Lloveras
Tomico, O., Pifarré, M., Lloveras, J.: Experience
landscapes. In Proc. DESIGN 2006 Conf.
(Dubrovnik, Croatia, 2006).
Constructivist approaches to the measurement of meaning
- R A Neimeyer
Neimeyer, R. A.: Constructivist approaches to the
measurement of meaning. In: Neimeyer G. J.
(ed): Constructivist Assessment: A Casebook.
London: Sage Publications, 1993.
The change of personal constructs from the viewpoint of a theory of implications. Doctoral dissertation (Ohio state university
- D N Hinkle
Hinkle, D.N.: The change of personal constructs
from the viewpoint of a theory of implications.
Doctoral dissertation (Ohio state university, 1965).