Jorma Sajaniemi’s research while affiliated with University of Eastern Finland and other places

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (73)


Fig. 1. Illustration of the relative frequencies of object reference types in Study 1. 
Fig. 2. An illustration of the relationships between mental models in the explaining task and error locating task. 
Fig. 3. An illustration of mapping of mental models in the error fi xing task. 
Fig. 7. Illustration of relative frequencies of object reference types in the error description task in Study 3. 
A mental model perspective for tool development and paradigm shift in spreadsheets
  • Article
  • Full-text available

November 2015

·

284 Reads

·

10 Citations

International Journal of Human-Computer Studies

·

Jorma Sajaniemi

To address the problem of errors in spreadsheets, we have investigated spreadsheet authors mental models in a hope of finding cognition-based principles for spreadsheet visualization and debugging tools. To this end, we have conducted three empirical studies. The first study explored the nature of mental models of spreadsheet authors during explaining and debugging tasks. It was found that several mental models about spreadsheets are activated in spreadsheet authors minds. Particularly, when explaining a spreadsheet, the real-world and domain mental models are prominent, and the spreadsheet model is suppressed; however, when locating and fixing an error, one must constantly switch back and forth between the domain model and the spreadsheet model, which requires frequent use of the mapping between problem domain concepts and their spreadsheet model counterparts. The second study examined the effects of replacing traditional spreadsheet formulas with problem domain narratives in the context of a debugging task. Domain narratives were found to be easy to learn and they helped participants to locate more errors in spreadsheets. Furthermore, domain narratives also increased the use of the domain mental model and appeared to improve the mapping between the domain and spreadsheet models. The third study investigated the effects of allowing spreadsheet authors to fix errors by editing domain narratives, thus relieving them from the use of traditional low-level cell references. This scenario was found to promote spreadsheet authors using even more of their domain mental model in a manner that completely overshadowed the use of their spreadsheet mental model. Thus, from a mental model perspective, it is possible to devise a new spreadsheet paradigm that uses domain narratives in place of traditional spreadsheet formulas, thus automatically presenting spreadsheet content so that it prompts spreadsheet authors to think in a manner that closely corresponds to their mental models of the application domain.

Download

Fig. 1. 
Fig. 2. 
Fig. 3. 
Visualizing the Problem Domain for Spreadsheet Users: A Mental Model Perspective

August 2014

·

218 Reads

·

6 Citations

Earlier research on spreadsheet authors' mental models has shown that people possess several types of information about spreadsheets. Especially, when explaining a spreadsheet, the real-world and domain mental models are prominent and the spreadsheet model is suppressed, but when locating and fixing an error, one must constantly switch back and forth between the domain model and the spreadsheet model, which requires frequent use of the mapping between problem domain concepts and their spreadsheet model counterparts. This paper introduces a new spreadsheet visualization tool and its empirical evaluation. The tool translates traditional spreadsheet formulas into problem domain narratives and highlights referenced cells. The tool was found to be easy to learn and helped the participants to locate more errors in spreadsheets. Furthermore, the tool increased the use of the domain mental model and appeared to improve the mapping between the spreadsheet model and the domain model.


Fig. 1. Visualization of a Sales Report spreadsheet. The cell cursor is in C9, whose formula is visible at the formula bar and narrated in domain terms in the light green box. Cells referred to in the domain narrative are highlighted with light green background. All formula cells are marked with a pink right border. 
Fig. 2. 
A domain terms visualization tool for spreadsheets

July 2014

·

117 Reads

·

5 Citations

Earlier research on spreadsheet authors' mental models has shown that people possess several types of information about spreadsheets. The research results also suggested that a tool intended to aid in comprehension and debugging of spreadsheets should make prominent real-world and problem domain concepts and map them easily to spreadsheet-specific details. This poster introduces a new spreadsheet visualization tool which was developed to demonstrate that it is possible to have an easy-to-use spreadsheet understanding and debugging tool that relieves users from spreadsheet details and lets them utilize more of their mental model of the application domain. The tool translates traditional spreadsheet formulas into problem domain narratives and highlights referenced cells.


Fig. 1. A line illustration of the relative frequencies of different object reference types in the three tasks.
An empirical study of spreadsheet authors' mental models in explaining and debugging tasks

September 2013

·

150 Reads

·

13 Citations

In this paper, we report on an empirical study exploring the nature of mental models of spreadsheet authors when they are explaining and debugging their own spreadsheets. Study participants were first asked to explain one of their own spreadsheets, and then to find and fix seeded errors in the same spreadsheets. Talk-aloud protocols were collected and analyzed to reveal the nature of participants' mental models in these activities. The findings indicate that the authors explain their spreadsheets mainly in terms of real-world and problem domain concepts; in debugging, they constantly switch between problem domain concepts and spreadsheet-specific concepts, although they mainly use spreadsheet-specific concepts to fix an identified error. These study findings provide insights on the need for developing spreadsheet authoring and debugging tools that correspond to spreadsheet authors' mental models of spreadsheets.


An Inter-Rater Reliability Analysis of Good's Program Summary Analysis Scheme

May 2012

·

13 Reads

·

7 Citations

In computer science education and research into the psychology of programming, program summary analysis has been used to characterize mental models of novice and expert programmers and to measure learning outcome of programs and programming concepts. This paper reports an investigation where three raters used Good's program summary analysis scheme consisting of two independent classifications of program summary segments: information types and object description categories. The problems in using the scheme as well as differences between the raters were recorded and analyzed. The findings indicate that by improving the scheme and its documentation, most of the observed inter-rater differences can be avoided. The only open problem concerns making the distinction between descriptions of data and activities in cases where the specific words that are used, or the abstractness of expression may affect raters' interpretation of the information type.


Communication in Testing: Improvements for Testing Management

May 2012

·

20 Reads

Testing in companies with highly competitive environments has many opportunities and challenges. Testing is diversified, both contextually and geographically: there are many testing goals, many ongoing parallel projects, many testing phases and all this needs to be managed so that the full view of testing is visible for management and reporting. Testing is also linked to project communication and psychology: communication needs to be constructive, and testers and test leaders should have good interpersonal skills. It really does matter how a failure or test report is formulated. In order to localize testing problems in a large software-intensive company, we conducted a current state analysis via web-based questionnaire among experienced testing practitioners, most having at least 5 years experience in these tasks. The scope of the survey was decided to keep broad with the goal of finding future improvements within tool, process and method development. In this paper, we will concentrate on those survey results that have psychological underlying. Based on the results, we suggest a set of improvements for testing and, especially, test reporting. Implementation of these improvements is still underway, but the findings and suggestions provide insight into psychology of testing.


An Experiment on the Short-Term Effects of Engagement and Representation in Program Animation

December 2008

·

34 Reads

·

5 Citations

Journal of Educational Computing Research

When visualization tools utilized in computer programming education have been evaluated empirically, the results have remained controversial. To address this problem, we have developed a model of short-term effects of program animation, and used it in a series of experiments. In the current experiment, we varied visual representation of an animation tool and the type of students' engagement. Results of the current experiment analyzed together with the results from the earlier experiments provided support for the hypothesis that what a student does plays a more central role in the usefulness of a visualization than representation used by the tool. Moreover, the levels of engagement as they are generally used in the research literature seem not to be the best possible indicators of the effectiveness of a visualization. (Contains 11 tables and 4 figures.)


Improving Knowledge Sharing in Embedded Software Production Line

October 2008

·

13 Reads

·

3 Citations

A smoothly running software production line (SPL) requires consistent family-viewpoint awareness among the stakeholders through the development cycle, which in software-intensive products' engineering extends from requirements elicitation and marketing to detailed design and integration testing. To improve knowledge sharing among the stakeholders, we developed a documentation model based on feature modelling, and implemented it in a concurrent and multi-site development environment In this paper we share our experience from the field, gathered during the development and qualitative and quantitative performance analysis of this production-line kind of software development environment.



From Procedures To Objects: A Research Agenda For The Psychology Of Object-oriented Programming Education

May 2008

·

950 Reads

·

21 Citations

Human Technology

Programming education has experienced a shift from imperative and procedural programming to object-orientation. This shift has been motivated by educators' desire to please the information technology industry and potential students; it is not motivated by research either in psychology of programming or in computer science education. There are practically no results that would indicate that such a shift is desirable, needed in the first place, or even effective for learning programming. Moreover, there has been an implicit assumption that classic results on imperative and procedural programming education and learning apply to object-oriented programming (OOP) as well. We argue that this is not the case and call for systematic research into the fundamental cognitive and educational issues in learning and teaching OOP. We also present a research agenda intended to improve the understanding of OOP and OOP education.


Citations (59)


... For instance, 'tip of the iceberg' is a visual metaphor frequently used to describe that something being discussed, encountered, felt, or experienced is a relatively small proportion of a much larger concept, situation or problem that remains unexplored (Schuman, Rowe, Glazer, & Redding, 1977). Furthermore, verbal metaphors and their visual counterparts are also commonly used in scientific writings (Robson, 1985), medicine (Marcos, 1997), biology (Shilo, 2013), physiology (Paton, 1992), chemistry (Bhushan & Rosenfeld, 1995), psychiatry (Alyami et al., 2015), psychology (Nash, 1962;Stott et al., 2010), computer science (Carroll & Mack, 1985;Petre & Blackwell, 1999;Stützle & Sajaniemi, 2005), and films (Forceville, 2015). ...

Reference:

Enhancing suicide risk assessment through the use of visual metaphor
An Empirical Evaluation of Visual Metaphors in the Animation of Roles of Variables

Informing Science The International Journal of an Emerging Transdiscipline

... Although the study found some important differences, a larger sample size may have allowed more precise characterisation of differences between sub-groups. While a larger number of participants would give greater confidence in the findings, we note that studies of small numbers of participants (ranging from 10 to 30 participants) are commonly published in the health services research and survey research literature [34,[48][49][50][51][52]. The nature of eye tracking data also facilitates the collection of a large number of data points within a relatively small sample-i.e. ...

Comparison of Three Eye Tracking Devices in Psychology of Programming Research
  • Citing Conference Paper
  • January 2004

... Se encarga de estudiar la cognición de los programadores de computadoras, así como herramientas y métodos para actividades relacionadas con la programación y su aprendizaje. Aborda también la usabilidad desde el punto de vista humano y una gran variedad de fenómenos, desde problemas de principiantes hasta el conocimiento de los expertos, desde la etapa de diseño hasta la etapa de pruebas y desde programas cortos e individuales hasta grandes sistemas creados en colaboración (Sajaniemi, 2008). Existen por lo menos cinco paradigmas psicológicos desde los cuales se abordan los problemas de la programación (Curtis, 1988): 1) Diferencias individuales. ...

Psychology of Programming: Looking into Programmers’ Heads

Human Technology

... However, users expressing low self-efficacy may also be unintentionally downplaying their proficiency. Previous research highlights that technical spreadsheet proficiency is often expressed in the context of one's domain knowledge [22], [23]. Therefore, it is important to consider not only general spreadsheet self-efficacy (GSE), which concerns general technical spreadsheet proficiency, but also contextspecific self-efficacy (CSSE), or proficiency in the context of one's work-related tasks. ...

A mental model perspective for tool development and paradigm shift in spreadsheets

International Journal of Human-Computer Studies

... That is, it should consist of a small number of parts that interact in ways that can be easily understood. " [37, p. 265] As others before [37,77,83,120], we distinguish between conceptual simplicity of program behavior and syntactic simplicity; we focus on the former. ...

From Procedures To Objects: A Research Agenda For The Psychology Of Object-oriented Programming Education

Human Technology

... Computer programming is a complex skill with cognitive and noncognitive challenges (McCracken et al., 2001). To develop flexible programming skills, students need to learn programming syntax (Altadmri & Brown, 2015;Sajaniemi & Navarro-Prieto, 2005), understand programming concepts (Bayman & Mayer, 1983;Cañas et al., 1994;Ma, 2007;Ma et al., 2007;Sirkiä & Sorva, 2012), and coordinate and apply this knowledge to solve novel problems (see Qian & Lehman, 2017 for a review). Students also need to regulate emotions that arise during learning (Bosch et al., 2014;D'Mello & Graesser, 2011), maintain motivation and engagement, and persist in the face of failure (Renumol et al., 2010). ...

Roles of variables in experts’ programming knowledge

... Mental models: Developers have mental models of the spreadsheets with which they develop or interact [47] [48][49] [50]. Thus, understanding their mental models will lead to better knowledge of why spreadsheet development is error-prone and enable the development of new tools and techniques that better correspond to spreadsheet developers' cognitive abilities. ...

A domain terms visualization tool for spreadsheets

... Since labels have been successfully employed in the past for annotating and explaining cells [4,19,26,29], we use labels to explain a set of references by one or two (row and/or column) labels ℓ ∈ Lab = Val ∪ Val × Val. More precisely, based on a relationship L ⊆ A × A where (a, a ′ ) ∈ L whenever the ...

Visualizing the Problem Domain for Spreadsheet Users: A Mental Model Perspective