Conference PaperPDF Available

Deconstructing Concept Maps: Uncovering The Reading Behind The Concepts Through Text Annotation

Authors:

Abstract and Figures

Teachers have successfully applied concept maps in educational settings. In particular, concept maps have been recognized as an effective tool for diagnosing students' misunderstandings. Frequently, students create concept maps from reading materials that teachers provide to develop the necessary background to draw the map. However, when it comes to tracing back the root of these misunderstandings, concept maps fall short. A concept map captures a mindset snap but not the reading experiences that underpin this mindset. The rationale that drives the creation of the map's concepts and relationships is often not explicit but in the students' heads. This rationale should be sought in the reading material, provided by teachers and 'processed' by the students to deliver the concept map. On these premises, concept mapping starts way before students draw their maps but at reading time. This turns concept mapping into an annotation activity. Annotation serves as a link between the reading content and the developed concept map. Highlighting or commenting on class books is the prelude to drawing nodes and arcs. Accordingly, we advocate for concept mapping tools to be extended with annotation facilities so that concepts and relationships can be traced back to the books' highlights that informed these decisions, and, in so doing, allows teachers to gain a deeper insight into students' misconceptions. This paper provides a proof of concept through Concept&Go, a web browser extension for building concept maps in CmapTools grounded on annotations.
Content may be subject to copyright.
DECONSTRUCTING CONCEPT MAPS: UNCOVERING THE READING BEHIND THE CONCEPTS
THROUGH TEXT ANNOTATION
Xabier Garmendia1, Oscar Díaz1 & Haritz Medina1
1University of the Basque Country (UPV/EHU), San Sebastian, Spain
Email: {xabier.garmendiad, oscar.diaz, haritz.medina}@ehu.eus
Abstract. Teachers have successfully applied concept maps in education al settings. In particular, concept maps have been
recognized as an effective tool for diagnosing students’ misunderstandings. Frequently, students create concept maps from
reading materials that teachers provide to develop the necessary background to draw the map. However, when it comes to tracing
back the root of these misunderstandings, concept maps fall short. A concept map captures a mindset snap but not the reading
experiences that underpin this mindset. The rationale that drives the creation of the map’s concepts and relationships is often not
explicit but in the students’ heads. This rationale should be sought in the reading material, provided by teachers and ‘processed’
by the students to deliver the concept map. On these premises, concept mapping starts way before students draw their maps but at
reading time. This turns concept mapping into an annotation activity. Annotation serves as a link between the reading content
and the developed concept map. Highlighting or commenting on class books is the prelude to drawing nodes and arcs.
Accordingly, we advocate for concept mapping tools to be extended with annotation facilities so that concepts and relationships
can be traced back to the books’ highlights that informed these decisions, and, in so doing, allows teachers to gain a deeper
insight into students’ misconceptions. This paper provides a proof of concept through Concept&Go, a web browser extension for
building concept maps in CmapTools grounded on annotations.
Keywords: concept mapping, web annotation, education, traceability
1 Introduction
Since they were developed in the course of Novak’s research program, a large body of literature emerged
pertaining to the use of Concept Mapping in educational settings (Novak et al., 1984; Cañas et al., 2003). The
construction of concept maps assists in organizing, sharing, and representing knowledge, which leads to a visual
indication of the student’s conceptual understanding and misconceptions about the given focus question.
Indeed, the role of concept maps in the diagnosis of students’ misunderstandings has been demonstrated by
their sensitivity to (i) the structural nature of student knowledge, (ii) intrusions or distortions in students’
understanding of content, and (iii) errors of omission (Surber, 1984; McClure et al., 1999). Yet, it is not yet
clear how to trace back the origins of these misunderstandings. This begs the question of how concept maps are
elaborated.
Students' knowledge does not come out of the blue. Teachers play a key role in facilitating and instructing
the map construction process (Atapattu et al., 2014). One of the ways to assist students' concept mapping
process is by facilitating reading materials associated with the topic or focus question. Here, students are asked
to construct a concept map to reflect their understanding and measurement of the text comprehension from the
given resources. Concept mapping has been shown to be valid for learning from reading materials enhancing
comprehension and summarization skills (Cañas et al., 2003; Cañas et al., 2008; Chang et al., 2002). Learning
from texts can provide important functions such as (i) fostering elaboration processes, (ii) reducing content for
enhancing the acquisition and retention of ideas, (iii) facilitating the construction of coherence, and (iv)
supporting metacognitive processes (Hilbert et al., 2008).
Students' outcoming concept map is followed by the validation from teachers. The latter allows teachers to
note missing or irrelevant concepts, and trivial or incorrect linking phrases (Cañas et al., 2003). It is not easy for
teachers to find what is behind these misunderstandings. Though concept maps might help spot students'
mistakes, they fall short to trace back their causes. Specifically, the grounding reading that underpins the map
element is not explicit but in the students’ heads. Needed is a way to make explicit the link between the reading
material and the students’ concept map elements. To this end, we look at annotation-based concept map
construction.
Annotation is a time-honored practice to assist in understanding and making understood reading material. If
the instruction is supported through reading materials, students can complement their concept maps with
annotations that sustain the concepts and relationships their concept maps are built upon. This would allow
teachers to go beyond the concept map, and ascertain what makes students create a map element. In this way,
concept constructs are linked back to annotations that come from one or distinct reading sources. By keeping
annotations, teachers might be able ‘to deconstruct’ the concept map. Certainly, annotation gathering should be
achieved as seamlessly as possible without disturbing the reading flow. This is when web annotation tools come
into play. This work introduces Concept&Go, a browser extension that bridges Hypothes.is as annotation
manager and CmapTools as the concept map editor.
2 Annotation-based concept mapping
Annotation includes highlighting text, adding comments, or classifying the annotated content. Annotation aids
in the mediation of the reading-writing interaction. While reading, people underline crucial passages, identify
plot devices, and remark on structure and dialogue. When writing, people refer to those passages or remark
points to later write a report or a final paper. Annotation has been proved to be an effective way of aiding in the
comprehension and interpretation of written information (Kawase et al., 2009).
Annotation becomes ‘Web Annotation’ when the content is a ‘Web resource’ and the process takes place on
the Web. Implementation-wise, Web annotations are displayed as a layer on top of the Web content. The
annotation layer is usually provided by a web annotation client, which allows users to add, modify or remove
annotations upon a web resource without modifying the resource itself.
Annotation can be regarded as the preamble of concept mapping. Annotation is a means to content
comprehension. Content comprehension absorbs different external experiences (reading included) that build up
a mindset. This mindset is made explicit through concept mapping. Thus, tightly integrating the activities of
annotation and concept mapping would account for a seamless transition from the construction of concept maps
out of annotations, and the other way around, i.e., the de-construction of concept maps into the readings that
underpin the mind map (see Fig.1).
Figure 1. Constructing and deconstructing concept maps from annotations.
But, what is meant by ‘tightly integrating’? Implications are twofold:
Concept mapping is a gradual-and-iterative process. If concept mapping is to be founded on
annotations, then annotation is not a one-shot effort but one to be conducted throughout. This
annotation-mapping interplay calls for a smooth and seamless transition from the annotation space to
the mapping space,
Concept mapping is a trial-and-error process. When looking at the students’ maps, teachers might turn
to annotations to find out the underpinning readings that led to the students’ misconceptions: what
makes students come up with this concept? What leads students to set this relationship? How could
they miss this important notion described in the textbook? This calls for being able to trace concepts
and relationships in the map back to the reading material.
Tool-wise, three options arise: (1) concept mapping to be offered as part of annotation tools; (2) annotation
to be offered as part of concept mapping editors; and (3), a bridge approach that acts as a conveyor belt’
between two decouple tools: the annotation tool and the mapping tool. We follow this last approach.
3 Proof-of-concept: Concept&Go
Concept&Go is a web annotation tool aimed at concept mapping. When the reading material (PDF or Web
content) is opened in a browser tab, Concept&Go can be activated with a single click. This causes a sidebar to
show up on the left part of the document. This sidebar contains the concepts collected so far (see Fig. 2.1).
Compared with other Web tools (e.g., Diigo), Concept&Go does not stop at highlighting quotes from text
paragraphs but elaborates on the so-gathered quotes to come up with concepts and relationships. From this
perspective, Concept&Go is not stand-alone but requires two companions: Hypothes.is
1
as the annotations’
persistent storage, and CmapCloud (the cloud service of CmapTools)
2
to depict the developed concept map with
its annotations. Next, we review the steps of concept mapping along with ‘The Standard Concept Map
Construction Method’ (Cañas et al., 2003).
Figure 2. Constructing and deconstructing concept maps using annotations in Concept&Go. Mimick ing Open Coding, text paragraphs
highlighted during readings (i.e., annotations) are abstracted into concepts and relationships during concept mapping.
Focus Question definition. Through reading, students discover new concepts and relationships. This step
involves defining which will be the topic of the concept map. The first time Concept&Go is activated, it asks to
introduce the topic of the new concept map. In the example of Fig. 2, we will use ‘Photosynthesis’. Once the
student defines a topic, the topic concept is established as the root node of the concept map and it is displayed as
a button in the sidebar.
Concept handling. Through annotation, students capture text fragments that are eventually abstracted into
a new concept. Broadly, this is Open Coding as introduced by the Grounded-Theory method (Walker et al.,
2006). Through color-coding, Concept&Go allows for concepts to be created on the fly: highlight the text
paragraph expressing the concept (e.g., “plants”), and click ‘New concept’. This turns the quote into a concept,
and, as such, supports it as a button in the side panel (see Fig. 2.1). From then on, the occurrence of this concept
in the current text can be highlighted by clicking this dedicated button. The codes can be linked to a line, a
sentence, a paragraph, or wholesome text. This results in a (concept, occurrence, document) annotation triplet to
1
https://web.hypothes.is/
2
https://cmapcloud.ihmc.us/
be stored in Hypothes.is. Certainly, occurrences might take different ways to express the concept and can be
captured from different reading materials. Annotation involves abstraction from the written realization to the
abstract notion embedded by the concept. Concept names can be changed at any time as students come up with
the most accurate terminology. In Fig. 2.1, “photosynthesis” and “plants” are captured while reading a
Wikipedia page.
Relationship handling. Relationships involve two concepts linked through a linking word. As well as with
concepts, students can find ‘concept-link-concept’ triples propositions while reading. These relationships can be
found written explicitly, implicitly, or collected on a table. Therefore, the student has to be able to capture the
relationship by annotating the linking word in the same way as with concepts. To complete a relationship, it is
necessary to provide the "from" and "to" concepts together with the linking word. When the student detects a
candidate linking word in the text, the student has to annotate the text fragment by clicking the ‘New relation’
button. Then, Concept&Go opens a panel where the students can select the concepts that are involved in the
relationship by selecting two concepts from the list of the current concepts. Concept&Go allows visualizing,
editing, and deleting the relationships. Fig. 2.1 illustrates how the linking word “used by is captured while
reading in Wikipedia. Fig. 2.3 shows the visualization once exported to CmapCloud.
Map reviewing. A set of annotations is not a concept map but ground a concept map. Annotations go
through abstraction to end up in a (tentative) concept map. Concept&Go permits exporting annotations to
CmapCloud. The exported folder contains both the concept map itself plus the associated annotation resources
(URLs) (see Fig. 2.2). By supporting annotations as URLs rather than mere text, it is possible to navigate back
to the reading material. Fig. 2 shows the case for “organisms”. Concepts are now displayed together with their
annotation counterparts. Click on the annotation icon ( ), for opening the annotations in subsequent browser
tabs (see Fig. 2.3). Students can then go back to the reading sources where the annotation appears, check back
their annotations, update as appropriate, and when convenient, move back to see the whole picture again in
CmapCloud. Fig. 2.4 illustrates the case of the student moving back to the annotations which underpin the
‘organisms’ concept in Wikipedia. She also decides to consult the Biolibre website where she finds out about
‘Cyanobacteria’ and ‘Plants’ as the only ‘Organisms’ that perform photosynthesis. This results in renaming
‘organisms’ (Fig. 2.5). Likewise, the student annotates two additional pieces of evidence for the ‘store solar
energy’ concept and the relation with photosynthesis (Fig. 2.5). This ends up being reflected in the concept map
(Fig. 2.6) where the text “is vital because” is abstracted in the relationship “important for” (Fig. 2.6).
The bottom line is that construction (moving from the Reading realm to the Mapping realm) and de-
construction (moving from the Mapping realm to the Reading realm) interplay throughout.
4 Conclusions and Future Work
Annotation and concept mapping can be regarded as the visible activities that mediate the invisible task of
understanding. These activities (i.e., annotation and concept mapping) are far from being sequential but
intermingled throughout. This annotation-mapping interplay calls for a smooth and seamless transition from the
annotation space to the mapping space. To this end, we introduce Concept&Go, a browser extension for web
annotation aimed at concept mapping. The vision is for concept mapping to become
a gradual and iterative construction of concept maps by supporting a seamless interplay between
annotation and mapping,
a trial-and-error process where students and teachers alike can trace concepts back to the reading
sources, and in so doing, face misunderstandings.
Concept&Go can be installed from the Chrome Web Store and it is publicly available under the MIT
license on GitHub. Our ultimate aim is to promote debate among the community about the large potential that
the marriage between annotation and concept mapping can bring. We are enthusiastic about teaming up with
teachers and researchers in evaluating, improving, and disseminating the Concept&Go vision.
References
Atapattu, T., Falkner, K., & Falkner, N. (2014). An evaluation methodology for concept maps mined from
lecture notes: An educational perspective. In Int. Conf. on Computer Supported Education (pp. 68-83).
Springer, Cham.
Cañas, A. J., Coffey, J. W., Carnot, M. J., Feltovich, P., Hoffman, R. R., Feltovich, J., & Novak, J. D. (2003). A
summary of literature pertaining to the use of concept mapping techniques and technologies for education
and performance support. Report to the Chief of Naval Education and Training, 1-108.
Cañas, A. J., & Novak, J. D. (2008). Concept Mapping using CmapTools to Enhance Meaningful Learning. In
A. Osaka, S. B. Shum, & T. Sherborne (Eds.), Knowledge Cartography: Springer Verlag.
Chang, K. E., Sung, Y. T., & Chen, I. D. (2002). The effect of concept mapping to enhance text comprehension
and summarization. Journal of Experimental Education, 71(1), 5–23.
Hilbert, T. S., & Renkl, A. (2008). Concept mapping as a follow-up strategy to learning from texts: what
characterizes good and poor mappers? Instructional Science, 36(1), 53-73.
Kawase, R., Herder, E., & Nejdl, W. (2009). A comparison of paper-based and online annotations in the
workplace. In European Conference on Technology Enhanced Learning (pp. 240-253). Springer, Berlin,
Heidelberg.
McClure, J. R., Sonak, B., & Suen, H. K. (1999). Concept map assessment of classroom learning: Reliability,
validity, and logistical practicality. Journal of Research in Science Teaching: The Official Journal of the
National Association for Research in Science Teaching, 36(4), 475-492.
Novak, J. D. & Gowin, D. B. (1984). Learning how to learn. New York: Cambridge University Press
Surber, J.R. (1984). Mapping as a testing and diagnosis device. In C.D. Holly & D.F. Dansereau (Eds.), Spatial
learning strategy: Techniques, applications and related issues (pp. 3–19). New York: Academic
Walker, D., & Myrick, F. (2006). Grounded theory: An exploration of process and procedure. Qualitative health
research, 16(4), 547-559.
ResearchGate has not been able to resolve any citations for this publication.
Conference Paper
Full-text available
Concept maps are effective tools that assist learners in organising and representing knowledge. Recent efforts in the area of concept mapping work toward semi- or fully automated approaches to extract concept maps from various text sources such as text books. The motivation for this research is twofold: novice learners require substantial assistance from experts in constructing their own maps, introducing additional hurdles, and alternatively, the workload required by academics in manually constructing expert maps is substantial and repetitive. A key limitation of an automated concept map generation is the lack of an evaluation framework to measure the quality of concept maps. The most common evaluation mechanism is measuring the overlap between machine-generated elements (e.g. concepts) with expert maps using relevancy measures such as precision and recall. However, in the educational context, the majority of knowledge presented is relevant to the learner, resulting in a large amount of information being retrieved for knowledge organisation. Therefore, this paper introduces a machine-based approach to evaluate the relative importance of knowledge by comparing with human judgment. We introduce three ranking models and conclude that the structural features are positively correlated with human experts (rs ~ 1) for courses with rich content and good structure (well-fitted).
Conference Paper
Full-text available
While reading documents, people commonly make annotations: they underline or highlight text and write comments in t he margin. Making annotations during reading activities has been show n to be an efficient method for aiding understanding and interpretation. In thi s paper we present a comparison of paper-based and online annotations in the workplace. Online annotations were collected in a laboratory study, m aking use of the Web-based annotation tool SpreadCrumbs. A field study was out to gather paper-based annotations. The results validate the benefits of W eb annotations. A comparison of the online annotations with paper-based annotati ons provides several insights in user needs for enhanced online annotation tools, from which design guidelines can be drawn.
Article
Full-text available
Although graphic strategies, such as graphic organizers and knowledge maps, have proved helpful for text learning, certain important application issues such as surface processing and cognitive overload have yet to be resolved. The authors tested the learning effects of a concept-mapping strategy. They designed 3 concept-mapping approaches-map correction, scaffold fading, and map generation-to determine their effects on students' text comprehension and summarization abilities. The experimental results from 126 fifth graders showed that the map-correction method enhanced text comprehension and summarization abilities and that the scaffold-fading method facilitated summarization ability.
Article
The psychometric characteristics and practicality of concept mapping as a technique for classroom assessment were evaluated. Subjects received 90 min of training in concept mapping techniques and were given a list of terms and asked to produce a concept map. The list of terms was from a course in which they were enrolled. The maps were scored by pairs of graduate students, each pair using one of six different scoring methods. The score reliability of the six scoring methods ranged from r = .23 to r = .76. The highest score reliability was found for the method based on the evaluation of separate propositions represented. Correlations of map scores with a measure of the concept maps' similarity to a master map provided evidence supporting the validity of five of the six scoring methods. The times required to provide training in concept mapping, produce concepts, and score concept maps were compatible with the adoption of concept mapping as classroom assessment technique. © 1999 John Wiley & Sons, Inc. J Res Sci Teach 36: 475–492, 1999
Chapter
Concept maps are graphical tools that have been used in all facets of education and training for organizing and representing knowledge. When learners build concept maps, meaningful learning is facilitated. Computer-based concept mapping software such as CmapTools have further extended the use of concept mapping and greatly enhanced the potential of the tool, facilitating the implementation of a concept map-centered learning environment. In this chapter, we briefly present concept mapping and its theoretical foundation, and illustrate how it can lead to an improved learning environment when it is combined with CmapTools and the Internet. We present the nationwide “Proyecto Conéctate al Conocimiento” in Panama as an example of how concept mapping, together with technology, can be adopted by hundreds of schools as a means to enhance meaningful learning.
Article
Concept maps consist of nodes that represent concepts and links that represent relationships between concepts. Various studies have shown that concept mapping fosters meaningful learning. However, little is known about the specific cognitive processes that are responsible for such mapping effects. In a thinking-aloud study, we analyzed the relations between cognitive processes during concept mapping as well as the characteristics of the concept maps that the learners produced and learning outcomes (38 university students). To test whether differences in learning outcome are due to differences in general abilities, verbal and spatial abilities were also assessed. In a cluster-analysis two types of ineffective learners were identified: ‘non-labeling mappers’ and ‘non-planning mappers’. Effective learners, in contrast, showed much effort in planning their mapping process and constructing a coherent concept map. These strategies were more evident in students with prior concept-mapping experience (‘advanced beginners’) than in those who had not used this learning strategy before (‘successful beginners’). Based on the present findings, suggestions for a direct training approach (i.e., strategy training with worked-out examples) and an indirect training approach (i.e., supporting the learners with strategy prompts) were developed.
Chapter
For almost a century, educational theory and practice have been influenced by the view of behavioural psychologists that learning is synonymous with behaviour change. In this book, the authors argue for the practical importance of an alternate view, that learning is synonymous with a change in the meaning of experience. They develop their theory of the conceptual nature of knowledge and describe classroom-tested strategies for helping students to construct new and more powerful meanings and to integrate thinking, feeling, and acting. In their research, they have found consistently that standard educational practices that do not lead learners to grasp the meaning of tasks usually fail to give them confidence in their abilities. It is necessary to understand why and how new information is related to what one already knows. All those concerned with the improvement of education will find something of interest in Learning How to Learn.
Grounded theory: An exploration of process and procedure
  • J R Surber
Surber, J.R. (1984). Mapping as a testing and diagnosis device. In C.D. Holly & D.F. Dansereau (Eds.), Spatial learning strategy: Techniques, applications and related issues (pp. 3-19). New York: Academic Walker, D., & Myrick, F. (2006). Grounded theory: An exploration of process and procedure. Qualitative health research, 16(4), 547-559.