ArticlePDF Available

Abstract and Figures

One of the fundamental human cognitive processes is problem solving. As a higher-layer cognitive process, problem solving interacts with many other cognitive processes such as abstraction, searching, learning, decision making, inference, analysis, and synthesis on the basis of internal knowledge representation by the object–attribute-relation (OAR) model. Problem solving is a cognitive process of the brain that searches a solution for a given problem or finds a path to reach a given goal. When a problem object is identified, problem solving can be perceived as a search process in the memory space for finding a relationship between a set of solution goals and a set of alternative paths. This paper presents both a cognitive model and a mathematical model of the problem solving process. The cognitive structures of the brain and the mechanisms of internal knowledge representation behind the cognitive process of problem solving are explained. The cognitive process is formally described using real-time process algebra (RTPA) and concept algebra. This work is a part of the cognitive computing project that designed to reveal and simulate the fundamental mechanisms and processes of the brain according to Wang’s layered reference model of the brain (LRMB), which is expected to lead to the development of future generation methodologies for cognitive computing and novel cognitive computers that are capable of think, learn, and perceive.
Content may be subject to copyright.
UNCORRECTED PROOF
1
2On the cognitive process of human problem solving
3Action editor: Ning Zhong
4Yingxu Wang
*
, Vincent Chiew
5International Center for Cognitive Informatics (ICfCI) and Theoretical and Empirical Software Engineering Research Centre,
6Department of Electrical and Computer Engineering, Schulich School of Engineering, University of Calgary,
72500 University Drive, NW, Calgary, Alberta, Canada T2N 1N4
8Received 25 February 2008; accepted 4 August 2008
9
10 Abstract
11 One of the fundamental human cognitive processes is problem solving. As a higher-layer cognitive process, problem solving interacts
12 with many other cognitive processes such as abstraction, searching, learning, decision making, inference, analysis, and synthesis on the
13 basis of internal knowledge representation by the object–attribute-relation (OAR) model. Problem solving is a cognitive process of the
14 brain that searches a solution for a given problem or finds a path to reach a given goal. When a problem object is identified, problem
15 solving can be perceived as a search process in the memory space for finding a relationship between a set of solution goals and a set of
16 alternative paths. This paper presents both a cognitive model and a mathematical model of the problem solving process. The cognitive
17 structures of the brain and the mechanisms of internal knowledge representation behind the cognitive process of problem solving are
18 explained. The cognitive process is formally described using real-time process algebra (RTPA) and concept algebra. This work is a part
19 of the cognitive computing project that designed to reveal and simulate the fundamental mechanisms and processes of the brain accord-
20 ing to Wang’s layered reference model of the brain (LRMB), which is expected to lead to the development of future generation meth-
21 odologies for cognitive computing and novel cognitive computers that are capable of think, learn, and perceive.
22 Ó2008 Published by Elsevier B.V.
23 Keywords: Cognitive informatics; Cognitive computing; Brain informatics; Computational intelligence; Reference model of the brain; Cognitive proce-
24 sses; Problem solving; Mathematical model; Concept algebra; RTPA
25
26 1. Introduction
27 The attempt to understanding the advance intelligent
28 ability of human beings for problem solving has intrigued
29 researchers from multiple disciplines, which can be traced
30 back to the Aristotle’s era (384–322BC). Problem solving
31 is identified as one of the basic life functions of the natural
32 intelligence of the brain (Polya, 1954; Wallas, 1926; Wang,
33 Wang, Patel, & Patel, 2006; Wilson & Clark, 1988). Most
34 decisions that an individual makes everyday are related
35 to certain problems needed to be solved no matter how
36trivial or critical they are. Problem solving as a process
37may be embodied in many forms, where research itself is
38essentially a typical problem solving paradigm (Beveridge,
391957).
40The history of studies on problem solving has a humble
41beginning (Mayer, 1992; Newell & Simon, 1972; Payne &
42Wenger, 1998; Polya, 1954; Robertson, 2001; Tuma & Reif,
431980; Wallas, 1926; Wang, 2008d; Wilson & Clark, 1988;
44Zadeh, 2008a). Traditional Gestalt psychology related
45human problem solving ability to learning and perception
46(Matlin, 1998; Ormrod, 1999; Wang, 2007e). Since early
471970s, psychologists acknowledged the benefits of using
48computer technologies to simulate the mechanisms of
49problem solving (Goldstein, 1978; Smith, 1991). Matlin
50(1998) expressed that psychology may not prove that a
1389-0417/$ - see front matter Ó2008 Published by Elsevier B.V.
doi:10.1016/j.cogsys.2008.08.003
*
Corresponding author. Present address: Department of Computer
Science, Stanford University, Stanford, CA 94305-9010, USA
Q2 .
E-mail addresses: yingxu@ucalgary.ca,yingxuw@stanford.edu
(Y. Wang), vincent.chiew@ieee.org (V. Chiew).
www.elsevier.com/locate/cogsys
Available online at www.sciencedirect.com
Cognitive Systems Research xxx (2008) xxx–xxx
COGSYS 281 No. of Pages 12, Model 5+
4 September 2008 Disk Used ARTICLE IN PRESS
Please cite this article in press as: Wang, Y., & Chiew, V., On the cognitive process of human problem solving, Cognitive Systems
Research (2008), doi:10.1016/j.cogsys.2008.08.003
UNCORRECTED PROOF
51 theory is correct, but may demonstrate so by using com-
52 puter simulations. In 1972, Newell and Simon developed
53 a computer program called the general problem solver
54 (GPS), which was quite successful in solving limited types
55 of carefully defined problems (Newell & Simon, 1972). In
56 his paper entitled ‘‘Developing a Computational Represen-
57 tation for Problem-Solving Skills,Ira Goldstein men-
58 tioned that computer technology could be of use as
59 personal assistants in problem solving, and to provide a
60 cognitive programming and simulating environments, to
61 achieve a deeper understanding of the subject matter and
62 to explore learning strategies (Goldstein, 1978).
63 Cognitive informatics is the transdisciplinary study of
64 cognitive and information sciences that investigate into
65 the internal information processing mechanisms and pro-
66 cesses of the natural intelligence – human brains and minds
67 – and their engineering applications ( Wang, 2002b, 2003a,
68 2007b; Zadeh, 2008a; Zadeh, 2008b; Zhong, 2006). Cogni-
69 tive informatics provides a coherent framework of contem-
70 porary theories for explaining human cognitive processes,
71 such as problem solving, learning, decision making, and
72 consciousness. A layered reference model of the brain
73 (LRMB) is developed in Wang et al. (2006), which reveals
74 that the brain and human intelligent behaviors may be
75 explained by 39 cognitive processes at six layers known
76 as the sensation, memory, perception, action, meta-cogni-
77 tion, and higher cognition layers. It is recognized that, in
78 order to enable rigorous modeling and description of the
79 brain and its cognitive mechanisms, the formal structures
80 of internal knowledge representation and new forms of
81 denotational mathematical means are essential and neces-
82 sary. The former is implemented by the object–attribute-
83 relation (OAR) model (Wang, 2007c) on the basis of neural
84 informatics (Wang, 2007b). The latter is expressed by a col-
85 lection of denotational mathematics (Wang, 2007a, 2007d,
86 2008a), such as concept algebra (Wang, 2008b) and real-
87 time process algebra (RTPA) (Wang, 2002a, 2003b,
88 2008c), which is a category of expressive mathematical
89 structures for dealing complex mathematical entities shared
90 by many modern scientific and engineering disciplines.
91 In cognitive informatics, problem solving is identified as
92 a cognitive process of the brain at the higher cognitive layer
93 that searches a solution for a given problem or finds a path
94 to reach a given goal (Wang, 2007b). Problem solving is
95 one of the 39 fundamental cognitive processes modeled in
96 the LRMB model (Wang et al., 2006). It is recognized that
97 there is a need to seek an axiomatic and rigorous model of
98 the cognitive process of human problem solving in order to
99 develop a solid and coherent theoretical foundation for
100 integrating various theories, models, and practices of prob-
101 lem solving (Wang, 2007b).
102 This paper presents a formal model of human problem
103 solving and its cognitive process. It will proceed in Section
104 2with literature surveys on problem solving and related
105 work developed in psychology, cognitive science, and com-
106 putational intelligence. In Section 3, a set of cognitive,
107 mathematical, and process models of problem solving will
108be developed and elaborated. Section 4introduces useful
109paradigms of denotationnal mathematics in the forms of
110concept algebra and RTPA. Based on them, the process
111model of problem solving is formalized for machine simu-
112lations in computational intelligence. Applications of this
113work in brain simulation and cognitive informatics are dis-
114cussed toward the development of future generation cogni-
115tive computers.
1162. Cognitive psychology of problem solving
117This section surveys related studies on problem solving
118and its cognitive foundations in psychology and computa-
119tional intelligence. The approaches to and factors affecting
120problem solving are explored. The cognitive characteristics
121of problem solvers and the impact of their knowledge in
122problem solving are discussed. A set of empirical problem
123solving procedures proposed in the field of psychology is
124comparatively analyzed, after the presentation of the con-
125text framework of problem solving in form of the LRMB
126model.
1272.1. Approaches and factors in problem solving
128It is proposed that a problem consists of three compo-
129nents known as the givens,goals,andoperations (Ormrod,
1301999; Polya, 1954). The givens are information available as
131part of the problem. The goals are defined as the desired
132termination state of a solution to the problem. The opera-
133tions are potential actions that can be executed to achieve
134the goals of a solution. For any given problem there is
135an associated problem space (Bender, 1996; Wilson &
136Clark, 1988), which is all the possible goals and paths
137potentially related to the problem known by a problem sol-
138ver. A solution to a certain problem might not exist within
139the solver’s current solution space. This could be caused by
140many factors, such as that the problem could be ill-defined,
141expected goals are ambiguous, and/or no method (path) is
142available that links the give problem object to the goal(s).
143A similar perception on the problem space is presented
144by Tuma and Reif (1980), as well as Payne and Wenger
145(1998), which identified two elements in problem solving:
146(a) adescription of all possible states of the task and prob-
147lem solver (representation); and (b) alist of the ways of
148moving among those states (search). The first element sup-
149ports a problem solver to understand the problem by
150abstraction and identification. The second element enables
151the problem solver to search for a possible solution in
152memory.
153A various of approaches to problem solving have been
154studied and proposed in psychology, cognitive informatics,
155and computational intelligence (Matlin, 1998; Ormrod,
1561999; Rubinstein & Firstenberg, 1995; Wang et al., 2006;
157Wang & Ruhe, 2007) as follows, inter alia:
158Direct facts finding a direct solution path based on
159known solutions.
2Y. Wang, V. Chiew / Cognitive Systems Research xxx (2008) xxx–xxx
COGSYS 281 No. of Pages 12, Model 5+
4 September 2008 Disk Used ARTICLE IN PRESS
Please cite this article in press as: Wang, Y., & Chiew, V., On the cognitive process of human problem solving, Cognitive Systems
Research (2008), doi:10.1016/j.cogsys.2008.08.003
UNCORRECTED PROOF
160 Heuristic adopting rule of thumb or the most possible
161 solutions.
162 Analogy reducing a new problem to an existing or
163 similar one for which solutions have already been
164 known.
165 Hill climbing making any move that approaches closer
166 to the problem goal step by step.
167 Algorithmic deduction applying a known and well
168 defined solution for a problem.
169 Exhaustive search using a systematic search for all pos-
170 sible solutions.
171 Divide-and-conquer solving a whole problem via
172 decomposing it into a set of subproblems.
173 Analysis and synthesis reducing a given problem to a
174 known category and then finding particular solutions.
175
176 Adoptions of the above approaches to problem solving
177 may not guarantee a problem goal to be reached, espe-
178 cially when a solution is not within the problem solver’s
179 solution space. There are a number of factors that may
180 hinder the process of problem solving (Matlin, 1998;
181 Smith, 1991) such as: (a) mental set in which a fixed or
182 improper method is adopted for a new problem while eas-
183 ier solutions could have been utilized; (b) meta-cognition
184 in which a problem solving process may require the sup-
185 port of other metacognitive processes to achieve the solu-
186 tion goal; and (c) lack of knowledge in which either the
187 problem or the goal could not be well represented or
188 modeled, and no method or solution could be applied
189 to the problem.
190 2.2. Cognitive characteristics of problem solvers
191 The typical psychological traits that may be of use and
192 of benefit to a successful problem solver are as follows:
193 To correctly identify problem goals, to be persistent, to
194 adopt efficient strategies in search, and to be able to trace
195 back to a certain previous point in the solution process.
196 In cognitive psychology, what differentiates an expert
197 from a novice problem solver is studied. It is observed
198 that not everyone possesses the same ability for problem
199 solving. These differences may provide insight to explain
200 the nature of problem solving. The most significant traits
201 between experts and novices in problem solving are iden-
202 tified as follows (Payne & Wenger, 1998; Polya, 1954;
203 Smith, 1991): scope of knowledge on accumulated infor-
204 mation, problem solving schemas, skills, expertise, mem-
205 ory capacity, problem representation ability, abstraction,
206 and categorization abilities, analysis, and synthesis skills,
207 long-term concentration ability, motivation, efficiency,
208 and accuracy.
209 It is interesting to contrast and analyze the differences
210 between professionals and amateurs in software engineer-
211 ing problem solving. Professional software engineers are
212 persons with professional cognitive models and knowledge
213 on software engineering. They are trained with: (a) funda-
214 mental knowledge that governs software and software engi-
215neering practices; (b) basic principles and laws of software
216engineering; (c) proven algorithms; (d) problem domain
217knowledge; (e) problem solving experience; (f) knowledge
218about program developing tools/ environments; (g) solid
219programming skills in multiple programming languages;
220and (h) aglobal and insightful view on system develop-
221ment, including its required functionalities as well as excep-
222tion handling and fault-tolerance strategies. However,
223amateurish programmers are persons who know only one
224or a couple of programming languages but lack formal
225training. They may be characterized as follows: (a) ad
226hoc structure of programming knowledge; (b) limited pro-
227gramming experience and skills; (c) eager to try what is
228directly required before a system architecture is designed;
229and (d) tend to focus on details without a global and sys-
230tematic view.
231In programming, Richard Mayer identified four aspects
232of knowledge required for solving programming problems
233known as the syntactic, semantic, schematic, and strategic
234knowledge (Mayer, 1992). He reported that there exist sig-
235nificant differences between the knowledge structures of
236experts and novices in all the four categories.
237It is noteworthy that unlike a machine, human abilities
238for problem solving do change depending on ages and
239external influences (Payne & Wenger, 1998). A senior per-
240son may have a broader knowledge base leading to better
241performance in problem solving. However, elderliness
242may reduce the efficiency in problem solving physiologi-
243cally and psychologically. In addition, personal motiva-
244tion, attitude, and external influences such as social
245pressure and environment inconvenience may hamper
246human problem solving efficiency and effectiveness (Wilson
247& Clark, 1988).
2482.3. LRMB: the context framework for problem solving
249It is noteworthy that the cognitive process of problem
250solving is not a trivial and isolated mental process rather
251than a complex and dynamic one interacting with almost
252all other cognitive processes at the meta-cognition, higher
253cognition, and lower layers according to the LRMB model
254as shown in Fig. 1 (Wang et al., 2006).
255A variety of life functions and their cognitive processes
256have been identified in cognitive informatics, cognitive neu-
257ropsychology, cognitive science, and neurophilosophy. In
258order to formally and rigorously describe a comprehensive
259and coherent set of mental processes and their relation-
260ships, the hierarchical LRMB model is established, which
261encompasses 39 cognitive processes at seven layers known
262as the sensation, memory, perception, action, meta-cogni-
263tive, meta-inference, and higher cognitive layers from the
264bottom up.
265LRMB reveals that the hierarchical life functions of the
266brain can be divided into two categories: the subconscious
267and conscious life functions. The former encompasses the
268layers of sensation, memory, perception, and action (Lay-
269ers 1–4). The latter includes the layers of meta-cognitive,
Y. Wang, V. Chiew / Cognitive Systems Research xxx (2008) xxx–xxx 3
COGSYS 281 No. of Pages 12, Model 5+
4 September 2008 Disk Used ARTICLE IN PRESS
Please cite this article in press as: Wang, Y., & Chiew, V., On the cognitive process of human problem solving, Cognitive Systems
Research (2008), doi:10.1016/j.cogsys.2008.08.003
UNCORRECTED PROOF
270 meta-inference, and higher cognitive functions (Layers 5–
271 7).
272 The subconscious layers of the brain are inherited, fixed,
273 and relatively mature when a person was born. Therefore,
274 the subconscious function layers are not directly controlled
275 by the conscious life function layers. This is why it is called
276 the unconscious life functions in some literature (Matlin,
277 1998; Payne & Wenger, 1998). However, the conscious lay-
278 ers of the brain are acquired, highly plastic, and can be con-
279 trolled intentionally based on willingness, goals, and
280 motivations.
281 LRMB provides a coherent framework to explain the
282 functional mechanisms and cognitive processes of the nat-
283 ural intelligence and human mind. According to LRMB,
284 the functioning of any higher-layer process is supported
285 by the lower layer processes from bottom up. For
286 instance, the problem solving process at the top layer
287 invokes lower layer processes’ support such as object
288 identification (Layer 5), abstraction (Layer 5), search
289 (Layer 5), memorization (Layer 5/2), and a number of
290 inference processes (Layer 6). It also interacts with pro-
291 cesses at the same layer such as comprehension, learning,
292 and decision making. Detailed discussions on the relation-
293 ships and interactions of the problem solving process with
294 other processes in the context of LRMB will be extended
295 in Section 4.3.
2962.4. Problem solving procedures
297Wallas (1926) and Polya (1954) proposed two sets of
298classical problem solving procedures. The former studied
299problem solving in a creativity context; while the latter pro-
300posed a generic empirical process of problem solving.
301Wallas’ creative problem solving procedure is known as
302follows (Wallas, 1926):
303(a) Preparation:defining the problem and gathering
304information relevant to its solution.
305(b) Incubation:thinking about the problem at a subcon-
306scious level while engaging in other activities.
307(c) Inspiration:having a sudden insight into the solution
308of the problem.
309(d) Verification:checking to be certain that the solution
310is correct.
311
312
Following Wallas’ work, an influential problem solving
313procedure was proposed by Polya as described below
314(Polya, 1954):
315(a) Understanding the problem:identifying the problem’s
316knowns (givens) and unknowns and, if appropriate,
317using suitable notation, such as mathematical symbols,
318to represent the problem.
319(b) Devising a plan:determining appropriate actions to
320take to solve the problem.
321(c) Carrying out the plan:executing the actions that have
322been determined to solve the problem and checking their
323effectiveness.
324(d) Looking backward:evaluating the overall effective-
325ness of the approach to the problem, with the intention
326of learning something about how similar problems may
327be solved on future occasions.
328
329
It is apparent that both Wallas and Polya derive their
330conceptual procedures for problem solving based on intro-
331spections and informal observations. However, mathemat-
332ical abstraction, symbolic reasoning, and formalism have
333not been introduced to rigorously model the cognitive pro-
334cess of problem solving in order to enable machine simula-
335tion of the human cognitive process. These important
336topics will be addressed in the following sections through-
337out this article.
3383. Cognitive informatics models of problem solving
339As reviewed in previous sections, the lack of suitable
340mathematical models and formal inference treatments has
341kept studies on problem solving at the empirical level based
342on observations and subjective interpretations. In this sec-
343tion, a rigorous study on problem solving as one of the fun-
344damental cognitive mechanisms of the brain is described.
345As a result, the mathematical model and process model
346of problem solving will be formally created on the basis
Conscious
life
functions
Subconscious
life
functions
Layer 7
Higher cognitive functi ons
Layer 5
Meta-cognitive functions
Level 3
Perception
Layer 4
Action
Level 2
Memory
Layer 1
Sensation
Layer 6
Meta-inference functions
Fig. 1. The layered reference model of the brain (LRMB).
4Y. Wang, V. Chiew / Cognitive Systems Research xxx (2008) xxx–xxx
COGSYS 281 No. of Pages 12, Model 5+
4 September 2008 Disk Used ARTICLE IN PRESS
Please cite this article in press as: Wang, Y., & Chiew, V., On the cognitive process of human problem solving, Cognitive Systems
Research (2008), doi:10.1016/j.cogsys.2008.08.003
UNCORRECTED PROOF
347 of empirical studies in cognitive psychology and computa-
348 tional intelligence.
349 3.1. The mathematical model of problem solving
350
351
352
353 Definition 1. A problem space, or solution space, His a
354 Cartesian product of a nonempty set of problem objects X,
355 a nonempty set of paths P,and a nonempty set of goals G,
356 i.e.:
H¼
^XPG ð1Þ
358358
359 where represents a Cartesian product.
360 Definition 2. Assuming the layout of a problem solving
361 process is a function f:X??Yon H,the problem q
362 is the domain of f,X, in general, and a specific instance
363 x,x2X, in particular, i.e.:
364
365
q¼
^ðXjf:X!  !YÞ;q2X ð2Þ
367367
368 Eq. (2) denotes that, in problem solving, a problem qis
369 the fix point of a denotational function in general, and the
370 input of the function in particular. The former represents
371 the broad sense of the problem, and the latter is the narrow
372 sense of the problem.
373 Problem solving is a process that seeks the generic func-
374 tion for a layout of problem, and determines its domain
375 and codomain. Then, a solution in problem solving can
376 be perceived as a concrete instance of the given function
377 for the layout of the problem.
378 Definition 3. Problem solving is a cognitive process of the
379 brain that searches or infers a solution for a given problem
380 in the form of a set of paths to reach a set of expected
381 goals.
382 Definition 4. A goal G in problem solving is the terminal
383 result Yof satisfactory in the solution space of the problem
384 q, which deduces Xto Yby a sequence of inference in finite
385 steps, i.e.:
386
387
388
G¼
^ðYjX!!YÞ;G2G ð3Þ
390390
391 Definition 5. Apath P in problem solving on His a 3-tuple
392 with a nonempty finite set of problem inputs X, a nonempty
393 finite set of traces T, and a nonempty finite set of goals G,
394 i.e.:
395
396
397
P¼
^ðX;T;GÞ¼XTGð4Þ
399399
400 where the a trace t 2Tis an internal node or subpath,
401 t:X
t
?Y
t
, that maps an intermediate subproblem X
t
to a
402 subgoal Y
t
.
403 According to Definitions 1–5, there are two categories of
404 problems in problem solving: (a) the convergent problem
405 where the goal of problem solving is given, but the path
406 of problem solving is unknown; and (b) the divergent prob-
407 lem where the goal of problem solving is unknown and the
408 path of problem solving are either known or unknown.
409The combination of the above cases in problem solving
410can be summarized in Table 1, which identifies four types
411of problem solving, i.e., proof, instance, case study, and
412explorative/creative problem solving. A special case in
413Table 1 is that when both the goal and path are known,
414the case is only a solved instance for a given problem. In
415a related work (Wang, 2008d), the cognitive process of cre-
416ation is recognized as a novel or unexpected but useful
417solution to a given problem. Therefore, a creation may
418be perceived as a special novel solution where the problem,
419goal, and/or path are usually unknown. With this view, the
420study of the generic theory of creativity can be reduced to
421the theory of problem solving.
422Definition 6. Asolution s to a given problem qon His an
423instance of a set of selected relation or function, S, which is
424a subset of the solution paths in P, i.e.:
425
S¼^ðX;T;GÞP;X;T;G6¼;
s2S
ð5Þ427427
428
According to Definition 6, in case #X=0, #G=0, or
429#T= 0, there is no solution for the given problem. For a
430convergent problem, i.e. #G1, the number of possible
431solutions is #X #T.This leads to the following theorem.
432Theorem 1. The polymorphic solution principle for problem
433solving states that the size of the solution space (SS, SS v
434H), N
SS
, of a given problem qis a product of the numbers of
435problem inputs N
x
, traces N
t
, and goals N
g
, i.e.:
436
NSS ¼
^NxNtNg¼#X#T#Gð6Þ438438
439
Theorem 1 provides a fundamental mathematical model
440for problem solving, which reveals that the factors deter-
441mining a solution to a given problem are the Cartesian
442space of all possible goals G, problem inputs X, and solu-
443tion paths Pof the problem.
444The polymorphic characteristic of the solution space
445contributes greatly to the complexity of problem solving.
446It is noteworthy that the path p(x,t,g)2Pin Definition
4475can be a simple or a complex function. A complex func-
448tion that mapping a given problem into a solution goal
449may be very complicated depending on the nature of the
450problem.
451Corollary 1. The divide-and-conquer principle for problem
452solving states that the efficiency gain or complexity reduction
Table 1
Classification of problems and problem solving methods
Type of
problem
Goal Path Type of solution
Convergent Known Unknown Proof (specific)
Known Known Instance (specific)
Divergent Unknown Known Case study (open-ended)
Unknown Unknown Explorative/creative (open-
ended)
Y. Wang, V. Chiew / Cognitive Systems Research xxx (2008) xxx–xxx 5
COGSYS 281 No. of Pages 12, Model 5+
4 September 2008 Disk Used ARTICLE IN PRESS
Please cite this article in press as: Wang, Y., & Chiew, V., On the cognitive process of human problem solving, Cognitive Systems
Research (2008), doi:10.1016/j.cogsys.2008.08.003
UNCORRECTED PROOF
453 for a given problem qis proportional to how many
454 subproblems, n, that qis partitioned, and/or how many path
455 segments, m, that the solution path P is partitioned, i.e.:
gq¼1n
nðn1Þ¼11
n1
gP¼1Pm
i¼1NPi
Qm
i¼1NPi
1mNP
ðNPÞm¼1m
ðNPÞm1
8
>
<
>
:
ð7Þ
457457
458 where NPis the average size or alternatives of all subpaths in
459 SS.
460 Corollary 1 provides a mathematical model that for-
461 mally explains the long-existing empirical heuristic princi-
462 ple of divide-and-conquer in problem solving for both
463 human and computing systems. According to Corollary
464 1, it can be expected that the greater the partitions, the
465 higher the efficiency gains in both ways. For instance, given
466 n¼3;m¼3 and NP¼5;the efficiency gains of qand P
467 partitions are g
q
=50% and g
P
= 88%, respectively. How-
468 ever, when n¼5;m¼5 and NP¼5;the efficiency gains
469 of qand Ppartitions are g
q
= 75% and g
P
= 99.2%,
470 respectively.
471 3.2. The cognitive process of problem solving
472 On the basis of the mathematical models of problem
473 solving as established in Section 3.1, the cognitive process
474 of problem solving can be derived logically in this subsec-
475 tion. In the problem solving process, the representation
476 of the problem is crucial. Problem representation includes
477 a description of the given situation, predefined operators
478 for changing the situation, and assessment criteria to deter-
479 mine whether the goal has been achieved. In most problems
480 of interest, the solution space can be too large to be
481 searched exhaustively, because it was noted in (Wang,
482 Liu, & Wang, 2003) that the maximum human memory
483 capacity is up to 10
8.432
bits in the brain. Typical
484 approaches to reduce search complexity in problem solv-
485 ing, according to Corollary 1, are to adopt divide-and-con-
486 quer and heuristic principles in order to simplify the
487 problem into subproblems and/or to reduce the paths into
488 a set of short ones.
489 On the basis of Definitions 1–6, a generic problem solv-
490 ing process is modeled as shown in Fig. 2, where the cogni-
491 tive process of problem solving can be divided into the
492 following five steps:
493 (a) To define the problem: This step describes the prob-
494 lem and its input layout Xby identifying its object O
X
495 and attributes A
X
, in a sub-OAR model (Wang, 2007c).
496 (b) To search the solution goals and paths: In this step,
497 the brain performs a parallel search for possible goals
498 Gand paths Tfor the solution. External memory and
499 resources may be searched if there is no available or suf-
500 ficient G or Tin the internal knowledge of the problem
501 solver.
502(c) To generate solutions according to Eq. (6): This step
503forms a set of possible solutions by a Cartesian product
504S=XTG.
505(d) To select suitable solutions: This step evaluates each
506possible solutions s2S=XTGas obtained in
507Step (c). Recursive searching actions may be executed
508if the obtained solution(s) could not satisfy the problem
509solver’s expectation.
510(e) To represent the problem solving result: This step
511incorporates and memorizes the solution(s), s2S,as
512the result of problem solving into the entire OAR model
513in the long-term memory of the problem solver. Before
514memorization, the solution Sis represented as a part
515of the relations, R, in the sub-OAR model.
516
517
It is noteworthy in Fig. 2 that a number of lower layer
518cognitive processes, as represented by double-ended boxes,
519are adopted to carry out the problem solving process.
520Based on the discussions in Section 2.3, the relationship
521among the problem solving process and other cognitive
522processes as modeled in LRMB will be discussed in Section
5234.3.
Search (Alternative
goals - G)
Representation
(OAR)
Begin
Identify
(
Object - O
X
)
Identify
(
Attributes - A
X
)
Search (Alternative
paths - T)
Evaluate
(Adequacy of T)
Sele ct ( Solu tio n - S )
S = X T G
Evaluate
(Satisfaction of S)
Memorize
(OAR)
End
Yes
No
Yes
Yes
No
Quantify (G) Quantify (T)
No
Evaluate
(Adequacy of G)
×
×
Fig. 2. The cognitive process of problem solving.
6Y. Wang, V. Chiew / Cognitive Systems Research xxx (2008) xxx–xxx
COGSYS 281 No. of Pages 12, Model 5+
4 September 2008 Disk Used ARTICLE IN PRESS
Please cite this article in press as: Wang, Y., & Chiew, V., On the cognitive process of human problem solving, Cognitive Systems
Research (2008), doi:10.1016/j.cogsys.2008.08.003
UNCORRECTED PROOF
524 The impact of individual’s knowledge on the outcomes
525 and efficiencies of problem solving has been recognized in
526 cognitive informatics and psychology. It is often true that
527 a problem to somebody is not one to others; and a hard
528 problem to somebody is not so tough at all to others. These
529 phenomena may be explained empirically by the difference
530 of expertise, knowledge, and problem solving skills. They
531 can be more rigorously explained by the differences of indi-
532 vidual’s solution space SS as given in Theorem 1 and Cor-
533 ollary 1. That is, although a problem as given is the same to
534 everybody, the solution spaces to the problem may be
535 greatly different due to the differences of each problem sol-
536 ver’s knowledge, experience, skills, and strategies in prob-
537 lem solving.
538 4. Formal description of the cognitive process of problem
539 solving in denotational mathematics
540 Before the formal description of problem solving is pre-
541 sented, the structures of denotational mathematics (Wang,
542 2007a, 2007d, 2008a), particularly RTPA (Wang, 2002a,
543 2003b, 2008c) and concept algebra (Wang, 2008b), are
544 introduced in this section.
545 Definition 7. Denotational mathematics is a category of
546 expressive mathematical structures that deals with high-
547 level complex mathematical entities beyond numbers and
548 sets, such as abstract objects, complex relations, behavioral
549 information, concepts, knowledge, processes, and systems.
550 4.1. Formal modeling of human behaviors using RTPA
551
552 Definition 8. RTPA is a denotational mathematical struc-
553 ture for algebraically denoting and manipulating system
554 and human behavioral processes and their attributes by a
555 triple, i.e.:
556
RTPA ¼
^ðT;P;NÞð8Þ
558558
559 where Tis a set of 17 primitive types for modeling system
560 architectures and data objects, Pa set of 17 meta-processes
561 for modeling fundamental system behaviors, and Ra set of
562 17 relational process operations for constructing complex
563 system behaviors.
564 Definition 9. The RTPA type system Tencompasses 17
565 primitive types elicited from fundamental computing
566 needs, i.e.:
567
ð9Þ
569569
570 where all types in Thave been defined in Wang (2007a).
571 Ameta-process in RTPA is a primitive computational
572 operation that cannot be broken down to further individ-
573 ual actions or behaviors. A meta-process serves as a basic
574 building block for modeling software behaviors. Complex
575processes can be composed from meta- processes using pro-
576cess relational operations.
577Definition 10. The RTPA meta-process system Pencom-
578passes 17 fundamental computational operations elicited
579from the most basic computing needs, i.e.:
580
581
582
ð10Þ
584584
585
where the 17 meta-processes stand for assignment, evalua-
586tion, addressing, memory allocation, memory release, read.
587write, input, output, timing, duration, increase, decrease,
588exception detection, skip, stop, and system, respectively.
589Aprocess relation in RTPA is an algebraic operation
590and a compositional rule between two or more meta-pro-
591cesses in order to construct a complex process, which is
592elicited from fundamental algebraic and relational opera-
593tions in computing in order to build and compose complex
594processes in the context of real-time software behaviors.
595Definition 11. The RTPA process relation system Rencom-
596passes 17 fundamental algebraic and relational operations
597elicited from basic computing needs, i.e.:
598
ð11Þ
600600
601
where the 17 relational operators of RTPA stand for se-
602quence, jump, branch, while-loop, repeat-loop, for-loop,
603recursion, function call, parallel, concurrence, interleave,
604
pipeline, interrupt, time-driven dispatch, event-driven dis-
605patch,and interrupt-driven dispatch, respectively.
606RTPA provides a coherent notation system and a for-
607mal engineering methodology for modeling both software
608and intelligent systems. RTPA can be used to describe both
609logical and physical models of systems, where logic views of
610the architecture of a software system and its operational
611platform can be described using the same set of notations.
612
When the system architecture is formally modeled, the sta-
613tic and dynamic behaviors that perform on the system
614architectural model, can be specified by a three-level refine-
615ment scheme at the system, class, and object levels in a top-
616down approach. Detailed syntaxes and formal semantics of
617RTPA meta-processes and process relations may be
618referred to Wang (2002a, 2007a, 2008c).
619
4.2. Formal treatment of internal knowledge in problem
620solving by concept algebra
621Aconcept is a cognitive unit to identify and/or model a
622concrete entity in the real-world and an abstract object in
623the perceived-world. Before an abstract concept is defined,
624the semantic environment or context of concepts is intro-
625duced below.
Y. Wang, V. Chiew / Cognitive Systems Research xxx (2008) xxx–xxx 7
COGSYS 281 No. of Pages 12, Model 5+
4 September 2008 Disk Used ARTICLE IN PRESS
Please cite this article in press as: Wang, Y., & Chiew, V., On the cognitive process of human problem solving, Cognitive Systems
Research (2008), doi:10.1016/j.cogsys.2008.08.003
UNCORRECTED PROOF
626 Definition 12. Let Obe a finite nonempty set of objects,
627 and Abe a finite nonempty set of attributes, then a semantic
628 environment or context Hof all concepts in the discourse is
629 denoted as a triple, i.e.:
630
H¼^ðO;A;
¼R:O ! OjO ! AjA ! OjA ! A ð12Þ
632632
633 where Ris a set of relations between Oand A,as well as
634 their reflective relations, and jdenotes alternative relations.
635 Concepts in denotational mathematics are an abstract
636 structure that carries certain meaning in almost all cogni-
637 tive processes such as problem solving, learning, and
638 reasoning.
639 Definition 13. An abstract concept c on His a 5-tuple, i.e.:
640
c¼
^ðO;A;Rc;Ri;RoÞð13Þ
642642
643 where
644 Ois a nonempty set of objects of the concept,
645 O¼fo1;o2;...;omg·O,where ·Odenotes a power
646 set of O.
647 Ais a nonempty set of attributes, A¼fa1;a2;...;
648 ang·A.
649 R
c
=OAis a set of internal relations.
650 R
i
A0A,A0vC0^Avc, is a set of input relations,
651 where C0is a set of external concepts, C0H.For con-
652 venience, R
i
=A0Amay be simply denoted as
653 R
i
=C0c.
654 R
o
cC0is a set of output relations.
655 Concept algebra is an abstract mathematical structure
656 for the formal treatment of concepts and their algebraic
657 relations, operations, and associative rules for composing
658 complex concepts.
659 Definition 14. Aconcept algebra CA on a given semantic
660 environment His a triple, i.e.:
661
CA ¼
^ðC;OP ;HÞ¼ðfO;A;Rc;Ri;Rog;fr;cg;HÞð14Þ
663663
664 where OP ={
r
,
c
} are the sets of relational and composi-
665 tional operations on abstract concepts.
666 Definition 15. The relational operations
r
in concept
667 algebra encompass eight comparative operators for manip-
668 ulating the algebraic relations between concepts, i.e.:
669
670
671
r¼
^f$;&;;;¼;;;,15Þ
673673
674 where the relational operators stand for related, indepen-
675 dent, subconcept, superconcept, equivalent, consistent, com-
676 parison,and definition, respectively.
677 Definition 16. The compositional operations
c
in concept
678 algebra encompass nine associative operators for manipu-
679 lating the algebraic compositions among concepts, i.e.:
680
c¼
^f);)
;)
þ;)
;];w;t;;7!g ð16Þ
682682
683
where the compositional operators stand for inheritance,
684tailoring, extension, substitute, composition, decomposition,
685aggregation, specification,and instantiation, respectively.
686Detailed descriptions of the relational and composi-
687tional operations of concept algebra may be referred to
688(Wang, 2008b). Concept algebra provides a powerful deno-
689tational mathematical means for algebraic manipulations
690of abstract concepts. Concept algebra can be used to
691model, specify, and manipulate generic ‘‘to betype prob-
692lems, particularly system architectures, knowledge bases,
693and detail-level system designs, in cognitive informatics,
694computing, software engineering, computational intelli-
695gence, and system engineering.
6964.3. The formal model of the cognitive process of problem
697solving
698Based on RTPA and concept algebra, the cognitive pro-
699cess of problem solving as elaborated in Fig. 2 can be for-
700mally described as presented in Fig. 3. According to the
701OAR model (Wang, 2008c) of internal knowledge repre-
702sentation in the brain, the result of a solution produced
703in problem solving in the mind of a problem solver is a
704new sub-OAR model, which will be used to update the
705entire OAR model of knowledge by concept composition
706(Wang, 2008b) in the long-term memory of the problem
707solver.
708The center in the formal model of the problem solving
709process is that knowledge about the problem and its solu-
710tion(s) are represented internally in the brain as an OAR
711model as shown in Fig. 4, where the external world is rep-
712resented by real entities (RE), and the internal world by vir-
713tual entities (VE) and objects (O). The internal world can be
714divided into two layers: the image layer and the abstract
715layer.
716The virtual entities are direct images of the external
717real-entities located at the image layer. The objects are
718abstract artifacts located at the abstract layer. The
719abstract layer is an advanced property of human brains.
720It is noteworthy that animal species have no such abstract
721layer in their brains. Therefore, they have no indirect or
722abstract thinking capability (Wang, 2007b). In other
723words, abstract thinking is a unique power of the human
724brain known as the qualitative advantage of human
725brains. The other advantage of the human brain is the tre-
726mendous capacity of long-term memory in the cerebral
727cortex known as the quantitative advantages. On the basis
728of these two principal advantages, mankind gains the
729power as human beings.
730There are meta-objects (O) and derived objects (O0) at the
731abstract layer in the OAR model. The former are concrete
732objects directly corresponding to the virtual entities and
733then to the external world. The latter are abstracted objects
734that are derived internally and have no direct connection
735with the virtual entities or images of the real-entities such
736as abstract concepts, notions, ideas, and states of feelings.
737The objects on the brain’s abstract layer can be further
8Y. Wang, V. Chiew / Cognitive Systems Research xxx (2008) xxx–xxx
COGSYS 281 No. of Pages 12, Model 5+
4 September 2008 Disk Used ARTICLE IN PRESS
Please cite this article in press as: Wang, Y., & Chiew, V., On the cognitive process of human problem solving, Cognitive Systems
Research (2008), doi:10.1016/j.cogsys.2008.08.003
UNCORRECTED PROOF
738 extended into a network of objects, attributes, and rela-
739 tions according to the OAR model as shown in Fig. 4.In
740 Fig. 4, the connections between objects/attributes (O/A)
741 via relations are partially connected. In other words, it is
742 not necessary to find a relation among all pairs of objects
743 or attributes.
744 The OAR model can be used to describe the dynamic
745 state changes of the problem solver during the problem
746 solving process. The problem solving process is essentially
747a set of representation and search operations. According to
748the OAR model, a problem can be represented as an object
749OS.The problem object is identified once it has been com-
750prehended as the problem of interest XðOS;AST;RSTÞST.
751The problem object XST is a structure as a part of the
752entire OARST model of the problem solver’s knowledge
753base or the solution space.
754All meta-objects, attributes, and relations within the
755OARST solution space will be exhaustively searched.
Fig. 3. Formal description of the cognitive process of problem solving in RTPA.
Y. Wang, V. Chiew / Cognitive Systems Research xxx (2008) xxx–xxx 9
COGSYS 281 No. of Pages 12, Model 5+
4 September 2008 Disk Used ARTICLE IN PRESS
Please cite this article in press as: Wang, Y., & Chiew, V., On the cognitive process of human problem solving, Cognitive Systems
Research (2008), doi:10.1016/j.cogsys.2008.08.003
UNCORRECTED PROOF
756 Upon satisfactory of a parallel search on GSand TST,a
757 set of solutions (SXS;TST;GSTÞST will be generated
758 and represented, which is memorized by using the concept
759 composition operations ]in order to update the solutions
760 to the given problem (Wang, 2008b).
761The relationships and interactions between the problem
762solving process and other cognitive processes can be
763explained according to the LRMB model as illustrated in
764Fig. 5. As a top layer process of the conscious life functions
765
of the brain in LRMB, the problem solving process inter-
The internal world
Real Entities
RE
1
Virtual Entities
Real Entities
Os/As
Relations
Os/As
Virtual Entities
The external world
The external world
The Image L ayer
The Image Layer
The Abstract Layer
Derived
objects
Meta
objects
O
1
VE
1
VE
1
O
1
RE
1
O
p
O
’1
O’
2
O’
m
O
2
VE
n
VE
2
VE
n
VE
2
RE
n
RE
2
RE
2
RE
n
O’
1
O
2
O’
2
O’
m
O
n
Other
internal
relations
The concrete
space
The abstract
space
Fig. 4. The extended OAR model of the brain.
L7 –
Higher
cognition
L5 –
Meta-cognition
L2 –
Memory
L1 –
Sensation
L6 –
Meta-inference
L4 – L3 –
Perception Action
L
R
M
B
Problem
Solving
Learning Decission mak ing
SBM STM LTM ABM CPM
Deduction Anal
y
sis S
y
nthesis
Identif
y
Ob
j
Abstraction Search Memoriz
e
Vision Audition Smell Tactilit
y
Tast
e
Attention Emotions
Fig. 5. Interaction between problem solving and other cognitive processes in LRMB.
10 Y. Wang, V. Chiew / Cognitive Systems Research xxx (2008) xxx–xxx
COGSYS 281 No. of Pages 12, Model 5+
4 September 2008 Disk Used ARTICLE IN PRESS
Please cite this article in press as: Wang, Y., & Chiew, V., On the cognitive process of human problem solving, Cognitive Systems
Research (2008), doi:10.1016/j.cogsys.2008.08.003
UNCORRECTED PROOF
766 acts with other higher cognitive processes at layer 7, such as
767 the learning and comprehension processes, It also involves
768 lower layer processes such as those of abstraction, search,
769 and memorization.
770 According to the cognitive model of the brain (Wang,
771 2007b), the thinking engine of the brain may be referred
772 to as a real-time natural intelligence system (NI-Sys). In
773 NI-Sys, the pre-determined operating system is defined as
774 the natural intelligence operating system (NI-OS) and a
775 set of acquired life applications is known as the natural
776 intelligence applications (NI-App). Subsequently, the
777 human memory has been classified into both short-term
778 memory (STM) and long-term memory (LTM). Since
779 problem solving is an acquired life function, it is classified
780 as a part of NI-App. However, the problem solving process
781 dynamically invokes the support of lower layer processes in
782 NI-OS, as well as STM and LTM, where the acquired
783 knowledge about the solution of a given problem is repre-
784 sented and retained in the logical form of an OAR model.
785 5. Conclusions
786 This paper has presented a generic and formal model of
787 the fundamental cognitive process of problem solving on
788 the basis the layered reference model of the brain (LRMB)
789 and the object–attribute-relation (OAR) model. With the
790 exploration of empirical studies on problem solving in cog-
791 nitive psychology and computational intelligence, a set of
792 formal and rigorous cognitive, mathematical, and process
793 models of problem solving as a cognitive process has been
794 developed. The cognitive structures of the brain and the
795 mechanisms of internal knowledge representation behind
796 the cognitive process of problem solving have been
797 explained. In order to facilitate computer simulations in
798 cognitive informatics and computational intelligence, the
799 denotational mathematical structures of real-time process
800 algebra (RTPA) and concept algebra have been intro-
801 duced, which provide a powerful tool to formally model
802 and manipulate human and system architectures and
803 behaviors in rigorous approaches.
804 Future research direction related to this work will be on
805 the modeling and explanation of the rest of the remaining
806 cognitive processes of LRMB using denotational mathe-
807 matics and formal means in hope to better understand
808 how the brain works as a whole. The entire project will lead
809 to the development of future generation cognitive comput-
810 ers and methodologies for cognitive computing that are
811 capable of think, learn, and perceive.
812 6. Uncited reference
813 Wang (in press).Q1
814 Acknowledgements
815 This work is partially sponsored by Natural Sciences
816 and Engineering Research Council of Canada (NSERC).
817The authors would like to thank Prof. Ning Zhong, Jiming
818Liu, Yiyu Yao, and the anonymous reviewers for their
819valuable suggestions and comments that have greatly im-
820proved the quality of the final version of this article.
821References
822
Bender, E. A. (1996). Mathematical methods in artificial intelligence. Los
823
Alamitos, CA, USA: IEEE CS Press.
824
Beveridge, W. I. (1957). The art of scientific investigation. UK: Random
825
House Trade Paperbacks.
826
Goldstein, I. (1978). Developing a computational representation for
827
problem solving skills, AI memo 495. Cambridge, MA, USA: MIT.
828
Matlin, M. W. (1998). Cognition (4th ed.). NY, USA: Harcourt Brace
829
College Publishers.
830
Mayer, R. E. (1992). Thinking, problem solving, cognition (2nd ed.). W.H.
831
Freeman and Co..
832
Newell, A., & Simon, H. A. (1972). Human problem solving. Prentice-Hall.
833
Ormrod, J. E. (1999). Human learning (3rd ed.). Prentice-Hall Inc..
834
Payne, D. G., & Wenger, M. J. (1998). Cognitive psychology. Boston, NY,
835
USA: Houghton Mifflin Company.
836
Polya, G. (1954). Patterns of plausible inference. Princeton, NJ, USA:
837
Princeton University Press.
838
Robertson, I. (2001). Problem solving. Psychology Press.
839
Rubinstein, M. F., & Firstenberg, I. R. (1995). Patterns of problem
840
solving. Englewood, NJ, USA: Prentice Hall.
841
Smith, M. U. (1991). Toward a unified theory of problem solving: Views
842
from the content domains. Hillsdale, NJ, USA: Lawrence Erlbaum
843
Associates.
844
Tuma, D. T., & Reif, F. (1980). Problem solving and education. Hillsdale,
845
NJ, USA: Lawrence Erlbaum Associates.
846
Wallas, G. (1926). The art of thought. NY, USA: Harcourt Brace.
847
Wang, Y. (2002a). The real-time process algebra (RTPA). Annals of
848
Software Engineering: An International Journal, 14, 235–274.
849
Wang, Y. (2002b). Keynote, on cognitive informatics.Proceedings of the 1st
850
IEEE international conference on cognitive informatics (ICCI’02).
851
Calgary, Canada: IEEE CS Press (pp. 34–42).
852
Wang, Y. (2003a). On cognitive informatics. Brain and Mind: A
853
Transdisciplinary Journal of Neuroscience and Neurophilosophy, 4(2),
854
151–167.
855
Wang, Y. (2003b). Using process algebra to describe human and software
856
behaviors. Brain and Mind: A Transdisciplinary Journal of Neurosci-
857
ence and Neurophilosophy, 4(2), 199–213.
858
Wang, Y. (2007a). Software engineering foundations: A software science
859
perspective. CRC series in software engineering (Vol. II). NY, USA:
860
Auerbach Publications.
861
Wang, Y. (2007b). The theoretical framework of cognitive informatics.
862
International Journal of Cognitive Informatics and Natural Intelligence,
863
1(1), 1–27.
864
Wang, Y. (2007c). The OAR model of neural informatics for internal
865
knowledge representation in the brain. International Journal of
866
Cognitive Informatics and Natural Intelligence, 1(3), 64–75.
867
Wang, Y. (2007d). Keynote, on theoretical foundations of software
868
engineering and denotational mathematics. In Proceedings of the 5th
869
Asian workshop on foundations of software (pp. 99–102), Xiamen,
870
China.
871
Wang, Y. (2007e). The theoretical framework and cognitive process of
872
learning.Proceedings of the 6th international conference on cognitive
873
informatics (ICCI’07). Lake Tahoe, CA: IEEE CS Press (pp. 470–479).
874
Wang, Y. (2008a). On contemporary denotational mathematics for com-
875
putational intelligence. Transactions of Computational Science, 2, 6–29.
876
Wang, Y. (2008b). On concept algebra: A denotational mathematical
877
structure for knowledge and software modeling. The International
878
Journal of Cognitive Informatics and Natural Intelligence, 2(2), 1–19.
879
Wang, Y. (2008c). RTPA: A denotational mathematics for manipulating
880
intelligent and computational behaviors. International Journal of
881
Cognitive Informatics and Natural Intelligence Q3
.
Y. Wang, V. Chiew / Cognitive Systems Research xxx (2008) xxx–xxx 11
COGSYS 281 No. of Pages 12, Model 5+
4 September 2008 Disk Used ARTICLE IN PRESS
Please cite this article in press as: Wang, Y., & Chiew, V. (2008c), On the cognitive process of human problem solving, Cognitive
Systems Research (2008), doi:10.1016/j.cogsys.2008.08.003
UNCORRECTED PROOF
882 Wang, Y. (2008d). On cognitive foundations of creativity and the cognitive
883 process of creation.Proceedings of the 7th IEEE international confer-
884 ence on cognitive informatics (ICCI’08). Stanford University, CA,
885 USA: IEEE CS Press (pp. 104–113).
886 Wang, Y. (in press). On abstract intelligence: Toward a unified theory of
887 natural, artificial, machinable, and computational intelligence. Inter-
888 national Journal of Software Science and Computational Intelligence,
889 1(1), 1–18
Q4 .
890 Wang, Y., Liu, D., & Wang, Y. (2003). Discovering the capacity of human
891 memory. Brain and Mind: A Transdisciplinary Journal of Neuroscience
892 and Neurophilosophy, 4(2), 189–198.
893 Wang, Y., & Ruhe, G. (2007). The cognitive process of decision making.
894 International Journal of Cognitive Informatics and Natural Intelligence,
895 1(2), 73–85.
896
Wang, Y., Wang, Y., Patel, S., & Patel, D. (2006). A layered reference
897
model of the brain (LRMB). IEEE Transactions on Systems, Man, and
898
Cybernetics (C), 36(2), 124–133.
899
Wilson, L. B., & Clark, R. G. (1988). Comparative programming language.
900
Wokingham, UK: Addison-Wesley Publishing Co..
901
Zadeh, L. A. (2008a). Toward human level machine intelligence – Is it
902
achievable? The need for a paradigm shift. IEEE Computational
903
Intelligence Magazine Q5
, 11–22.
904
Zadeh, L. A. (2008b). Is there a need for fuzzy logic? Information Sciences:
905
An International Journal, 178, 2751–2779.
906
Zhong, N. (2006). Impending brain informatics research from web
907
intelligence perspective. International Journal of Information Technol-
908
ogy and Decision Making, 5(4), 713–728.
909
12 Y. Wang, V. Chiew / Cognitive Systems Research xxx (2008) xxx–xxx
COGSYS 281 No. of Pages 12, Model 5+
4 September 2008 Disk Used ARTICLE IN PRESS
Please cite this article in press as: Wang, Y., & Chiew, V., On the cognitive process of human problem solving, Cognitive Systems
Research (2008), doi:10.1016/j.cogsys.2008.08.003
... This approach only trains the LLM to memorize knowledge about task-specific solutions, and fails to capture the high-level abstract meta-knowledge necessary for generalization across similar problems. As a con- To tackle this challenge, we draw insights from cognitive science (Wang & Chiew, 2010;Radüntz, 2020): humans simplify complex problems through high-level abstraction before engaging with details (Ross, 2009). Such abstraction not only lightens the cognitive load but also distills highlevel meta-knowledge that is transferable to analogous problems. ...
... Consequently, when generating detailed problem solutions, the LLM is conscious of what to do at the current step, and successfully solves the problem. Research in cognitive science (Wang & Chiew, 2010;Radüntz, 2020) supports the notion that such a structured approach significantly eases cognitive load and improves learning efficiency. ...
Preprint
In the field of large language model (LLM) post-training, the effectiveness of utilizing synthetic data generated by the LLM itself has been well-presented. However, a key question remains unaddressed: what essential information should such self-generated data encapsulate? Existing approaches only produce step-by-step problem solutions, and fail to capture the abstract meta-knowledge necessary for generalization across similar problems. Drawing insights from cognitive science, where humans employ high-level abstraction to simplify complex problems before delving into specifics, we introduce a novel self-training algorithm: LEarning to Plan before Answering (LEPA). LEPA trains the LLM to formulate anticipatory plans, which serve as abstract meta-knowledge for problem-solving, before engaging with the intricacies of problems. This approach not only outlines the solution generation path but also shields the LLM from the distraction of irrelevant details. During data generation, LEPA first crafts an anticipatory plan based on the problem, and then generates a solution that aligns with both the plan and the problem. LEPA refines the plan through self-reflection, aiming to acquire plans that are instrumental in yielding correct solutions. During model optimization, the LLM is trained to predict both the refined plans and the corresponding solutions. By efficiently extracting and utilizing the anticipatory plans, LEPA demonstrates remarkable superiority over conventional algorithms on various challenging natural language reasoning benchmarks.
... Sintaks Guo et al., 2023). Wang dan chiew mengusulkan bahwa suatu masalah terdiri dari tiga komponen yang dikenal sebagai hal-hal yang diberikan, tujuan, dan operasi (Wang & Chiew, 2010). (1) Hal-hal yang diberikan adalah informasi yang tersedia sebagai bagian dari masalah. ...
... Solusi untuk masalah tertentu mungkin tidak ada dalam ruang solusi pemecah masalah saat ini. Hal ini dapat disebabkan oleh banyak faktor, seperti masalah tersebut mungkin tidak terdefinisi dengan baik, tujuan yang diharapkan ambigu, dan/atau tidak ada metode (jalur) yang tersedia yang menghubungkan objek masalah yang diberikan dengan tujuan (Wang & Chiew, 2010). ...
Book
Full-text available
Pemahaman terhadap berbagai teori belajar merupakan fondasi utama bagi seorang pendidik untuk merancang, melaksanakan, dan mengevaluasi proses pembelajaran secara efektif dan bermakna. Tidak hanya itu, pemahaman mendalam mengenai prinsip-prinsip belajar juga membantu pendidik dalam menyesuaikan pendekatan dengan karakteristik peserta didik yang beragam. Isi buku ini mengulas secara sistematis berbagai pendekatan dan teori belajar, mulai dari behavioristik, kognitivistik, konstruktivistik, hingga pendekatan humanistik dan sosiokultural. Selain itu, buku ini juga membahas relevansi teori-teori tersebut dalam merancang strategi pembelajaran yang inovatif dan kontekstual, sesuai dengan kebutuhan pendidikan abad ke-21. Penulis menyusun buku ini dengan harapan agar dapat menjadi referensi bagi mahasiswa, guru, dosen, dan semua pihak yang tertarik pada bidang pendidikan, baik dalam konteks akademik maupun praktis. Semoga buku ini tidak hanya memperkaya pengetahuan, tetapi juga menginspirasi pembaca untuk terus belajar dan mengembangkan praktik pembelajaran yang lebih efektif dan berpusat pada peserta didik.
... Another relevant cognitive process is issueselling -the notion that individuals affect others' attention to and understanding of the events, developments, and trends that affect organizational performance (Dutton & Ashford, 1993). Further, problem-solving -a process at the higher cognitive layer that searches for solutions or finds a path to reach a given goal -is a key cognitive process (Wang & Chiew, 2010). ...
Thesis
While information systems (IS) projects are pivotal in guiding organizational strategies and sustaining competitive advantages, they frequently overrun budgets, extend beyond timelines, and experience high failure rates. This dissertation delves into the psychological micro-foundations of human behavior – specifically cognition and emotion – in relation to a prevalent issue in IS project management: the tendency to persist with failing courses of action, also called escalation of commitment (EoC). Through a mixed-methods research approach, this study investigates the emotional and cognitive bases of decision-making during IS project escalation and its evolution over time. The results of a psychophysiological laboratory experiment provide evidence for the predictions on the role of negative and complex situational integral emotions of Cognitive Dissonance over Coping Theory and add to a better understanding of how escalation tendencies change during sequential decision- making due to cognitive learning effects. Using psychophysiological measures, including data triangulation between electrodermal and cardiovascular activity and AI-based analysis of facial micro-expressions, this research reveals physiological markers of behavioral escalation tendencies. Complementing the experiment, a qualitative analysis using free-form narration during decision-making simulations shows that decision-makers employ varied cognitive reasoning patterns to justify escalating behaviors, suggesting a sequence of four distinct cognitive phases. By integrating both qualitative and quantitative findings, this dissertation offers a comprehensive theoretical framework of how cognition and emotion shape behavioral EoC over time. I propose that escalation is a cyclical adaptation of mental models, distinguished by shifts in cognitive reasoning patterns, temporal cognition mode variations, and interactions with situational emotions and their anticipation. The primary contribution of this dissertation lies in disentangling the emotional and cognitive mechanisms that drive IS project escalation. The findings provide the basis for developing de-escalation strategies, thereby helping to improve decision-making under uncertainty. Stakeholders involved in IS projects that get “off track” should be aware of the tendency to persist with failing courses of action and the importance of the underlying emotional and cognitive dynamics.
... This metric considers how problem solving involves navigating a problem space using operators that transform the current state into a solution, emphasizing the importance of selecting appropriate spaces and operators (Newell & Simon, 1972). The orchestration of fundamental cognitive processes, such as abstraction, searching, heuristics and analogy, is considered crucial for performing problem solving as a higher-layer cognitive process (Wang & Chiew, 2010). This study emphasizes how effectively problem-solving strategies are tailored by simulated students to meet task-specific requirements and how they enhance both logic and efficiency. ...
Article
Full-text available
In the field of education, the think‐aloud protocol is commonly used to encourage learners to articulate their thoughts during the learning process, providing observers with valuable insights into learners' cognitive processes beyond the final learning outcomes. However, the implementation of think‐aloud protocols faces challenges such as task interference and limitations in completeness and authenticity of verbal reports. This study proposes a method called Cognitive Echo, which leverages large language models (LLMs) trained with simulated student experiences to enhance the completeness and authenticity of think‐aloud verbalizations. LLMs have been demonstrated to simulate human‐like behaviour more effectively by memorizing experiences. In this work, we introduce specific learner roles and train the LLMs to act as distinct learners. Our method involves integrating transaction data from learners' interactions with a tutoring system and the tutor's content to create interactive experiences between learners and teachers, thereby training the model to become simulated students with learning experiences. To investigate the effectiveness of this approach, we designed a test playground based on the retrospective think‐aloud protocol and examined how LLM‐trained simulated students improve cognitive process transparency and generalization of learning strategies. The study found that Cognitive Echo not only reveals what simulated students genuinely think about their learning experiences but also enables them to transfer their different cognitive strategies to new tasks. By training simulated students on real learning behaviour data to ensure their cognitive processes reflect authentic learner experiences, this approach will extend think‐aloud protocols to more practice‐oriented applications. Practitioner notes What is already known about this topic Think‐aloud protocols are widely used in educational settings to explore students' cognitive processes by asking them to verbalize their thoughts while solving problems, but they are prone to issues like task interference and incomplete data reporting. Existed applications of simulating student cognition in educational research are rigid and less adaptive to individual learner characteristics. Artificial intelligences, especially large language models, have shown promise in educational contexts, particularly for simulating human‐like behaviours. What this paper adds This paper introduces the concept of Cognitive Echo, a method that integrates LLM‐powered simulated students into think‐aloud protocols, which addresses the limitations of traditional verbalization‐based methods by leveraging retrospective data. The study shows that LLMs, when fine‐tuned with authentic learner experiences, can replicate distinct human‐like cognitive processes, enabling a more complete and authentic simulation of how students think and solve problems. It demonstrates how the use of LLMs to simulate students' cognitive processes can enhance the transparency and completeness of think‐aloud protocols by allowing researchers to capture cognitive strategies and behaviours that would otherwise go unspoken. Implications for practice and/or policy Teacher training programmes can benefit from integrating LLM‐based simulated students, which enable preservice teachers to practice responding to a wide range of cognitive processes and challenges without the constraints of real‐time think‐aloud tasks. The Cognitive Echo method, by offering a more authentic and less intrusive way of capturing student cognition, can be applied in teacher training scenarios where simulation of real‐world classroom dynamics is crucial for developing pedagogical skills. The use of Cognitive Echo could help in the creation of digital twins of educational scenarios, facilitating research into complex educational issues (eg, bullying and learning disabilities) through simulations that model real‐world interactions.
... Ideation is a common cognitive activity during the conceptual design phase, which generates propositions by which challenges could be overcome for the problem. The cognitive process of problem-solving involves the stages of searching, learning, synthesis, analysis, and inference (Goel and Pirolli, 1992;Wang and Chiew, 2010). During recursive ideation, the corresponding stages are referred to as exploration (searching), inspiration (learning), generation (synthesis), elaboration (analysis), and evaluation (inference). ...
Article
Full-text available
This article presents a novel conversational artificial intelligence (CAI)-enabled active ideation system as a creative idea generation tool to assist novice product designers in mitigating the initial latency and ideation bottlenecks that are commonly observed. It is a dynamic, interactive, and contextually responsive approach, actively involving a large language model (LLM) from the domain of natural language processing (NLP) in artificial intelligence (AI) to produce multiple statements of potential ideas for different design problems. Integrating such AI models with ideation creates what we refer to as an active ideation scenario , which helps foster continuous dialog-based interaction, context-sensitive conversation, and prolific idea generation. An empirical study was conducted with 30 novice product designers to generate multiple ideas for given problems using traditional methods and the new CAI-based interface. The ideas generated by both methods were qualitatively evaluated by a panel of experts. The findings demonstrated the relative superiority of the proposed tool for generating prolific, meaningful, novel, and diverse ideas. The interface was enhanced by incorporating a prompt-engineered structured dialog style for each ideation stage to make it uniform and more convenient for the product designers. A pilot study was conducted and the resulting responses of such a structured CAI interface were found to be more succinct and aligned toward the subsequent design stage. The article thus established the rich potential of using generative AI (Gen-AI) for the early ill-structured phase of the creative product design process.
Article
Problem-solving strategies are crucial in learning programming. Owing to their hidden nature, traditional methods such as interviews and questionnaires cannot reflect the details and differences of problem-solving strategies in programming. This study uses the Hidden Markov Model to detect and compare the problem-solving strategies of different groups in an interactive programming environment. The results suggest that high- and low-performance students have significant differences in their problem-solving strategies in programming. High-performance students had more “blank behaviors” in programming than low-performance students in video recordings. Low-performance students spent more time “searching teaching materials” than high-performance students. In the transfer task, high-performance students began the task by “identifying the problem,” while low-performance students were involved in the “implementing of strategies.” Additionally, high- and low-performance students improved from basic to transfer tasks. These findings shed light on why students performed differently in programming and how and when teachers needed to provide instructions to students in programming education.
Article
Purpose Seekers who visit professional virtual communities (PVCs) are usually motivated by knowledge-seeking, which is a complex cognitive process. How do seekers search for knowledge, and how is their search linked to prior knowledge or PVC situation factors? From the cognitive process and interactional psychology perspectives, this study investigated the three-way interactions between seekers’ expertise, task complexity, and perceptions of PVC features (i.e. knowledge quality and system quality) on knowledge-seeking strategies and resultant outcomes. Design/methodology/approach A field experiment was conducted with 119 seekers in a PVC using a 2 × 2 factorial design of seekers’ expertise (i.e. expert versus novice) and task complexity (i.e. low versus high). Findings The study reveals three significant insights: (1) For a high-complexity task, experts adopt an ask-directed searching strategy compared to novices, whereas novices adopt a browsing strategy; (2) For a high-complexity task, experts who perceive a high system quality are more likely than novices to adopt an ask-directed searching strategy; and (3) Task completion time and task quality are associated with the adoption of ask-directed searching strategies, whereas knowledge seekers’ satisfaction is more associated with the adoption of browsing strategy. Originality/value We draw on the perspectives of cognitive process and interactional psychology to explore potential two- and three-way interactions of seekers’ expertise, task complexity, and PVC features on the adoption of knowledge-seeking strategies in a PVC context. Our findings provide deep insights into seekers’ behavior in a PVC, given the popularity of the search for knowledge in PVCs.
Article
Full-text available
Real-time process algebra (RTPA) is a denotational mathematical structure for denoting and manipulating system behavioral processes. RTPA is designed as a coherent algebraic system for intelligent and software system modeling, specification, refinement, and implementation. RTPA encompasses 17 metaprocesses and 17 relational process operations. RTPA can be used to describe both logical and physical models of software and intelligent systems. Logic views of system architectures and their physical platforms can be described using the same set of notations. When a system architecture is formally modeled, the static and dynamic behaviors performed on the architectural model can be specified by a three-level refinement scheme at the system, class, and object levels in a top-down approach. RTPA has been successfully applied in real-world system modeling and code generation for software systems, human cognitive processes, and intelligent systems. Purchase this article to continue reading all 19 pages >
Article
Full-text available
Supplementary to matter and energy, information is the third essence for modeling the natural world. An emerging discipline known as cognitive informatics (CI) is developed recently that forms a profound interdisciplinary study of cognitive and information sciences, and tackles the common root problems sharing by informatics, computing, software engineering, artificial intelligence, cognitive science, neuropsychology, philosophy, linguistics, and life science. CI focuses on internal information processing mechanisms and the natural intelligence of the brain. This paper describes the historical development of informatics from the classical information theory and contemporary informatics, to CI. The domain of CI, and its interdisciplinary nature are explored. Foundations of CI, particularly the brain versus the mind, the acquired life functions versus the inherited ones, and generic relationships between information, matter, and energy are investigated. The potential engineering applications of CI and perspectives on future research are discussed. It is expected that the investigation into CI will result in fundamental findings towards the development of next generation IT and software technologies, and new architectures of computing systems.
Book
A groundbreaking book in this field, Software Engineering Foundations: A Software Science Perspective integrates the latest research, methodologies, and their applications into a unified theoretical framework. Based on the author's 30 years of experience, it examines a wide range of underlying theories from philosophy, cognitive informatics, denotational mathematics, system science, organization laws, and engineering economics. The book contains in-depth information, annotated references, real-world problems, heuristics, and research opportunities. Highlighting the inherent limitations of the historical programming-language-centered approach, the author explores an interdisciplinary approach to software engineering. He identifies fundamental cognitive, organizational, and resource constraints and the need for multi-faceted and transdisciplinary theories and empirical knowledge. He then synergizes theories, principles, and best practices of software engineering into a unified framework and delineates overarching, durable, and transdisciplinary theories as well as alternative solutions and open issues for further research. The book develops dozens of Wang's laws for software engineering and outlooks the emergence of software science. The author's rigorous treatment of the theoretical framework and his comprehensive coverage of complicated problems in software engineering lay a solid foundation for software theories and technologies. Comprehensive and written for all levels, the book explains a core set of fundamental principles, laws, and a unified theoretical framework.
Chapter
Cognitive Informatics (CI) is a transdisciplinary enquiry of the internal information processing mechanisms and processes of the brain and natural intelligence shared by almost all science and engineering disciplines. This article presents an intensive review of the new field of CI. The structure of the theoretical framework of CI is described encompassing the Layered Reference Model of the Brain (LRMB), the OAR model of information representation, Natural Intelligence (NI) vs. Artificial Intelligence (AI), Autonomic Computing (AC) vs. imperative computing, CI laws of software, the mechanism of human perception processes, the cognitive processes of formal inferences, and the formal knowledge system. Three types of new structures of mathematics, Concept Algebra (CA), Real-Time Process Algebra (RTPA), and System Algebra (SA), are created to enable rigorous treatment of cognitive processes of the brain as well as knowledge representation and manipulation in a formal and coherent framework. A wide range of applications of CI in cognitive psychology, computing, knowledge engineering, and software engineering has been identified and discussed.
Article
Reflecting important new research developments of the past eight years as well as classic theories of problem solving, this book provides a balanced survey of the higher cognitive processes, human thinking, problem solving, and learning. Divided into four parts, the book discusses associationism and Gestalt theory before introducing current research and theories of induction and deduction in part two. Part three considers recent cognitive theories and discusses information-processing analysis, outlining techniques for analyzing cognition into processes, strategies, and knowledge structures. Finally, the implications and applications of findings in cognitive psychology are examined, with emphasis on applications such as teaching creative problem solving and intelligence measurement. The Second Edition updates research and includes new chapters on everyday thinking, expert problem solving, and analogical reasoning to reflect the growing interest in problem solving within specific domains and in real situations. New and classic problem solving exercises are used liberally throughout the text to illustrate concepts and to enhance the reader's active involvement in the process of problem solving.