ArticlePDF Available

Understanding and Evaluating Measures of Computer Ability: Making a Case for an Alternative Metric

Authors:

Abstract

Most researchers and educators have used a construct approach to evaluate computer ability or literacy. A prototypical measure assesses programming ability, application software skill, and computer awareness. This kind of measure is often viewed as a final product, rather than a pedagogical tool. It is argued that the fundamental basis of computer ability measures has to be altered in order to (a) address a rapidly evolving computer software market and (b) take advantage of significant advances made in instruction and cognitive science. A more fundamentally useful metric of computer ability can be developed using process-oriented methodology. This new metric, comprised of actual learning activities, helps provide a comprehensive and coherent understanding of how a person interacts with a computer. Metaphors and constraints based on an extensive core of intelligence assessment research are used (a) to illustrate how theorists have looked at computer ability and (b) to provide guidelines for developing more useful ability measures. A microgenetic approach is offered as one promising example of a process-oriented method that could produce a richer metric of computer ability for researchers and educators. (Keywords: learning, methodology, computer ability)
Kay, R. H. (1994b). Understanding and evaluating measures of computer ability:
Making a case for an alternative metric. Journal of Research on Computing in
Education, 26(2), 270-284.
... Labbo & Keiffer, 1998;cited in Reinhardt & Isbell, 2002). When it comes to defining the e-literacy, or the computer literacy, there exist many aspects of an individual's ability to do a range of tasks, experience on a number of software packages and programming languages, and the level of normal training (Kay, 1994). Kay (1994), however, affirms that the measure of the computer-ability depends on how the subject interacts with computer, the context of computer use, the goals and needs of an individual. ...
... When it comes to defining the e-literacy, or the computer literacy, there exist many aspects of an individual's ability to do a range of tasks, experience on a number of software packages and programming languages, and the level of normal training (Kay, 1994). Kay (1994), however, affirms that the measure of the computer-ability depends on how the subject interacts with computer, the context of computer use, the goals and needs of an individual. Therefore, in the context of e-commerce, the basic computer literacy may include web browsing and computer operating skills other than making use of some simple software packages and a general level of Information Technology (IT) knowledge. ...
... There needs to be more research asking questions about why girls use the computer. Qualitative studies examining what factors prompt girls' engagement in computer use will add to information on beliefs and valuing of computer activities in gender-role stereotypic ways (Kay, 1994). ...
Article
The purpose of the research study was to describe girls' engagement with computers during middle childhood and to delineate the factors that initiated and sustained the engagement. The research questions were: 1) What patterns distinguish how girls engage in web page development during middle childhood? 2) What roles do environmental and personal factors play in the girls' engagement in the activity of web page development? 3) What are the perceived reasons for the girls' achievement in creating web pages? The research design followed a qualitative case study approach with descriptive methods of data collection. Four participants were selected through nomination by their elementary school principal based on their computer attitude and aptitude. The data collected included interviews, observations, artifacts, and interviewer's reflective notes.
... Most studies in computer literacy have used questionnaires to infer the computer literacy levels of the subjects (Pierce &Lloyd & Solak, 2001), in addition to standardized tests of computer literacy (Hignite & Echternacht, 1992) and structured interviews (Kay, 1993). Brown (2000) advised of several methods available to conduct computer literacy assessment. ...
Article
Accelerated advances in information and communication technologies are widening the offering for new ways to producing and distributing knowledge. Technological progress has fundamentally altered how we live and work, as well as, how we learn and have transformed the world into a global community. The manufacturing industry in developed economies has struggled to train and to turn their workforce into a computer literate group that keeps abreast of changes in computing and information technologies, since most of the work in manufacturing sectors does not rely on this type of literacy to perform well. This paper presents an examination on current computer literacy competence in the manufacturing industry between groups of workers (Managerial and Labor) in USA and Germany. Special emphasis is granted to the discussion of the similarities and differences found in computer literacy between these groups of workers, and the implications associated with having literate and illiterate groups in the workplace.
... In 1992, Kay reviewed 36 studies on gender and computer related behaviors. While there were clear measurement concerns regarding the assessment of gender differences in computer ability, attitude, and use (e.g., Kay, 1992 Kay, , 1993 Kay, , 1994), the overall picture indicated that males had more positive attitudes, higher ability, and used computers more. Five years later, a meta-analysis by Whitley (1997) revealed that the imbalance between males and females continued to exist with respect to computer attitudes. ...
Article
Full-text available
Over the past 18 years, a number of large scale reviews of the literature have documented that gender differences in computer attitudes, ability, and use tend to favor males. Since the use of laptops in higher education classrooms is increasing, it is important to examine whether this use is disproportionally advantageous to males and disadvantageous to females. The purpose of this study was to explore gender differences in the use of laptops in higher education classrooms. Two key areas were examined: on-task behaviors (note-taking, academic activities, instant messaging) and off-task behaviors (e-mail, instant messaging, games, movies, distractions). With respect to on-task behaviors, females reported significantly more note-taking and participation in academic laptop-based activities. No gender differences were observed with respect to instant messaging for academic purposes. Regarding off-task behaviors, females were more distracted by their peers' use of laptops than males, whereas males reported that they played significantly more games during class. Recommendations for future research include expanding the breadth of off-and on-task behaviors assessed, exploring the role of teaching strategies, and focusing on learning performance.
Article
The paper describes the theoretical basis and methodology for research seeking to identify higher order cognitive activity occurring in students' information seeking and learning tasks with hypermedia. It reviews difficulties arising from the inconsistency among schemes of cognitive analysis, and of articulating such schemes closely with accounts of the desirable attributes of graduates in employment, where the display of higher order skills is expected. It concludes that such analyses of learning with hypermedia must, despite these problems, be guided by more holistic theoretical accounts of thinking, and constantly adapt methodologies to avoid reliance on over-simplified models.
Article
Full-text available
For many years a mid sized university has offered several sections of an introductory computer concepts course by the lecture method and has also offered at least one online section. There has been much speculation about whether there were differences between the two approaches and the students that self-select into each. In January 2008 it was decided to use the same computer concepts test to compare the students and student knowledge levels in traditional and online sections. The pre test was run in January 2008 at the start of the semester and the post test will be run at the end of April 2008. This paper describes the preliminary results of this study. An additional bonus of this study was the opportunity to examine the computer concepts preparation of enrolled students, mainly first and second year students. The results confirmed faculty speculation that students are not adequately prepared. BACKGROUND
Article
Full-text available
The impact of gender on computer related attitudes, ability, and use has been actively documented, but little research has been done examining how to modify and reduce imbalances. The purpose of this study was to explore the effect of ubiquitous computing (24-hour access to a laptop and the Internet) on gender differences in pre-service teachers with respect to computer attitudes, ability, and use. Regarding computer attitudes, gender differences before the laptop program were observed in only one of the four constructs assessed: future intentions to use computers (behavioral attitude). There were no significant differences in attitude between males and females after the laptop program. With respect to computer ability, males reported having stronger skills in five of the ten ability constructs assessed before the laptop program (operating systems, database software, creating a web page, and programming). There were no significant gender differences in ability after the laptop program, with the exception of programming which continued to favor males. It is speculated that the gender equalization effect observed in this study could have a significant impact on the extent to which technology is used by future students, especially given recent trends in promoting the use of technology in the classroom.
Article
Full-text available
The impact of gender on computer-related attitudes, ability, and use has been actively documented, but little research has been done examining how to modify and reduce imbalances. The purpose of this study was to explore the effect of ubiquitous computing (24-hour access to a laptop and the Internet) on gender differences in pre-service teachers with respect to computer attitudes, ability, and use. Regarding computer attitudes, gender differences before the laptop program were observed in only one of the four constructs assessed: future intentions to use computers (behavioral attitude). There were no significant differences in attitude between males and females after the laptop program. With respect to computer ability, males reported having stronger skills in five of the ten ability constructs assessed before the laptop program (operating systems, database software, creating a web page, and programming). There were no significant gender differences in ability after the laptop program, with the exception of programming which continued to favor males. It is speculated that the gender equalization effect observed in this study could have a significant impact on the extent to which technology is used by future students, especially given recent trends in promoting the use of technology in the classroom.
Article
Full-text available
Defining computer literacy has proven to be an elusive endeavour. A variety of conflicting criteria has created a somewhat confusing and chaotic state of affairs. The following paper provides a framework to organize and understand the evolving and ephemeral meaning of computer literacy. Employing Marshall McLuhan’s now famous axiom “the Medium is the Message,” it is proposed that advances in computer technology have strongly influenced the way in which computer literacy has been defined. Significant advances in computer technology have spawned six relatively distinct perspectives on computer literacy. These perspectives or stages include (a) computer awareness, (b) programming, (c) evolving concept and planning (d) behavioural approach, (e) reaction and process, and (f) personal needs. It is argued that significant advances in computer technology should allow educators to stop focusing on how to use computers and start focusing on how to apply computers.
Article
Full-text available
Since its relatively modest beginning in 1972, the term computer literacy has flourished into a myriad of conflicting meanings and purposes leaving a somewhat confusing result. It is hypothesized that the rapid growth of computer technology has strongly influenced the nature of computer literacy definitions. Five relatively distinct philosophies on defining computer literacy are examined, including a) Specificity, b) Global, c) Planned, d) Evolutionary and e) Individual Needs. It is concluded that computer literacy architects are now focusing on educational as opposed to computer literacy goals.
Article
Full-text available
Findings from the cognitive analysis of human performance in various domains are guiding development of instructional programs that aim to produce specified forms of competence. A detailed analysis of the principles, theory, and assumptions about learning and instruction that underlie a representative set of such programs indicates the significant issues in theories of learning that have begun to drive experimental work in instructional psychology. Through discussion of programs for the acquisition of proceduralized knowledge, the development of self-regulatory strategies, and the structuring of knowledge for problem solving, this article suggests that instructional experimentation is of increasing value to the interactive growth of learning theory and its applications. The article concludes by suggesting approaches to future integration of various theories of learning and of conditions that foster the acquisition of knowledge and skill. (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Article
Full-text available
Describes how motivational processes influence a child's acquisition, transfer, and use of knowledge and skills. Recent research within the social-cognitive framework illustrates adaptive and maladaptive motivational patterns, and a research-based model of motivational processes is presented that shows how the particular performance or learning goals children pursue on cognitive tasks shape their reactions to success and failure and influence the quality of their cognitive performance. Implications for practice and the design of interventions to change maladaptive motivational processes are outlined. It is suggested that motivational patterns may contribute to gender differences in mathematics achievement and that empirically based interventions may prevent current achievement discrepancies and provide a basis for more effective socialization. (79 ref) (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Article
Full-text available
Presents a conceptual analysis of four sets of research issues raised by the rapid intrusion of microcomputers into the lives of children. The first involves use of the computer as a vehicle for studying the determinants of intrinsic motivation. The second involves the study of the relationships between intrinsic motivation and instructional effectiveness in educational software. The third involves the empirical examination of contrasting philosophies of instruction embodied in different current approaches to the design of computer-based educational programs. The final set of issues concerns the effects of the widespread introduction of the computer on social equality, the process of social development, and the goals of formal education. It is argued that these issues should be examined before this technology becomes part of daily life. (99 ref) (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Book
A style is any pattern we see in a person's way of accomplishing a particular type of task. The "task" of interest in the present context is education-learning and remembering in school and transferring what is learned to the world outside of school. Teachers are expressing some sort of awareness of style when they observe a particular action taken by a particular student and then say something like: "This doesn't surprise me! That's just the way he is. " Observation of a single action cannot reveal a style. One's impres­ sion of a person's style is abstracted from multiple experiences of the person under similar circumstances. In education, if we understand the styles of individual students, we can often anticipate their perceptions and subsequent behaviors, anticipate their misunderstandings, take ad­ vantage of their strengths, and avoid (or correct) their weaknesses. These are some of the goals of the present text. In the first chapter, I present an overview of the terminology and research methods used by various authors of the text. Although they differ a bit with regard to meanings ascribed to certain terms or with regard to conclusions drawn from certain types of data, there is none­ theless considerable agreement, especially when one realizes that they represent three different continents and five different nationalities.
Article
Although the “new connectionism” is causing a great stir in cognitive science and artificial intelligence, it has been difficult for people outside these fields to grasp. Through use of a concrete analogy, this article attempts to provide a nontechnical explanation of what connectionism is like and to show how it constitutes a radical alternative to the classical view of cognition based on implicit rules.
Article
[this chapter] consists of: (a) a broad discussion of some general conceptual issues; (b) a brief summary of more historical conceptions of the problem-solving process, followed by a description of the information processing model; (c) a summary of recent problem-solving research, especially as found in particular subject matter domains; (d) a summary of recent work on the effectiveness of problem-solving instruction; (e) a section on miscellaneous topics, presented in question-answer form; and (f) a concluding statement (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Article
To make computer systems easier to use, we are in need of behavioral data which enable us to pinpoint what specific needs and problems users may have. Recently, the “thinking-aloud protocol” method was adopted as a technique for studying user behaviours in interactive computer systems. In the present paper, the “question-asking protocol” method is proposed as a viable alternative to the thinking-aloud method where the application of the latter is difficult or even inappropriate. It is argued that question-asking protocols shed light on (1) what problems users experience in what context, (2) what instructional information they come to need, (3) what features of the system are harder to lean, and (4) how users may come to understand or misunderstand the system.
Article
This article described three heuristics that are employed in making judgements under uncertainty: (i) representativeness, which is usually employed when people are asked to judge the probability that an object or event A belongs to class or process B; (ii) availability of instances or scenarios, which is often employed when people are asked to assess the frequency of a class or the plausibility of a particular development; and (iii) adjustment from an anchor, which is usually employed in numerical prediction when a relevant value is available. These heuristics are highly economical and usually effective, but they lead to systematic and predictable errors. A better understanding of these heuristics and of the biases to which they lead could improve judgements and decisions in situations of uncertainty.