Conference PaperPDF Available

Catalyst: Seeing Through the Eyes of a Cat

Authors:

Abstract and Figures

In this paper we document a simulation of the cat visual system intended to convey four of the major differences between the human and cat visual systems. Learning about an animal's visual system is an important step in understanding how that type of animal perceives the world around them, and how they behave within it. The cat visual system, for example, has been studied extensively by neuroscientists [20, 14, 1, 6], but the results of their work are difficult to convey using traditional text displays that are common in zoos, museums, and classrooms. We achieve some of our effects using fragment shaders applied as post-processes, enabling real-time simulation in either a game engine or live video feed. We also present Catalyst, an educational game that uses our simulation to teach players about the differences between human and cat vision. The tasks in Catalyst are based on the principle of situated cognition, and require the player to switch repeatedly between the two visual systems, thus emphasizing the contrast between them. The results of a user study suggest that Catalyst is successful in stimulating the interest of the players with regard to the material being presented, making it a suitable edutainment application for classrooms, zoos, or other educational settings.
Content may be subject to copyright.
Catalyst: Seeing Through the Eyes of a Cat
Jeremy Long Anthony Estey David Bartle
University of Victoria
Sven Olsen Amy Gooch
Abstract
We have implemented a simulation of the cat visual system that is
based on the research of neuroscientists [Shuurmans and Zrenner
1981; Mouat 1985; Govardovskii et al. 2000]. The purpose of our
simulation is to illustrate four of the major differences between the
cat and human visual systems, and to map those contrasts into a
space that can be readily observed by humans. Three of the four
effects are achieved using fragment shaders, and can be applied
as post processes to a game engine or to a live video feed in real
time, provided that enough information about the scene is avail-
able. We also developed Catalyst, an educational game that teaches
the player about how their vision differs from that of a cat. The
tasks included in Catalyst require the player to switch between the
two visual systems, thus emphasizing the contrasts between them.
1 Simulating the Cat Visual System
1.1 Color Transformation
Color vision is the ability to distinguish objects based on the wave-
lengths of light that they reflect. Cones are the primary receptors
associated with color vision, although rod receptors can play a role
under low light viewing conditions. The model of cat vision that
we have implemented is intended only to simulate cone-dominated
color vision, as the interaction between cones and rods is complex.
We base our model of cat color vision on research done by neuro-
scientists that indicates that the cat visual system includes two cone
classes with peaks at 450 nm and 556 nm [Mouat 1985; Shuurmans
and Zrenner 1981]. This model of vision implies that cats would
only be able to see combinations of two color primaries. Some re-
searchers have suggested the presence of a third cone class within
the cat visual system [Guenther and Zrenner 1993], but they be-
lieve this cone class would only be present in a tiny number of reti-
nal ganglion cells, limiting its ability to mediate color vision. We
adopted the two cone model of cat vision, as it is well suited to il-
lustrate the trouble cats would have in distinguishing certain colors.
Some researchers have suggested that the pigment in cone photore-
ceptors has relatively invariant properties across different species,
allowing the curve of a cone receptor to be defined simply by spec-
ifying its peak absorption point. Several different formulations of
the universal pigment template have been proposed that take differ-
ent data sets and visual systems into consideration [Lamb 1995].
We used the alpha-bands proposed by Govardovskii et al. [2000]
to create response curves for the cat cones. Figure 1 shows how
the human cone response curves compare to the cat cone response
curves. Based on these curves, we were able to derive a 3x3 matrix
transform that takes in a signal recorded by the human cones and
translates it into coordinates within the cat visual system, which we
then display within the space that can be observed by the human vi-
sual system. We built a fragment shader that can perform this color
transformation in real time.
Figure 1: Response curves for cone photoreceptors in the human
visual system (left) and the cat visual system (right).
1.2 Luminance Transformation
Cats have superior night vision to humans. This is partially due
to an abundance of rod sensors, which dominate the visual system
under scotopic conditions. Cats also have a tapetum lucidum, which
is a reflective layer that reflects light that passes through the retina
back into the eye. The characteristics described above give the cat
a minimum light detection threshold up to seven times lower than
that of humans. This enhances vision under low light conditions,
but it appears to reduce vision in cases where light is abundant.
We have modeled the relationship between the human visual system
and the cat visual system’s ability to register light using a logarith-
mic function. Figure 2 shows that the slope of the resulting curve
approximates the cat’s ability to function at low light levels, while
also simulating the manner in which the responses from their light
receptors plateau when light is more abundant. This function was
built into a fragment shader that can be run in real time.
Figure 2: The cat luminance transformation function.
1.3 Distance Blur Transformation
Visual acuity describes the sharpness of the images that are pro-
duced by the visual system. It is estimated that the visual acuity of
cats is between 4 and 10 times worse than humans. We approxi-
mated this difference using a depth blur shader that applies an in-
creasingly powerful blur as distance from the viewpoint increases.
1.4 Field of View Transformation
Cats are thought to have a wider field of view than humans. This
gives cats more expansive peripheral vision. We simulate this char-
acteristic by changing the projection matrix used by the virtual cam-
era from the standard 45 degree viewing angle to a 70 degree field
of view when rendering the scene from a cat’s perspective.
2 Catalyst
Our purpose in creating a simulation of the cat visual system is to
educate people about the differences between their visual systems
and the cat visual system. To this end, we decided to implement
an educational game aimed at younger players that uses our sim-
ulation to convey some of the important characteristics of the cat
visual system. Running our simulation on a virtual scene also sim-
plifies the process of providing the information for the depth and
luminance transformations.
Catalyst is a first person puzzle game where the user must switch
between controlling a human and a cat in order to make their way
past a series of obstacles. When controlling the cat, the player sees
the world through our cat visual system simulation. The puzzles
that the player must overcome are based on color discrimination,
low light vision, and field of view, and are specifically designed
to require numerous switches between the two visual modes, thus
emphasizing the differences between them. The video submitted
with this project shows an example playthrough of Catalyst.
References
GOVARDOV SKII , V. I., FY HRQU IST, N ., RE UTER , T. O. M., K UZMIN, D . G., AND DONNER, K. 2000. In search of
the visual pigment template. Visual Neuroscience 17, 4, 509–528.
GUENTHER, E., AN D ZRENNER , E. 1993. The spectral sensitivityof dark- and light-adapted cat retinal ganglion cells.
Journal of Neuroscience 13, 1543–1550.
LAMB, T. 1995. Photoreceptor spectral sensitivities: Common shape in the long-wavelength region. Vision Research35,
22, 3083–3091.
MOUAT, G. S. V. 1985. Photoreceptor inputs to cat lateral geniculate nucleus cells. Experimental Brain Research59, 2,
242–248.
SHUURMANS, R. P., AND ZR ENN ER, E. 1981. Responses of the blue sensitive cone system from the visual cortex and
the arterially perfused eye in cat and monkey. Vision Research21, 1611–1615.
... Refers to the design of technology that enables users to experience different points of view. Previous works have used technology to show users how animals see the world [49,50,92], or to embody animals [3,11,64]. For example, Kasuga et al. [36] created virtual reality (VR) videos of various animals' eyesight, colour vision and dynamic vision. ...
... Refers to the design of technology based on the focal point of attention of the user. Technology in previous works has either focused the users' view of the animal and the exhibit [22,35,83] or on the technology [3,4,49,50,88]. A key motivator for using AR technologies at zoos is not hindering visual connection with animals [83]. For example, Fu et al. [22]'s AR app overlaid text or 2D graphics on animals detected via a smartphone without obstructing the view of the animal. ...
... The types of content explored in previous works can be broadly categorized as visual or auditory. For example, Long et al. [49] used visual content to simulate the cat visual system and show four key differences (colour, luminance, blur and field of view) between the human and feline systems. In contrast, Pendse et al. [62] created a novel experience for an accessible aquarium. ...
Conference Paper
Full-text available
Augmented Reality (AR) offers unique opportunities for contributing to zoos’ objectives of public engagement and education about animal and conservation issues. However, the diversity of animal exhibits pose challenges in designing AR applications that are not encountered in more controlled environments, such as museums. To support the design of AR applications that meaningfully engage the public with zoo objectives, we first conducted two scoping reviews to interrogate previous work on AR and broader technology use at zoos. We then conducted a workshop with zoo representatives to understand the challenges and opportunities in using AR to achieve zoo objectives. Additionally, we conducted a field trip to a public zoo to identify exhibit characteristics that impacts AR application design. We synthesise the findings from these studies into a framework that enables the design of diverse AR experiences. We illustrate the utility of the framework by presenting two concepts for feasible AR applications.
... For studying vision, the physiological properties of an optic system can be examined, however the simulation thereof gives a better understanding. For this reason animal vision simulations are often used in an educational context [1]- [3]. ...
... The specifications of the test system can be found in the appendix(1) ...
Thesis
Full-text available
Vision is the basis for complex behaviour of bees such as navigation and foraging. Simulating bee vision can be helpful in exploring this behaviour. In this thesis a bee vision simulation is developed, based on a detailed scientific model of the spatial resolution and field of view of a bee’s eye. Four different aspects concerning bee vision simulation are covered in this thesis. Namely an existing 3D environment is enhanced by extending it with a skydome. The afore mentioned model is implemented. A rendering engine based on the bee’s eye model is built that uses raycasting for generating bee views from the 3D environment. Lastly, an existing tool for analysing flight paths tracked by radar is extended, so that it can be used to render movies from the bee’s point of view.
... Body-ownership and agency was investigated with humanoid and non-humanoid avatars with wings of a bat [11,12,56] as well as zoologic avatars [100,101] by using visuotactile feedback. To perceive the world from the view of a cat, a combination of distance blur, color transformation, luminance transformation and changing the user's perspective (lower visual eye height) was used [110]. By reducing the visual range and the spatial resolution, a mosquito's hunting behavior was imitated to be perceived by humans [148]. ...
Conference Paper
Much can be learned about an animal species' behavior by studying its visual system [1]. However, it is challenging to convey such a fundamentally visual concept in plain text - a format that is still commonly used in zoos, museums, and classrooms - and is unlikely to appeal to young observers, in partiuclar. Recent advances in computer graphics hardware and techniques enable us to simulate animal visual systems in realtime, allowing a user to explore the world from 'behind the eyes' of the species in question. We have developed a simulation of bee vision based on neuroscience and biology research using a difference-based methodology that emphasizes the key differences between the human and bee visual systems. By integrating the simulation into a serious game, we are able to enhance the simulation's impact, while at the same time engaging users in an entertaining and memorable experience. We conducted a user study to evaluate the impact of our educational game, and found that it was successful in stimulating a significant increase in knowledge regarding bee vision.
Article
Full-text available
Free-flying bumblebees (Bambus terrestris Linnaeus 1758) were trained to visit homogeneously coloured plastic stimuli in a controlled illumination laboratory, and then their ability to discriminate this target colour from differently coloured stimuli was evaluated in non-rewarded tests. Bees did not discriminate between similar colours until the colour distance was well above discrimination threshold, but then discrimination fitted a sigmoidal-type function. The results for this absolute conditioning function and a previously determined function for differential conditioning were compared, and it is shown that the absolute conditioning function best explains the discrimination and flower constancy behaviour of bees that has previously been observed in natural settings. Modeling of the empirically determined absolute discrimination function allows for predictions of how bees would discriminate between flowers in complex foraging conditions that might include changes in the background and/or illumination colour. The absolute conditioning function should thus serve as an important guide for the evaluation of pollinator discriminations between flowers in natural settings, and for the understanding of why there may have been considerable evolutionary pressure on plants to evolve distinctive flower colours so as to promote flower constancy in important pollinators.
Article
Full-text available
(Uncorrected OCR) Abstract U sing online vocabulary learning games In teaching and learning vocabulary has become prominent but controversial. The increased application of such tool has called for the need to evaluate its educational value. It is because of this urge that the present study has come into existence. The purpose of the present study is to understand whether online learning games can benefit learners. It attempts to look into the effects of online games on vocabulary learning and identify the factors contributing to their effectiveness. 118 students in my school were involved in the study. They were enrolled in the same course and were divided into two groups - the experimental group and control group. Both groups were asked to do a pre-test on a pre-selected list of vocabulary. Then the experimental groups were asked to learn the list of vocabulary using two selected online sites with games. Their teachers introduced them to the games in a lesson at the computer laboratories. Mter that they were to learn the words on their own via the games. The control groups were to learn the same list through activities in a face-to-face learning lesson. Later, all the subjects tried the post-test which was exactly the same as the pre-test. The scores of the pre-test and post-test obtained by both groups were compared and discussed. Information was also collected by conducting interviews with five students in the experimental group and three teachers teaching on that course. The results show that the online learning games can help students remember the words learnt more effectively than face-to-face learning lessons. The effectiveness of face-to-face lessons, however, cannot be denied, but is subject to many variables. It is found that students tended to prefer the online mode to the offline one but likewise they revealed that simulated vocabulary games were more desirable than drilling games. 1 Teachers' roles have changed as a result of the use of online learning games. Their role as facilitator and researcher has become more active. Though they thought highly of the educational value of the online games, they found it difficult to monitor students' progress, especially after class. Hence, they tended to use them as teaser to arouse learners' interest. Based on the findings, it is recommended that online learning games be polished and simulated games which are more interactivity be introduced for the teaching and learning of English vocabulary. Accordingly, a design and execution plan of an online simulated game for teaching and learning vocabulary has been detailed in the paper. 11
Article
Full-text available
Note: This article was UPDATED and revised in 2015 in a new article entitled "DGBL: Still Restless After All These Years" which can be found in Research Gate and at Educause Review. What follows are BOTH abstracts: 2006 Abstract: After years of research and proselytizing, the proponents of digital game-based learning (DGBL) have been caught unaware. Like the person who is still yelling after the sudden cessation of loud music at a party, DGBL proponents have been shouting to be heard above the prejudice against games. But now, unexpectedly, we have everyone’s attention. The combined weight of three factors has resulted in widespread public interest in games as learning tools. 2015 Abstract: Nearly a decade ago, I wrote an article for EDUCAUSE Review about digital game-based learning (DGBL) and the challenges it faced.1 I suggested that once proponents of DGBL were successful in convincing people that games could play a role in education, they would be unprepared to provide practical guidance for implementing DGBL. Just as when the person shouting to be heard at a party is suddenly the center of attention at the moment there is a lull in the conversation, we DGBL proponents had everyone's attention—but not much to say. In the article I also suggested that our sometimes overzealous defense of videogames (hereafter often referred to as "digital games") ran the risk of overselling the benefits (and underreporting the challenges) of using digital games in formal education. Digital games, I said then and still believe today, are effective as embodiments of effective learning theories that can promote higher-order outcomes. Our inability to provide guidance in doing so a decade ago was ceding the DGBL front to digital games as tools for making didactic, instructivist learning (i.e., lectures) more "engaging." DGBL, I suggested, was effective not as a means for making learning "fun" or for "tricking" students into learning; DGBL was effective because it supported powerful learning strategies such as situated learning, authentic environments, and optimized challenge and support (scaffolding). What was needed was a renewed focus on (1) research about why DGBL is effective and (2) guidance on how, when, for whom, and under what conditions to integrate digital games into formal education. I was not the only one with these ideas, but my timing and the venue combined to reach many people. That 2006 article has been cited more than 1,000 times since then.2 Yet though these ideas continue to resonate with many people, much has changed in terms of research, practice, and to some extent, my own beliefs about the future of DGBL.
Article
Full-text available
In an effective e-learning game, the learner’s enjoyment acts as a catalyst to encourage his/her learning initiative. Therefore, the availability of a scale that effectively measures the enjoyment offered by e-learning games assist the game designer to understanding the strength and flaw of the game efficiently from the learner’s points of view. E-learning games are aimed at the achievement of learning objectives via the creation of a flow effect. Thus, this study is based on Sweetser’s & Wyeth’s framework to develop a more rigorous scale that assesses user enjoyment of e-learning games. The scale developed in the present study consists of eight dimensions: Immersion, social interaction, challenge, goal clarity, feedback, concentration, control, and knowledge improvement. Four learning games employed in a university’s online learning course “Introduction to Software Application” were used as the instruments of scale verification. Survey questionnaires were distributed to students taking the course and 166 valid samples were subsequently collected. The results showed that the validity and reliability of the scale, EGameFlow, were satisfactory. Thus, the measurement is an effective tool for evaluating the level of enjoyment provided by e-learning games to their users.
Conference Paper
Full-text available
Researchers are using emerging technologies to develop novel play environments, while established computer and console game markets continue to grow rapidly. Even so, evaluating the success of interactive play environments is still an open research challenge. Both subjective and objective techniques fall short due to limited evaluative bandwidth; there remains no corollary in play environments to task performance with productivity systems. This paper presents a method of modeling user emotional state, based on a user's physiology, for users interacting with play technologies. Modeled emotions are powerful because they capture usability and playability through metrics relevant to ludic experience; account for user emotion; are quantitative and objective; and are represented continuously over a session. Furthermore, our modeled emotions show the same trends as reported emotions for fun, boredom, and excitement; however, the modeled emotions revealed differences between three play conditions, while the differences between the subjective reports failed to reach significance.
Article
Full-text available
Museums have started to realise the potential of new technologies for the development of edutainment content and services for their visitors. Virtual reality technologies promise to offer a vivid, enjoyable experience to the museums guests, but the cost in time, effort and resources can prove to be overwhelming. In this paper, we propose the use of 3D game technologies for the purpose of developing affordable, easy to use and pleasing virtual environments. To this end, we present a case study based on an already developed version of a virtual museum and a newly implemented version that uses game technologies. The informal assessment indicates that game technologies can offer a prominent and viable solution to the need for affordable desktop virtual reality systems.
Conference Paper
If surfaces in a scene are to be distinguished by their color, their neural representation at some level should ideally vary little with the color of the illumination. Four possible neural codes were considered: von-Kries-scaled cone responses from single points in a scene, spatial ratios of cone responses produced by light reflected from pairs of points. and these quantities obtained with sharpened (opponent-cone) responses. The effectiveness of these codes in identifying surfaces was quantified by information-theoretic measures. Data were drawn from a sample of 25 rural and urban scenes imaged with a hyperspectral camera, which provided estimates of Surface reflectance at 10-nm intervals at each of 1344 X 1024 pixels for each scene. In computer simulations, scenes were illuminated separately by daylights of correlated color temperatures 4000 K, 6500 K, and 25,000 K. Points were sampled randomly in each scene and identified according to each of the codes. It was found that the maximum information preserved under illuminant changes varied with the code, but for a particular code it was remarkably stable across the different scenes. The standard deviation over the 25 scenes was, on average, approximately 1 bit, suggesting that the neural coding of surface color can be optimized independent of location for any particular range of illuminants.
Article
Investigated the effects of a gaming approach on knowledge acquisition and retention in 56 male and 4 female military trainees. Ss were presented with either subject matter in paper-based prose form (text), paper-based question-and-answer form (test), or computer-based gaming form (game). Results show Ss assigned to the game condition scored significantly higher on a retention test compared to pretest performance. Ss assigned to the game condition scored significantly higher on a retention test than did Ss assigned to the text condition. Ss assigned to the test and text conditions showed no benefit from training in performance at the retention test. Ss assigned to the game condition rated the training they received as more enjoyable and more effective than did those assigned to the other 2 conditions. Results are discussed in terms of the effectiveness of computer-based games for military training applications. (PsycINFO Database Record (c) 2014 APA, all rights reserved)
Article
This article reviews the literature that compares the instructional effectiveness of games to conventional classroom instruction. Studies dealing with empirical research rather than teachers'judgments are reviewed. Published reviews of research in English dating from 1963 to 1984 were examined and the literature was searched for studies from 1984 to 1991. Of the 67 studies considered over a period of 28 years, 38 show no difference between games and conventional instruction; 22 favor games; 5 favor games, but their controls are questionable; and 3 favor conventional instruction. Results for social sciences, math, language arts, logic physics, biology, retention over time, and interest are examined. Math is the subject area with the greatest percentage of results favoring games, but only eight studies have adequate controls. Thirty-three out of 46 social science games/simulations show no difference between games/simulations and classroom instruction. The authors conclude that subject matter areas where very specific content can be targeted are more likely to show beneficial effects for gaming.