ChapterPDF Available

WOWcube Puzzle: A Transreality Object of Mixed Reality

Authors:

Abstract and Figures

We have developed and are presenting here a novel WOWCube device, which combines properties of a puzzle and a computer video game and is a so-called “transreality puzzle”. The main purpose of the device is to integrate the physical representation and the virtual gaming environment in a common gaming process based on the principles underlying the development of tangible interfaces. The device opens up a wide range of new possibilities by inviting players to dive into a useful entertainment. These devices can be used by various categories of users including children, adults, and seniors by generating new gaming experience and using the gamification principles widely. We believe that the proposed device creates a new class of programmable mechatronic puzzles (video games) falling under the mixed-reality category and being an example of the tangible interface for a serious-game player.
Content may be subject to copyright.
Osipov I.V., Nikulchev E. (2019) WOWcube Puzzle: A Transreality Object of Mixed Reality. In: Arai K., Bhatia
R., Kapoor S. (eds) Proceedings of the Future Technologies Conference (FTC) 2018. FTC 2018. Advances in
Intelligent Systems and Computing, vol 881. Springer, Cham; DOI: https://doi.org/10.1007/978-3-030-
02683-7_3
https://www.springer.com/us/book/9783030026820
WOWcube puzzle: a transreality object of mixed reality

1 Cubios Inc, Novato, CA 94948, USA
2 MIREA – Russian Technological University, Moscow 119454 Russia
Abstract. We have developed and are presenting here a novel WOWCube
device, which combines properties of a puzzle and a computer video game and
is a so-called “transreality puzzle”. The main purpose of the device is to
integrate the physical representation and the virtual gaming environment in a
common gaming process based on the principles underlying the development of
tangible interfaces. The device opens up a wide range of new possibilities by
inviting players to dive into a useful entertainment. These devices can be used
by various by various categories of users including children, adults, and seniors
by generating new gaming experience and using the gamification principles
widely. We believe that the proposed device creates a new class of
programmable mechatronic puzzles (video games) falling under the mixed-
reality category and being an example of the tangible interface for a serious-
game player.
Keywords: New UI; Games; Education; Mixed reality; TUI; puzzles; video
games.
1. Introduction
       !  
"# # $
      %&  '(#"      
!)    "      # (
" #"    
*                    "    
 #""+,
-""
."    "    "
#/0#%"1&
2/((#
 
   %3&4
5!55" 6
)""
,+-7%8&5/("
6 7 "# # . 2 
%9&$.:"#"
#   "#   "
#
#
4(/("##"
# "+" ( #
0 ;/"<<3
2 
" "#
$ 
0   # =    <9"
 .>:  # /
  " "  0   
0#
"##"
"""#
"  ? "  0 
#      $                
6!!7="/%9&
@A#0  67  
 # " #   /
       %B&       "        
  "# !#
%C&
$      !!"#
#00#
"67$ #
'4D%E&
4 
  !!  $  #  #    0"  "      5    0
 # #   "
        5
"# ("+
( 0"    
"#0 
F64G %& #H(
"###7%<&
;/#"#+
4G "##
  /        +            
%"&" !!!4"
  !!               ,$I-      
670
2. Puzzles. Relationship between game mechanics and interfaces
.!!#$J
  !!.!!   JJ
  JJ#5 D I54
K  *    :  ="  !!          
;"D#
8(!!"## ##! JJ4"
#.'"'"#L$
/!! #' 
KMGEB3GH'#"
0              5  "  67
#
:+     (/  
!                       $
67%1&
$#+
4
+
""
   /"# +  
                "    #    
      #          
/$I

K"       +"   
!    "              "     $I  
6#7%3&*""
6"""
7%8&
$            #  +        
""     5 $I#
   EC< @"# "
#:"$I
"#5+"
.,  4" -      
#04$IF
0#$#
4###."
# #  %9& $I       
"#%B&*
    $I  "  #               
+"#%C&
3. WOWCube as transreality puzzle
$!!
'" # $  
#!!
!!
4    /  %9&"   !! # +  
"#,4G- ,4-"
   #       #  
$#
4'#!!"#
+ "  
,"GH'-"
    !! 
#"
$" +     #" 
"+"
$    (   
#(
 D* /"  " #  ;  '"    #
    "                    
"      !!"          ,"    (+
     # #"0
##"#-
$//.'!!D*
EB<,I5.1"988"<"6.!!#7%E&
4    ,6NC7- #  
H!!$
#/
,-
0#'2"'
(#"
!!.'4"#
!!%<&
Fig. 11. WOWCube 3D-model (render).
$ '  !!" 
 #"/
,D*/-4#
''
' # 0 ;"  #  "
#      
"  "  "        $    5"    
    "  "            %"  &    
"'     H  //2
.!!%E&"#'
$"  !!       ; /" 
#(#8(.!!  " #
0"
"#
#""
' "  8'  ,#  
-/
" " ,  #  -"
,1O1O1"3O3O3"-""/"""

.!!            !!  "  +" 6#  !!7  
6 !!7$<!!"
   +   #!! , 
  !!    FNN#!!N(N(PQR
Q3-
(2.!!='
GH'"##!!"#
        !  ,              -  ,
FNN###0N!!N!!"  FNN####!!N(
N!!PQ3CB-K#"!!"
""/
$N'#"#
   # $  
"/"  "  GH '"
N          '    ,    
  -        # 4"          
"     "                
K#"           
'/"#;
$      #        #        
"#'#/

$ /
        "    !!"        #"    0  
67  #

- -
Fi g. 2 а) Standard configuration of WOWCube using 8 WOWCube elements. All tile
connectors are directed inwards, all outer sides are displays. Such a structure can turn freely
around 3 axes on the mechanical base in the center; b) Same with one WOWCube removed.
The steel ball in the middle serves as the base, which allows the structure turn around three
axes without bias. The ball can be replaced with a Pocket Cube mechanical puzzle.
"#'"#F
A variant of Scrabble 3 #  , 
"" !"- ,;1-$'
 #"0
,#-$#"#
"#$"#
#       +
"#
Fig. 3. WOWCube with the gameplay in process on all external displays forming common
gaming space.
A variant of Pac-Man$   /  ' 
    $      .(2          ,  
-    '"   
#"# ( 
.(2".(2"
#.(2#"#
/
Maze4!  ' $   
"#!"/
$2.!!=,;3-
Fig. 4. WOWCube while turning around one of the axes.
Faces;/ (  #' 
$      2
","#
  #    #    
#(-
Fig 5. WOWCube with the gameplay in process on all external displays forming common
gaming space
Patterns/Fractals """ " ?
 "6 70 
# " $  
""#
Bubbles  "     #          +  ?
#$67##
0  #"
"","
/"-
Birds/Fish= ? +#  $
'$
+
Pac-Man vs. Digger   /( # #
"""

Cities and Landscapes4+"!!#N
" #     0  
"   0 "  #
!
Mixing colors;"'#=
"#/""
GH'$ 
/  $     #"/"
6#7"/#6767
A version of 15-Puzzle, only it is 23 now, rather than 15
,#-"0
"   $        
,""#-4
            62  '7  "    (
      8(.!!F          #  I(  "  #  
"/"##
$/
%1&
5 ' "
     '   
"              "  +"    
,-"
#"
"#"
4. Design WOWcube
$'    " #   
 #
4                  ,  ; 9-  $
'    3          !!        
##(#GH'
Fig. 6. Assembled and functional prototype of the 8-element WOWCube.
$ #"
        "              "  
' #$0
#I54G$,I54
GN$-"#(/
/#"

  (              /  
,"                      
0" /#
#
 /    3</3<$;$ # /
C"#

4+""
"+##"##
""0
      0 #  
0;"
  0     "#
 " #    , 
#$;$"#-
$ ##
    #               ,; B-
I  #"     " +"$J  I54G$ 
"GJI54G$"',
                  "  #    0
)S8#-":
67"#"#GJ$J
"##
'
$#
 0 "  :   #   
:"'" '" #  I54G$ " 
#/+" #67""
GJ#$J"$J"GJ$
:'"
GJ$J"""#

$  (          ,;B-  ,
<C<B8B3-#
              "        
(" # 
+"#0

Fig. 7. Prototyping process and software testing.
5. Сonclusions
$  #    '            
+
$
"##(#GH'IGH'"#
                "            
     "  '3
  "#
+#

$                  
'
; + " # 

Acknowledgments
$ /    # "# # 
0  #        F 4/  :"   ;"  
5"  2  "    T" 4  ."  5  "
5 "  2 5" T"4/ ." 4
4"*2":=
References
1. Watanabe, R., Itoh, Y., Kawai, M., Kitamura, Y., Kishino, F., & Kikuchi, H.:
Implementation of ActiveCube as an intuitive 3D computer interface. In: International
Symposium on Smart Graphics, pp. 43-53. Springer, Heidelberg (2004).
2. Montola, M.; Stenros, J.; Waern, A.: Pervasive Games. Theory and Design, CRC Press
(2009).
3. Nieuwdorp, E.: The pervasive discourse. Computers in Entertainment 5(2), 13 (2007).
4. Bonsignore, E.M., Hansen, D.L, Toups, Z.O et al.: Mixed reality games. In: Proceedings of
the ACM 2012 conference on CSCW Companion, ACM (2012).
5. de Souza e Silva, A., Sutko, D.M.: Digital Cityscapes: merging digital and urban
playspaces. New York, Peter Lang Publishing, Inc. (2009).
6. Milgram, P., Takemura, H., Utsumi, A., Kishino, F.: Augmented Reality: A class of
displays on the reality-virtuality continuum. In: Proceedings of Telemanipulator and
Telepresence Technologies, pp. 282–293 (1994).
7. van Kokswijk, J.: Hum@ n: Telecoms and Internet as Interface to Interreality: A Search for
Adaptive Technology and Defining Users. Bergboek (2003).
8. Gintautas, V., Hübler, A. W.: Experimental evidence for mixed reality states in an
interreality system. Physical Review E 75(5), 057201 (2007).
9. Lindley, C. A.: Trans-reality gaming. In: Proceedings of the 2nd Annual International
Workshop in Computer Game Design and Technology, p. 10 (2004).
10. Milgram, P., Takemura, H., Utsumi, A., Kishino, F.: Augmented reality: A class of displays
on the reality-virtuality continuum. In: International Society for Optics and Photonics for
industrial applications, pp. 282-292 (1995).
11. Kasapakis, V., Gavalas, D.: Pervasive gaming: Status, trends and design principles. Journal
of Network and Computer Applications 5(5), 213-236 (2015).
12. Montola, M.: Exploring the edge of the magic circle: Defining pervasive games. In:
Proceedings of DAC, vol. 1966, p. 103 (2005).
13. Djaouti, D., Alvarez, J., Jessel, J.P.: Classifying serious games: the G/P/S model. In:
Handbook of research on improving learning and motivation through educational games:
Multidisciplinary approaches, vol. 2, pp. 118-136 (2011).
14. Ishii, H., Ullmer, B.: Tangible bits: towards seamless interfaces between people, bits and
atoms. In: Proceedings of the ACM SIGCHI Conference on Human factors in computing
systems, pp. 234-241. ACM (1997).
15. Norman, D. A.: The design of everyday things: Revised and expanded edition. Basic books
(2013).
16. Markoff. J.: As Apple Gains PC Market Share, Jobs Talks of a Decade of Upgrades, New
York Times, http://www.nytimes.com/2007/10/22/technology/22apple.html (2007).
17. Guo, C., Sharlin, E.: Exploring the use of tangible user interfaces for human-robot
interaction: a comparative study. In: Proceedings of the SIGCHI Conference on Human
Factors in Computing Systems, pp. 121-130. ACM (2008).
18. Osipov, I.V. Technology overview TUI (tangible user interface) used for gamification,
Cloud of Science, 3(4), 572-602 (2016).
19. Nichols, L.D.:Puzzle and method with pieces rotatable in groups. U.S. Patent No.
3,655,201. Washington, DC: U.S. Patent and Trademark Office (1972).
20. Sun, T., Zheng, C.: Computational design of twisty joints and puzzles. ACM Trans. Graph.
34(4), 101 (2015).
21. Gray, P. Cognitive Benefits of Playing Video Games. Psychology Today. Viitattu 19, 2016
(2015).
22. Green, C.S., Seitz, A.R.: The impacts of video games on cognition (and how the
government can guide the industry). Policy Insights from the Behavioral and Brain
Sciences 2(1), 101-110 (2015).
23. Zubr yaev I. M . Puzzle game “MINU S- CUBE”, U SSR Aut hor's Ce rt ificate,
http://www.findpatent.ru/patent/136/1367992.html (1986).
... In order to demonstrate and use the main features of the device [12], a gaming application has been developed. The player's goal is to gather all bonuses in the displays of each unit by using actively the tangible interface and the common gaming space. ...
Article
Full-text available
We consider some functions used in modern gadgets, in particular, the split screen, and the possibilities to employ gyroscope and accelerometer using an example of a customized gaming device, Wowcube. This device is a smart toy with tangible interface and is an analogue of a portable console with its potential going beyond launching applications only. The design of a firmware complex of a customized eight-processor gadget with a tangible interface is described. The structure of a data batch exchanged by the units of the complex to ensure synchronization is presented. The method of exchanging messages and the message lifetime are described. The commands used to exchange messages between the unit and the launched application are described. A list of the commands used by the platform and applications is determined. In order to determine the topology of the cube unit network, an example of operation of the message exchange system between the platform and an application, as well as between the units, is considered. An application for the customized computer complex has been developed using an SDK. The developed application takes into account the specific features and limitations of the device. The process of interaction of the device elements is described using this application as an example. Operation of the main menu of the device is presented. Means of the user's interaction with the tangible interface are described.
Article
Full-text available
Web surveys are an integral part of the feedback of Internet services, a research tool for respondents, including in the field of health and psychology. Web technologies allow conducting research on large samples. For mental health, an important metric is reaction time in cognitive tests and in answering questions. The use of mobile devices such as smartphones and tablets has increased markedly in web surveys, so the impact of device types and operating systems needs to be investigated. This article proposes an architectural solution aimed at reducing the effect of device variability on the results of cognitive psychological experiments. An experiment was carried out to formulate the requirements for software and hardware. Three groups of 1000 respondents were considered, corresponding to three types of computers and operating systems: Mobile Device, Legacy PC, and Modern PC. The results obtained showed a slight bias in the estimates for each group. It is noticed that the error for a group of devices differs both upward and downward for various tasks in a psychological experiment. Thus, for cognitive tests, in which the reaction time is critical, an architectural solution was synthesized for conducting psychological research in a web browser. The proposed architectural solution considers the characteristics of the device used by participants to undergo research in the web platform and allows to restrict access from devices that do not meet the specified criteria.
Article
Full-text available
The article briefly discusses functions that are often used in modern gadgets, such as a shared working space in different devices, and features, such as a gyroscope and accelerometer, as well as an example of a non-standard device that uses this functionality. This device is a smart toy with a tangible interface and is an analogue of a portable console, with the ability to launch not only gaming applications. The second section describes the design of the hardware-software complex of a non-standard eight-processor device with a tangible interface. The third section describes the structure of the package, which the hardware modules exchange with each other to ensure synchronization. The method of messaging and the lifetime of messages are described. The fourth section describes the commands used when exchanging messages between the platform and the running application. The list of commands used by the platform and applications is determined. In order to determine the topology of the network of cube modules, an example of the operation of the messaging mechanism not only between the platform and the application, but also between the modules is considered. The fifth section, using the developed application for this complex as an example, taking into account its features and limitations, describes the process of interaction between its parts. An example of working with the main menu of the device is also given. The methods of user interaction with a tangible interface are described.
Article
Full-text available
Pervasive games represent a radically new game form that transfers gaming experiences out into the physical world, weaving ICTs into the fabric of players׳ real environments. This emerging gaming mindset is rather challenging for developers exploring technologies and methods to achieve a high quality interactive experience for users, and designing novel and compelling forms of content. This paper follows a systematic approach in exploring the landscape of pervasive gaming. First, we present 18 representative pervasive game projects, following a generations-based classification. Then, we present a comparative view of those projects with respect to several design aspects. Lastly, we shed light on technological status and trends, design principles, developer guidelines, and research challenges for pervasive games development.
Article
Full-text available
The purpose of this chapter is to introduce an overall classification system for Serious Games. The intention of this classification is to guide people through the vast field of Serious Games by providing them with a general overview. For example, it may appeal to teachers who wish to find games with strong educational potential though they may be outside the “edugames” field. This chapter will start by discussing the definition of Serious Games, and define them as having a combination of “serious” and “game” aspects. This theoretical framework will be used to review previous classification systems and discuss their limitations. It will then introduce a new classification that addresses a number of these limitations: the G/P/S model. This classifies games according to both their “serious-related” and “game-related” characteristics, and combines the strengths of several previous classification systems.
Article
Full-text available
Trans-reality games are games that take advantage of pervasive, mobile, ubiquitous, location-based and mixed reality technical infrastructures to deliver new modes of game play experience in which the different contexts of staging are integrated within a unified game space that crosses over technical borders. The development of trans-reality games involves meeting specific design challenges concerning variations between the roles of technology and the player in different game staging environments. The result must be a design methodology in which diverse demands upon and opportunities for player creativity are integrated within the mechanics of a specific trans-reality game design.
Article
Full-text available
In this paper we discuss Augmented Reality (AR) displays in a general sense, within the context of a Reality-Virtuality (RV) continuum, encompassing a large class of "Mixed Reality" (MR) displays, which also includes Augmented Virtuality (AV). MR displays are defined by means of seven examples of existing display concepts in which real objects and virtual objects are juxtaposed. Essential factors which distinguish different Mixed Reality display systems from each other are presented, first by means of a table in which the nature of the underlying scene, how it is viewed, and the observer's reference to it are compared, and then by means of a three dimensional taxonomic framework, comprising: Extent of World Knowledge (EWK), Reproduction Fidelity (RF) and Extent of Presence Metaphor (EPM). A principal objective of the taxonomy is to clarify terminology issues and to provide a framework for classifying research across different disciplines.
Article
We present the first computational method that allows ordinary users to create complex twisty joints and puzzles inspired by the Rubik's Cube mechanism. Given a user-supplied 3D model and a small subset of rotation axes, our method automatically adjusts those rotation axes and adds others to construct a "nonblocking" twisty joint in the shape of the 3D model. Our method outputs the shapes of pieces which can be directly 3D printed and assembled into an interlocking puzzle. We develop a group-theoretic approach to representing a wide class of twisty puzzles by establishing a connection between non-blocking twisty joints and the finite subgroups of the rotation group SO(3). The theoretical foundation enables us to build an efficient system for automatically completing the set of rotation axes and fast collision detection between pieces. We also generalize the Rubik's Cube mechanism to a large family of twisty puzzles.
Article
Video game play has become a pervasive part of American culture. The dramatic increase in the popularity of video games has resulted in significant interest in the effects that video gaming may have on the brain and behavior. The scientific research to date indicates that some, but not all, commercial video games do indeed have the potential to cause large-scale changes in a wide variety of aspects of human behavior, including the focus of this review—cognitive abilities. More recent years have seen the rise of a separate form of video games, the so-called “brain games,” or games designed with the explicit goal of enhancing cognitive abilities. Although research on such brain games is still in its infancy, and the results have definitely not been uniformly positive, there is nonetheless reason for continued optimism that custom games can be developed that make a lasting and positive impact on human cognitive skills. Here, we discuss the current state of the scientific literature surrounding video games and human cognition with an emphasis on points critically related to public policy.
Article
In this article I argue for a critical analysis and re-evaluation of the term pervasive. Due to ambiguous definitions in both the discourse on computing and gaming, this term has become theoretically entangled with others. This has led to multiple definitions, and also, in the case of gaming, to the neglect of the different perspectives in which a game can be pervasive. In the current nascent stage of research into pervasive gaming, in which attempts are being made to theorize this concept, I argue for an analytical overview of the use of the term pervasive in order to understand the different perspectives in which it is used.