ArticlePDF Available

Tangible Interfaces for Art Restoration

International Journal of Creative Interfaces and Computer Graphics

January 2010
1(1):54-66

DOI:10.4018/jcicg.2010010105

Source
DBLP

Authors:

Leonardo Amerigo Bonanni

Massachusetts Institute of Technology

Maurizio Seracini

University of California, San Diego

Xiao Xiao

Pôle Universitaire Léonard de Vinci

Matthew Hockenberry

Fordham University

Show all 9 authorsHide

Few people experience a work of art the way a restorer does: as a tactile, multi-‐dimensional and ever-‐changing object. We are investigating a set of tools for the distributed analysis of artworks in the physical and digital realms. Our work is based on the observation of professional art restoration practice and the rich data available through multi-‐spectral imaging. We are developing a suite of interactions to expand on the perceptual dimensions afforded by visual art. This article presents a multidisciplinary approach to develop interfaces usable by restorers, students and amateurs alike. Several interaction techniques were built using physical metaphors to navigate the layers of information revealed by multi-‐ spectral imaging, and these were prototyped using single- ‐ and multi-‐touch displays. We built modular systems to accommodate the technical needs and resources of various institutions and individuals, with the aim to make high-‐quality art diagnostics possible on a variety of hardware platforms. Our aim is to make rich diagnostic and historic information about artworks available for education and research through a cohesive set of web-‐based tools instantiated in physical interfaces and public installations.

A traditional approach to art diagnosis and restoration In this example, a sample region was scraped to determine what lay beneath the wall paint (see the patch on the right side of the image). At one depth, the diagnosticians found a fresco, and the restorers chose to uncover the entire wall to that layer.

…

A detail from multi-‐spectral analysis of a painting This detail of a Raphael's painting Young Woman with Unicorn is a composite of the visible image and an x-‐ray scan. It reveals that the columns framing the subject were added what was once a simple window.

…

A Tangible User Interface for Medical Visualization The patient can refer to an MRI scan of his shoulder by touching the location on his body during a consult with a doctor.

…

Viewing a famous painting The viewing gallery for Da Vinci's Mona Lisa, showing the protective barrier and tinted glass separating the audience of hundreds from the 21 " x30 " (53cm x 77cm) painting

…

Leonardo Da Vinci and Andrea del Verrocchio's Annunciation, 1472-‐5 This work is typical of Renaissance painting in that it was modified by several artists, including Verrocchio, Leonardo's master, da Vinci himself, and subsequent painters and restorers.

…

Figures - uploaded by Hiroshi Ishii

Content may be subject to copyright.

Content uploaded by Hiroshi Ishii

Content may be subject to copyright.

Tangible)Interfaces)for)Art)Restoration)

!"#$%&'#()#$%$$*+((

,%-&*.*#(/"&%0*$*1(

2*%#(2*%#+( (

,%334"5(6#07"$8"&&9+((

)*%$0%(:4"$;(:#<3%$.#+((

=$'&"5(/4->+(

?#>%*$(@"*A+(

=$3#$9(/B"&%$.%+(

6*&#<4*(C<4**+(

+D(,C@(,"'*%(!%8#&%3#&9E(@%$;*8A"(,"'*%(F&#-B(

1D(G:/HE(:"$3"&(#I(C$3"&'*<0*BA*$%&9(/0*"$0"(I#&(=&3E(=&04*3"03-&"(%$'(=&04%"#A#;9(

Abstract)

J"5( B"#BA"( "KB"&*"$0"( %( 5#&7( #I( %&3( 34"( 5%9( %(

&"<3#&"&( '#"<L(%<(%( 3%03*A"E( >-A3*M'*>"$<*#$%A( %$'(

"N"&M04%$;*$;(#8O"03P( Q"( %&"( *$N"<3*;%3*$;( %( <"3(#I(

3##A<( I#&( 34"( '*<3&*8-3"'(%$%A9<*<( #I( %&35#&7<(*$(34"(

B49<*0%A(%$'('*;*3%A(&"%A><P(R-&(5#&7(*<(8%<"'(#$(34"(

#8<"&N%3*#$( #I(B&#I"<<*#$%A(%&3(&"<3#&%3*#$(B&%03*0"(

%$'( 34"( &*04( '%3%( %N%*A%8A"( 34&#-;4( >-A3*M<B"03&%A(

*>%;*$;P(Q"(%&"('"N"A#B*$;(%(<-*3"(#I(*$3"&%03*#$<(3#(

"KB%$'(#$(34"(B"&0"B3-%A( '*>"$<*#$<( %II#&'"'( 89(

N*<-%A( %&3P( @4*<( %&3*0A"( B&"<"$3<(%(>-A3*'*<0*BA*$%&9(

%BB&#%04( 3#( '"N"A#B( *$3"&I%0"<( -<%8A"( 89( &"<3#&"&<E(

<3-'"$3<( %$'( %>%3"-&<( %A*7"P( /"N"&%A(*$3"&%03*#$(

3"04$*S-"<( 5"&"( 8-*A3( -<*$;( B49<*0%A( >"3%B4#&<(3#(

$%N*;%3"(34"(A%9"&<(#I(*$I#&>%3*#$(&"N"%A"'(89(>-A3*M

<B"03&%A( *>%;*$;E( %$'( 34"<"( 5"&"(B&#3#39B"'(-<*$;(

<*$;A"M(%$'(>-A3*M3#-04( '*<BA%9<P( Q"( 8-*A3( >#'-A%&(

<9<3"><( 3#( %00#>>#'%3"( 34"( 3"04$*0%A( $""'<( %$'(

&"<#-&0"<(#I(N%&*#-<(*$<3*3-3*#$<(%$'(*$'*N*'-%A<E(5*34(

34"(%*>(3#(>%7"(4*;4MS-%A*39(%&3('*%;$#<3*0<(B#<<*8A"(

#$( %( N%&*"39( #I( 4%&'5%&"( BA%3I#&><P(R-&( %*>( *<( 3#(

>%7"(&*04( '*%;$#<3*0(%$'(4*<3#&*0(*$I#&>%3*#$(%8#-3(

%&35#&7<( %N%*A%8A"( I#&( "'-0%3*#$( %$'( &"<"%&04(

34&#-;4( %( 0#4"<*N"( <"3( #I( 5"8M8%<"'( 3##A<(

*$<3%$3*%3"'( *$( B49<*0%A( *$3"&I%0"<(%$'(B-8A*0(

*$<3%AA%3*#$<P(

Introduction)

Q4"$(9#-(;%."(-B#$(%( B%*$3*$;(*$(%( >-<"->E(9#-&(

"9"<( 0#-A'( 8"( >*<A"%'*$;(9#-P(@4"(%BB"%&%$0"( #I( %(

5#&7( #I( %&3( #$A9( &"N"%A<( 34"(0-&&"$3(<3%3"T(*3<(3&-"(

<*;$*I*0%$0"( 0#-A'( A*"(8"$"%34(34"(<-&I%0"P(

@&%'*3*#$%AA9(34"(#$A9( >"%$<( #I( '*%;$#<*$;( 34"(

4*<3#&9( #I( %( B%*$3*$;( 5%<( '"<3&-03*N"E( 8-3( #N"&( 34"(

B%<3(34&""('"0%'"<(>"'*0%A(*>%;*$;(3"04$*S-"<(4%N"(

8""$(%BBA*"'(3#(%$0*"$3(%&35#&7(3#(B""&(8"$"%34(34"(

<-&I%0"($#$M*$N%<*N"A9P( ,%$9( #I( 34"<"( <3-'*"<( 4%N"(

&"N"%A"'( %( B%<3*04"( #I( <7"304"<E( &"M5#&7*$;<E(

%A3"&%3*#$<(%$'( >*<;-*'"'(&"<3#&%3*#$(%33">B3<(34%3(

0#>BA*0%3"( 34"( %-34#&<4*B( %$'( %-34"$3*0*39(#I(34"(

5#&7P( @4"<"( <3-'*"<( %&"( &%&"T( 34"*&( I*$'*$;<( %&"(

0A#<"'( 3#( *$3"&B&"3%3*#$T( %$'( 34"9( %&"( &%&"A9( &"M

"N%A-%3"'P(Q"(8"A*"N"(34%3(34"(4*<3#&9(#I(#-&(0-A3-&%A(

4"&*3%;"( <4#-A'( 8"( #B"$( %$'( %00"<<*8A"(3#(%(5*'"(

%-'*"$0"( 3#( >#3*N%3"( 0#$<"&N%3*#$( "II#&3<( %$'( 3#(

*$0&"%<"( 34"( A*7"A*4##'(#I(I-&34"&('*<0#N"&9P(R-&(

3"%>( *<( 8-*A'*$;( 3%$;*8A"( *$3"&I%0"<( I#&( %&3(

&"<3#&%3*#$( 3#( >%7"( >#'"&$( '*%;$#<3*0(*$I#&>%3*#$(

5*'"A9( %N%*A%8A"( %$'( 3#( 8&#%'"$( 34"( *$3"&B&"3%3*#$(

%$'(%BB&"0*%3*#$(#I(%&3(4*<3#&9P(

)

Figure)1.)A)traditional)approach)to)art)diagnosis)and)restoration)

C$(34*<( "K%>BA"E(%( <%>BA"( &";*#$(5%<( <0&%B"'(3#( '"3"&>*$"(54%3(

A%9(8"$"%34( 34"( 5%AA( B%*$3(U<""(34"(B%304( #$( 34"(&*;43( <*'"(#I(34"(

*>%;"DP(=3(#$"('"B34E(34"( '*%;$#<3*0*%$<( I#-$'( %( I&"<0#E( %$'( 34"(

&"<3#&"&<(04#<"(3#(-$0#N"&(34"("$3*&"(5%AA(3#(34%3(A%9"&P(

Art)Diagnostics)

@4"( I*"A'( #I( %&3( '*%;$#<3*0<( *<( 0#$0"&$"'( 5*34(

&"N"%A*$;( 34"( 4*<3#&9( #I( %( 5#&7( #I( %&3( 3#( %<<"<<( *3<(

0#$'*3*#$( %$'( 3#( 4"AB( '*&"03(0#$<"&N%3*#$("II#&3<P(

@&%'*3*#$%A(3"04$*S-"<(&"S-*&"(3"04$*0*%$<(3#(%8&%'"(

34"( <-&I%0"( #I( %$( *>%;"( -<*$;( <0%AB"A<( %$'( <#AN"$3<(

3#(A#0%3"('"3%*A<( %$'( A%9"&<(#I(*$3"&"<3(U<""(J*;P(+DP(

Q4*A"( 34"<"( 3"04$*S-"<( %&"( <"A'#>( -<"'( 5*34(

*>B#&3%$3(5#&7<(#I(%&3E('*&"03(B49<*0%A( *$3"&%03*#$( *<(

3*>"M3"<3"'E( *$3-*3*N"E( %$'( %A>#<3( %A5%9<(

0#AA%8#&%3*N"P((

=A3"&$%3*N"A9E( >"'*0%A( *>%;*$;( "S-*B>"$3( 0%$( 8"(

-<"'( 3#( B&#'-0"(4*;4M&"<#A-3*#$( *>%;"<( #I( 34"(

%&35#&7( %3( '*II"&"$3( 5%N"A"$;34<( U"P;P( *$I&%&"'E(

-A3&%N*#A"3E(KM&%9DP(@4"<"(&"B&"<"$3(N%&*#-<( >%3"&*%A<(

'"B#<*3"'( #N"&( 34"( 0#-&<"( #I( 34"( B%*$3*$;V<(4*<3#&9E(

I&#>( #&*;*$%A( <7"304"<( 3#( A%9"&<( #I( B*;>"$3( %$'(

N%&$*<4P( Q4*A"( <%I"E( >-A3*M<B"03&%A( <0%$<( &"S-*&"(

<B"0*%A*."'( 3&%*$*$;( 3#( %$%A9."E(%$'( 34"( 5#&7( *<(

%A>#<3( "$3*&"A9( 0%&&*"'( #-3( #$( <*$;A"M-<"&( ;&%B4*0<(

5#&7<3%3*#$<P(Q4"$(%$%A9.*$;(%( >-A3*M<B"03&%A( <0%$E(

34"('*%;$#<3*0*%$(8";*$<(89(B&"0*<"A9(%A*;$*$;(34"(0#M

A#0%3"'( 4*;4M&"<#A-3*#$( *>%;"<( 5*34(%(>-A3*MA%9"&"'(

B4#3#( "'*3*$;( <#I35%&"(#$(%(B#5"&I-A( 0#>B-3"&P(

@4"$E(<4"(A##7<(I#&(%$#>%A*"<(8"35""$(34"(A%9"&<(89(

.##>*$;( *$3#( %('"3%*A(%$'(<-B"&*>B#<*$;(35#(<0%$<(

*$(3&%$<B%&"$09P()9(;&%'-%AA9(%'O-<3*$;(34"(#B%0*39(#I(

#$"(*>%;"(&"A%3*N"(3#(%$#34"&E( 34"('*%;$#<3*0*%$(0%$(

>#&"("%<*A9(B"&0"*N"('*II"&"$0"<(8"35""$(34"(<0%$<P(

@4"<"( %&"( -<-%AA9( %$%A#;#-<( 3#( %A3"&%3*#$<( >%'"(

#N"&( 34"( 4*<3#&9( #I( 34"( %&35#&7P(@4"('*%;$#<3*0*%$(

34"$( <%N"<( 34"( *>%;"( '"3%*AE( 3#;"34"&( 5*34(

*$I#&>%3*#$(%8#-3(34"(A%9"&<(%$'(34"(A"N"A(#I(#B%0*39(

-<"'(U<""(J*;P(1DP(

(

Figure)2.)A)detail)from)multi=spectral)analysis)of)a)painting)

@4*<('"3%*A(#I(%(?%B4%"AV<(B%*$3*$;(Young&Woman&with&Unicorn(*<(%(

0#>B#<*3"( #I( 34"( N*<*8A"( *>%;"( %$'( %$( KM&%9( <0%$P( C3( &"N"%A<( 34%3(

34"( 0#A->$<( I&%>*$;( 34"( <-8O"03( 5"&"( %''"'( 54%3( 5%<( #$0"( %(

<*>BA"(5*$'#5P(

R$0"(0#>BA"3"E(%&3('*%;$#<*<(0%$(*$I#&>(&"<3#&%3*#$(

%$'( 0#$<"&N%3*#$( "II#&3<P( C$( >%$9( 0%<"<E( '*%;$#<*<(

5*AA( &"N"%A( 34"( 0#$'*3*#$( #I( %( B%*$3*$;( 3#( *$'*0%3"(

N-A$"&%8*A*3*"<( %$'( 3#( '*&"03( 0#$<"&N%3*#$P(

/#>"3*>"<(34"('*%;$#<*<(5*AA(&"N"%A(%(WB"$3*>"$3#EV(

#&( %$( "%&A9( 04%$;"( #I( >*$'(89(34"(%&3*<3P(C$(#34"&(

0%<"<E( %&3( '*%;$#<*<( &"N"%A<( *$3"&N"$3*#$<( >%'"( 89(

#34"&( %&3*<3<( %$'( &"<3#&"&<( 54*04( 4*'"( #&( '"<3&#9(

B%&3( #I( 34"( #&*;*$%A( 5#&7P( H"B"$'*$;( #$( 34"(

B4*A#<#B49( #I( &"<3#&%3*#$E( 34"( %&35#&7(*<( 0#$<"&N"'(

*$(*3<(B&"<"$3(<3%3"E(&"3-&$"'(3#(*3<(#&*;*$%A(0#$'*3*#$E(

#&(A"I3(%<(%(B%<3*04"(#I(#A'(%$'($"5P(

=&3( '*%;$#<3*0( B&%03*0"( &"A*"<( #$( B&%03*3*#$"&<( I&#>(

>-A3*BA"( '*<0*BA*$"<( X(4*<3#&*%$<E(0-&%3#&<E(

3"04$*0*%$<( X(5#&7*$;(*$'*N*'-%AA9(#&(*$(3"%><(3#(

%<<"<<(%$'( >%7"('"0*<*#$<(%8#-3(%&35#&7P(@4"&"( %&"(

N*&3-%AA9( $#( <#I35%&"( 3##A<( *$( "K*<3"$0"( 3#( I%0*A*3%3"(

34"<"( '*%;$#<"<( #&( 0#AA%8#&%3*#$<E( <%N"( 0-<3#>(

B&#;&%><( >%'"( 89( *$'*N*'-%A( &"<3#&%3*#$(

A%8#&%3#&*"<( Y+Z[P(Q"( %&"( 8-*A'*$;(%(<-*3"(#I(3##A<(

34%3( &"*$I#&0"( %&3( '*%;$#<3*0( B&%03*0"(3#(>%7"(*3(

%N%*A%8A"( I#&('*N"&<"(>-A3*'*<0*BA*$%&9(;&#-B<E(

*$0A-'*$;(<3-'"$3<(%$'(%>%3"-&<P((

Graphic)Techniques)

@4"( >-A3*MA%9"&"'( %$%A9<*<( 34%3( 04%&%03"&*."<( %&3(

'*%;$#<3*0<( *<( %7*$( 3#( N*<-%A*.%3*#$( 3"04$*S-"<(

0#>>#$(*$(%($->8"&(#I(I*"A'<L('"<*;$"&<E("$;*$""&<E(

%$'( '#03#&<( %AA( &"A9( #$( %( <"03*#$%A( <3%07( #I( *>%;"(

A%9"&<(3#( N*<-%A*."('"$<"(34&""M'*>"$<*#$%A( N#A->"<(

Y\[P(C$( >"'*0%A( *>%;*$;E( B49<*0%A( >%<<"<( %&"( #I3"$(

N*<-%A*."'(%<(%(<"S-"$0"( #I( <A*0"<( 34&#-;4( 34"( 8#'9P(

C$( %&04%"#A#;9E( A%9"&<( %&"( -<"'( 3#( '"B*03( 3">B#&%A(

B&#;&"<<*#$E(%$'(*$(%&04*3"03-&"(34"9(4"AB(3#('"<*;$(

I#&( <B%3*%A( 0#*$0*'"$0"P( C$( "N"&9( 0%<"E( 34"(

&"A%3*#$<4*B( 8"35""$( A%9"&<( 0%$( 8"( %<( 3"AA*$;( %<( 34 "(

*$'*N*'-%A(*>%;"<(34"><"AN"<E(%$'(*3(0%$(8"(-<"I-A(3#(

0#>B%&"( #$"( A%9"&( 5*34( %$#34"&( 3#( '"3"&>*$"(

B"&<*<3"$0"(#I(I"%3-&"<(#N"&(3*>"(%$'(<B%0"P((

]49<*0%A(>"3%B4#&<(4"AB(-<"&<(*$3-*3*N"A9(-$'"&<3%$'(

34"( B#<*3*#$( #I( *>%;"( A%9"&<( *$(34&""M'*>"$<*#$%A(

<B%0"P(@4"( -8*S-*3#-<( W'"<73#BV(#B"&%3*$;(<9<3">(

>"3%B4#&(&"B&"<"$3<(I*A"(<3&-03-&"<(34&#-;4(%(<"&*"<(

#I(<3%07"'(W5*$'#5<PV(H"B34(0-"<(X(<-04(%<(<4%'#5<(

%$'( #00A-<*#$<( X(%&"(0#>>#$A9(-<"'(3#(4"AB(

#&;%$*."(34"(A%9"&<T(34"<"(0%$(I%0*A*3%3"( &"%'*$;( %$'(

0#>B%&*<#$(#I(>#&"(34%$(#$"(A%9"&(%3(%(3*>"(Y+^E11[P(

H&#B( <4%'#5<( 0&"%3"( 34"( *AA-<*#$( #I(<-B"&B#<*3*#$E(

%$'( <">*M3&%$<B%&"$3(5*$'#5<( %AA#5( 35#( A%9"&<( #I(

*$I#&>%3*#$(3#(8"(N*"5"'(<*>-A3%$"#-<A9(Y+1E+_[P((

]49<*0%A( 8"4%N*#&<( 0%$( %A<#( 4"AB( 3#( $%N*;%3"( >-A3*M

A%9"&"'( *>%;"<P( C$( #$"( *$3"&I%0"E( %BBA*0%3*#$(

5*$'#5<(8"4%N"( %<( B*"0"<( #I( B%B"&( 34%3( 0%$( 8"(

I#A'"'( 8%07( 3#( &"N"%A(-$'"&A9*$;( 0#$3"$3( Y`[P(@4*<(

5#-A'( %AA#5( %( '*%;$#<3*0*%$( <"A"03( 8"35""$( 0#M

A#0%3"'( <0%$<P(C$( %$#34"&E( #8O"03<( 0%$( 8"( <4-IIA"'(

%$'(<3%07"'( A*7"( BA%9*$;(0%&'<(3#("<3%8A*<4(#&'"&( Y+[P(

@4*<(>*;43(%II#&'( 34"( %8*A*39( 3#(0#$I&#$3( <0%$( A%9"&<(

*$(<-8O"03*N"(#&'"&P(

Q4"&"%<( 3&%'*3*#$%A( ;&%B4*0%A( *$3"&I%0"<( 4%N"( 8""$(

'"<*;$"'( I#&( <*$;A"M-<"&( 5#&7<3%3*#$<E( 3%$;*8A"( %$'(

*$3"&%03*#$( 0#-A'( %AA#5( *$3"&'*<0*BA*$%&9( ;&#-B<( 3#(

5#&7( 3#;"34"&( %<( 34"9( 5#-A'( *$( 3&%'*3*#$%A( %&3(

'*%;$#<3*0<P( G<*$;( B49<*0%A( 3##A<( %$'( ;"<3-&"<( #$( %(

&"%A(%&3*I%03(B&#N*'"<(%(;&#-B(5*34(%(<4%&"'(I&%>"(#I(

&"I"&"$0"E( 0#MA#0%3"'( I""'8%07( %$'( 34"( %8*A*39( I#&(

"KB"&3<( I&#>( N%&*#-<( '*<0*BA*$"<( 3#( >%7"( '"0*<*#$<(

#$( %( 5#&7( #I( %&3( %3( 34"( <%>"( 3*>"P( @%$;*8A"( G<"&(

C$3"&I%0"<( U@GC<D( -<"( &"%AM5#&A'( #8O"03<( 3#( 0#$3&#A(

'*;*3%A( *$3"&I%0"<E( <#( 34%3( 34"( %II#&'%$0"<( #I( 34"(

I%>*A*%&( *3"><( >%7"( 34"( *$3"&%03*#$( >#&"( *$3-*3*N"P(

Q4"$( '"%A*$;( 5*34( %( <"S-"$3*%A( <"&*"<( #I( <A*0"<(

34&#-;4(%(N#A->"E(@GC<(>%7"(*3(B#<<*8A"(3#($%N*;%3"(

34&#-;4(B49<*0%A(<B%0"(5*34(&"%AM5#&A'(3##A<(3#(>%7"(

34"( *$3"&%03*#$( >#&"( $%3-&%A(Y+a[P( J#&( "K%>BA"E( %(

>#'"A( #I( %( <7-AA( 0%$( 8"( -<"'( %<( %( &"I"&"$0"( 3#(

$%N*;%3"( <0%$<( #I( 34"( 8&%*$( Y+\[P( =$( #-3<3&"304"'(

B%A>(0%$( 4"AB(3#('"I*$"(34"(0-3(BA%$"(54"$(B""&*$;(

*$<*'"( %$( #8O"03( Y\[( U/""( J*;P( \DP( ]49<*0%A( *$3"&I%0"<(

>%7"(&##>( I#&( $#N"A( 39B"<( #I( *$3"&%03*#$E( %<( *$( #$"(

*$3"&I%0"(34%3(%AA#5<( -<"&<(3#(3%7"(%($#$MBA%$%&(<A*0"(

34&#-;4( $->"&#-<( <"03*#$<(89('"I#&>*$;(%(IA"K*8A"(

B&#O"03*#$(<0&""$(Yb[P(

(

Figure)3.)A)Tangible)User)Interface)for)Medical)Visualization)

@4"(B%3*"$3( 0%$( &"I"&( 3#(%$(,?C(<0%$( #I( 4*<( <4#-A'"&( 89(3#-04*$;(

34"(A#0%3*#$(#$(4*<(8#'9('-&*$;(%(0#$<-A3(5*34(%('#03#&P(

@4"( A%9"&<( #I( B"$0*AE( B%*$3( %$'( N%&$*<4( 34%3(

0#$<3*3-3"(>#<3(B%*$3*$;<(%''( -B( 3#( $#( >#&"(34%$(%(

>*AA*>"3"&(#I(34*07$"<<E(>%7*$;(*3('*II*0-A3(3#(B"&0"*N"(

34"*&( 3&-"( N#A->"P( =( $"5( ;"$"&%3*#$( #I( ;"<3-&"M

8%<"'( 3%$;*8A"( *$3"&I%0"<( 0%$( I%0*A*3%3"( $%N*;%3*$;(

34"*&(&"A%3*N"(34*$$"<<P(,-A3*M3#-04(*$3"&I%0"<("$%8A"(

B"#BA"(3#('"%A(5*34(4*;4M&"<#A-3*#$(0#$3"$3(#$(A%&;"(

<0&""$<(Ya[P( @4"&"E( 34"9( 0%$( -<"( 8#34(4%$'<(%<(34"9(

5#-A'( #$( %( &"%A( #8O"03E( %$'( >-A3*BA"( B"#BA"( 0%$(

B%&3*0*B%3"(*$( 34"('*%;$#<3*0(B&#0"<<P(J*$;"&<(%&"($#(

A#$;"&( &"<3&*03"'( 3#( 8"4%N*$;( %<( %( >#-<"( B#*$3"&E(

>%7*$;( *3( B#<<*8A"( 3#( 3%7"( %'N%$3%;"( #I( 34"( 3%03*A"(

"KB"&3*<"(*$(%(&"<3#&"&V<(4%$'<P(

,%7*$;( *$3"&%03*#$( 5*34( 34&""M'*>"$<*#$%A( N#A->"<(

*$3-*3*N"( %$'( 0#AA%8#&%3*N"( &"A*"<( # $( 34"( 0%&"I-A( -<"(

#I( B49<*0%A( >"3%B4#&<P( C$( 3-&$E( 34"<"( 0%$( >%7"( *3(

B#<<*8A"( I#&( ;&#-B<( 3#( B"&I#&>( 0#>BA"K(

>%$*B-A%3*#$<( 3#( >-A3*MA%9"&"'( *>%;"<( *$3-*3*N"A9(

"$#-;4( 3#( 8&#%'"$( 34"( &"%04( #I( B&#I"<<*#$%A(

*$3"&I%0"<P(

Museum)Interfaces)

,-<"-><( %&"( *$0&"%<*$;A9( -<*$;( *$3"&%03*N"(

3"04$*S-"<( 3#( "$&*04( 34"( %-'*"$0"( "KB"&*"$0"P( C$(

;"$"&%AE( >-<"->( *$3"&I%0"<( $""'( 3#( 8"( '*<0&"3"( <#(

%<( $#3( 3#( '*<3&%03( I&#>( 34"( %&3( #$( 34"( 5%AA<P( =-'*#(

;-*'"<E( N*'"#( ;-*'"<( %$'( <>%AA( <0&""$M8%<"'( 7*#<7<(

%&"(%>#$;(34"(>#<3( 0#>>#$( <9<3"><( *$(BA%0"P(@4"(

0#$3"$3E( 54*04( *<( ;"$"&%3"'( 89( 0-&%3#&<E(-<-%AA9(

0#$<*<3<( #I( B&"M&"0#&'"'( %-'*#( %$'( N*'"#( 0A*B<P(

)-*A'*$;(34"<"( *$3"&I%0"<( *<( 3*>"M0#$<->*$;( %$'(

"KB"$<*N"E(#I3"$(&"S-*&*$;("K3"&$%A(0#$<-A3%$3<P(

C$3"&%03*N"( <9<3"><( 4%N"( %A<#( 8""$( '"<*;$"'(I#&(

>-<"-><T( 34"<"( 0#>8*$"( "KB#<*3#&9(*$I#&>%3*#$(

5*34( ;%>"MA*7"( *$3"&%03*#$( 3"04$*S-"<P( R$"(

%&04%"#A#;*0%A( *$3"&I%0"( 4%<( 8""$( '"<*;$"'( <#( 34%3(

*>%;"( A%9"&<( 0%$( 8"( B""A"'( %5%9( I&#>( "%04( #34"&(

Y1[P(=(>-<"->(*$<3%AA%3*#$(%AA#5<(-<"&<(3#(-$0#N"&(%(

>#<%*0( 89( 8&-<4*$;( %5%9( N*&3-%A( '-<3( #$( %( 3#-04(

<0&""$( Y^[P( @4"<"( *$3"&I%0"<(;*N"(-<"&<(34"(

*>B&"<<*#$( 34%3( 34"9( %&"(B%&3*0*B%3*$;(*$(%$( %03( #I(

'*<0#N"&9P(

/#0*%A( $"35#&7<( 0%$( >%7"( *3( B#<<*8A"( I#&(-<"&<( 3#(

%03-%AA9( B%&3*0*B%3"( *$( 34"( %&3( '*%;$#<3*0( B&#0"<<P( C$(

;"$"&%AE( #$A9( 34"( 0-&%3#&<( %$'( '*%;$#<3*0*%$<(

5#&7*$;( I#&( %( B%&3*0-A%&( *$<3*3-3*#$( 0%$( <3-'9(%$'(

B-8A*<4( I*$'*$;<( %8#-3( *3<( 0#AA"03*#$P( !"N"&%;*$;(

0#AA"03*N"( *$3"AA*;"$0"( 0#-A'( N%<3A9( "KB%$'( 34"( B##A(

#I( %$%A9<3<( 3#( *$0A-'"( B&#I"<<*#$%A<( %3( #34"&(

*$<3*3-3*#$<E( %0%'">*0<E( <3-'"$3<( %$'( 34"( ;"$"&%A(

B-8A*0P( ]#B-A%&( &"<#-&0"<( <-04( %<( Q*7*B"'*%( &"N"%A(

34"("K3"$3(3#(54*04(%(;A#8%A(B##A(#I("KB"&3<(0%$(I#&>(

%-34#&*3%3*N"( &"I"&"$0"( '#0->"$3<(Y1+[P( =( $->8"&(

#I( "K%>BA"<( #I( W0*3*."$( <0*"$0"V( B#*$3( 3#( 34"( %8*A*39(

I#&("N"$( $#N*0"<( 3#( 0#$3&*8-3"(3#( %( &"<"%&04( B&#O"03(

89( 3%7*$;( %'N%$3%;"( #I( 34"*&( -$*S-"( B#*$3( #I(

&"I"&"$0"(YZE+`[P((

:#$<*'"&*$;(34"(B%-0*39(#I(0#AA"03*N"("II#&3<(%*>"'(%3(

%&3( *$( ;"$"&%AE( "N"$( %( N"&9( <*>BA"( %>%3"-&(

0#AA%8#&%3*#$( <3%$'<( 3#( >%7"( %( <*;$*I*0%$3( *>B%03P(

Q4"$( 34"( G/( !*8&%&9( #I( :#$;&"<<( 8";%$( B-8A*<4*$;(

*3<( 0#AA"03*#$( #I( B4#3#;&%B4<( # $( 34"( B#B-A%&( B4#3#M

<4%&*$;(<*3"(JA*07&E( I%$<( 0#$3&*8-3"'( %$$#3%3*#$<( %$'(

3%;<(89( 34"( 34#-<%$'<( X("$#-;4(3#(>%7"(34"("$3*&"(

0#AA"03*#$( <"%&04%8A"( %$'( "'*3%8A"( 89( %$9#$"(Y+c[P(

,%7*$;(%&3( '*%;$#<3*0( *$I#&>%3*#$( B-8A*0A9( %N%*A%8A"(

0#-A'( B&#>B3( %( 5"%A34( #I( I*$'*$;<( 89( $";A"03"'(

*$'*N*'-%A<(%&#-$'(34"(5#&A'P(

(

Figure)4.)Viewing)a)famous)painting)

@4"( N*"5*$;( ;%AA"&9( I#&( H%( d*$0*V<( Mona& LisaE( <4#5*$;( 34"(

B&#3"03*N"( 8%&&*"&( %$'( 3*$3"'( ;A%<<( <"B%&%3*$;( 34"( %-'*"$0"( #I(

4-$'&"'<(I&#>(34"(1+eK\ce(Ua\0>(K(ZZ0>D(B%*$3*$;(

Wetpaint)

/#( I%&E( N"&9( I"5( B%*$3*$;<( 4%N"( 8""$( <-8O"03"'( 3#(

0#>B&"4"$<*N"( %$%A9<*<( 34&#-;4( >-A3*M<B"03&%A(

*>%;*$;P( @4"<"( %&"( 34"( >#<3(I%>#-<( B%*$3*$;( *$( 34"(

5#&A'E( B%*$3*$;<( <#( B#B-A%&( 34%3( 34"9("K4*8*3"'(

8"4*$'(B49<*0%A(8%&&*"&<(34%3(>%7"(34">('*II*0-A3(3#(

<""(X("N"$(*$(B"&<#$(U/""(J*;P(_DP(R$"(%BB&#%04(*<(3#(

BA%0"(%(A%&;"('*<BA%9(34%3(%II#&'<(-BM0A#<"(N*"5<($"%&(

34"(5#&7( #I(%&3(*$(34"( >-<"->P( @4*<( *<(34"(0%<"(5*34(

,*04"A%$;"A#V<( DavidE( 54*04( *<( IA%$7"'( 89(%(A%&;"(

<0&""$( 54"&"( N*"5"&<( 0%$( &#3%3"( %( 34&""M

'*>"$<*#$%A(>#'"A( #I( 34"( <3%3-"(3#(<""(*3(I&#>($"5(

B"&<B"03*N"<(Y+b[P(

(

Figure) 5.) Leonardo) Da) Vinci) and) Andrea) del) Verrocchio’s)

Annunciation,)1472=5)

@4*<(5#&7(*<(39B*0%A(#I(?"$%*<<%$0"(B%*$3*$;(*$(34%3(*3(5%<(>#'*I*"'(

89( <"N"&%A( %&3*<3<E( *$0A-'*$;( d"&&#004*#E( !"#$%&'#V<( >%<3"&E( '%(

d*$0*(4*><"AIE(%$'(<-8<"S-"$3(B%*$3"&<(%$'(&"<3#&"&<P(

Q*34( 34*<( %BB&#%04( *$( >*$'E( 5"( <"A"03"'(%(A%&;"E(

4*;4M8&*;43$"<<( BA%<>%( '*<BA%9( 5*34( ;A%<<( <-&I%0"(

%$'( *$I&%&"'( 3#-04( '"3"03*#$( 3#( 8-*A'( %$( *$3"&I%0"(

34%3(0#>BA">"$3<(!"#$%&'#(H%(d*$0*(%$'(=$'&"%('"A(

d"&&#004*#V<(Annunciation(U<""( J*;P(aDE( #$( '*<BA%9( %3(

34"(GII*.*(,-<"->(*$(JA#&"$0"E(C3%A9P(

(

Q"(4%N"(I*N"(4*;4M&"<#A-3*#$( <0%$<( %N%*A%8A"( I&#>(

34*<(>%<3"&B*"0"(%3(N%&*#-<( 5%N"A"$;34<(U<""(J*;P( bDP(

=A34#-;4( 34"( B%*$3*$;( *<( #$A9( <"N"&%A( 4-$'&"'(

>*0&#$<(34*07E( N%&9*$;( 5%N"A"$;34<(#I( A*;43( %&"( %8A"(

3#( '*<0"&$( >%3"&*%A<( '"B#<*3"'( %3( N%&*#-<( <3%;"<(

34&#-;4(34"(B%*$3*$;V<(4*<3#&9P(=>#$;( #34"&('"3%*A<E(

34"<"(<0%$<(&"N"%A(35#(<*>*A%&(0#>B#<*3*#$<(B%*$3"'(

#N"&("%04(#34"&P(J-&34"&( "KBA#&%3*#$(&"N"%A<(#&*;*$%A(

<7"304"<(%<(5"AA(%<(>%$9(<*;$<(#I(%;"P((

(

Figure)6.)Multi=spectral)scans)

C$(34"(0%<"(#I(34"(AnnunciationE(I*N"(5%N"A"$;34<(#I(*>%;*$;(%&"(

%N%*A%8A"(3#(-<E(&"B&"<"$3*$;(I*N"(&"A%3*N"('"B34<(*$3#(34"(<-&I%0"(

#I(34"(B%*$3*$;P)

C$( #-&( I*&<3( *$3"&I%0"( X(0%AA"'(Wetpaint(X(5"(<#-;43(

3#( 0&"%3"( %$( "KB"&*"$0"( %7*$( 3#( 3&%'*3*#$%A(

&"<3#&%3*#$(>"34#'<(-<*$;(%('"3%*A(I&#>(34"(B%*$3*$;P(

Y_[P( J*N"( <0%$<( %&"( <3%07"'( *$( #&'"&( I&#>( <4%AA#5"<3(

UN*<*8A"( A*;43D( 3#( '""B"<3( UKM&%9DP( G<*$;( %( I*$;"&E( 34"(

N*"5"&(0%$( <0&%B"(#II(B%&3( #I(#$"(A%9"&(3#(&"N"%A(34"(

$"K3P(?"BA%0*$;(34"(I*$;"&(%AA#5<(#$"(3#("K0%N%3"(34"(

<-8<"S-"$3( A%9"&( U<""( J*;P( ZDP(@4"( <-83&%03"'( %&"%(

4%<( %(&%;;"'("';"(5*34(%('&#B(<4%'#5(>"%$3(3#(

"N#7"( 34"( %8&%<*N"( 3"04$*S-"( -<"'( 89( &"<3#&"&<E(

-<-%AA9( 5*34( %( <0%AB"A( #&( %(8&-<4P(R$0"( %$( %&"%( 4%<(

8""$( &">#N"'E( *3( <A#5A9( I%'"<( 8%07(#&(W4"%A<PV(@4*<(

%$*>%3*#$E( 54*A"( $#3( %<( B&"0*<"(%<(34"(0#$3&#AA"'(

I%'*$;(-<"'(89( B&#I"<<*#$%A<E( $"N"&34"A"<<( 4*;4A*;43<(

<#>"(*$0#$<*<3"$0*"<(8"35""$(35#(A%9"&<P(G<"&<(0%$(

<"A"03(%$#34"&(A%9"&( 3#( '"B%&3( I&#>( 89( 3%BB*$;(B%;"(

"';"<( #$( 34"( <*'"( #I( 34"( <0&""$P( @4"( A%&;"( *>%;"(

I%'"<( ;A#8%AA9( 3#( %( $"5( A%9"&( I&#>( 54*04( %( $"5(

*$N"<3*;%3*#$(0%$(8";*$P(

Q"( B"&I#&>"'( %( -<"&( <3-'9( #I( 34"( Q"3B%*$3(

*$3"&I%0"( %$'( "K4*8*3"'( *3( *$( 35# ( B-8A*0( 0#$3"K3<P( C$(

#-&( <3-'9( #I( 34*<( *$3"&I%0"E( 5"( 0#$0A-'"'( 34%3(

'"I*$*$;( %&8*3&%&9( &";*#$<( I#&( 0#>B%&*<#$( 5%<(

8"$"I*0*%A( *$( 0%<"<( 54"$( *>%;"<( 4%'( B%&3*0-A%&(

<*;$*I*0%$0"( #&( 34"( '*II"&"$3( A%9"&<( 5"&"( $#3(

*$3"$'"'( 3#( 8"( <-B"&*>B#<"'P( ]-8A*0( "K4*8*3*#$<(

&"N"%A"'(34%3(34"(<0&%B*$;(>"3%B4#&(*<(*$3-*3*N"E(%$'(

34"(I*K"'(<0%A"(%$'(#&*"$3%3*#$(#I( 34"(%&35#&7(>%7"<(

*3(A";*8A"(3#(>%$9(B"#BA"(%3(#$0"P(R$(34"(#34"&(4%$'E(

34"( A%07( #I( 0#$3&#AA"'( I%'"( #&( .##>( %$'( 34"( I*K"'(

A%9"&(#&'"&(>%7"<(*3( '*II*0-A3( 3#( -<"(*$(%(B&#I"<<*#$%A(

&"<"%&04( 0#$3"K3P(@4"( A*>*3%3*#$( #I( <*$;A"M3#-04(

'"3"03*#$(5%<( <*;$*I*0%$3(%<(>-A3*BA"(B"#BA"(3&*"'( 3#(

-<"( 34"( <0&""$( %3( 34"( <%>"( 3*>"P(@4"(<0&%B*$;(

'*%>"3"&(5%<(A*>*3"'(3#(34"(<*."(#I(%(I*$;"&3*BE(54*04(

*<(3##( <>%AA(I#&(-$0#N"&*$;(A%&;"(%&"%<P(R$(34"(#34"&(

4%$'E(34"(3%03*A"($%3-&"(#I(34"(3#-04(*$3"&%03*#$E(34"(

<"$<"(#I('*<0#N"&9(%$'(34"(0#>B-A<*#$(3#(<0&%304(#II(

A%9"&<(>%'"(*3(%$("$O#9%8A"(*I(<4#&3M3"&>("KB"&*"$0"P(

(

Figure)7.)Wetpaint)

R-&(I*&<3(3#-04M<0&""$(*$3"&I%0"(I#&(0#>B%&*$;(>-A3*M<B"03&%A(

<0%$<(#I(%(B%*$3*$;(-<"<(34"(>"3%B4#&(#I(<0&%B*$;(34&#-;4(A%9"&<(

3#(&"N"%A(34"(B&#;&"<<*#$(#I(34"(%&3*<3P(@4"(B4#3#;&%B4(<4#5<(35#(

A%9"&<(8"*$;(<0&%B"'(#II(89(34"(-<"&E(%<(5"AA(%<(34"(B%;"("';"<(#$(

34"(&*;43(#I(34"(<0&""$(-<"'(3#($%N*;%3"(8"35""$(<0%$<P(

)9(N*&3-"( #I("K4*8*3*$;(*$(<"N"&%A( 0#$3"K3<E(5"(I#-$'(

%($""'( I#&(>#'-A%&*39(%$'(IA"K*8*A*39(*$(34"(<B"0*I*0<(

#I( *>BA">"$3%3*#$P( ,#<3( *$3"&%03*N"( >-<"->(

*$3"&I%0"<( %&"( <3%$'M%A#$"E( 8-*A3( I&#>( <0&%304( 89(

'"'*0%3"'( 0#$<-A3%$3<T( *3( <4#-A'( 8"( B#<<*8A"( 3#(

'"N"A#B( *$3"&I%0"<( 34%3( 0%$( 8"( 0-<3#>*."'(89(

%>%3"-&<P(@#-04M<0&""$<(%$'(A%&;"('*<BA%9<(%&"(&%&"(

%$'( N%&*"'E( <#( %$9( *$3"&I%0"( &"A9*$;(#$(34">($""'<(

3#( B&#N*'"( %( $->8"&( #I( B#*$3<( #I( "$3&9P( )%<"'( #$(

34"<"(I*$'*$;<(%$'(34"(-<"&(<3-'*"<E(5"(%&"(8-*A'*$;(%(

<"&*"<( #I( *>B&#N"'( *$3"&I%0"<( I#&( '*<3&*8-3"'( 4%$'<M

#$(*$3"&%03*#$(5*34(%&3(4*<3#&9P(

)

Pictouch)

)%<"'( #$( 34"( '"<*&"( 3#( %33&%03( %( 5*'"&( %-'*"$0"( 3#(

34"(%&3('*%;$#<3*0<E(5"(%&"(8-*A'*$;(%(0#>B&"4"$<*N"(

<9<3">( I#&( *$N"<3*;%3*$;( >-A3*M<B"03&%A( <0%$<( *$(

;%AA"&*"<(%$'(>-<"-><(%$'(#$(34"( 5"8P( R-&(0-&&"$3(

B&#3#39B"E( 0%AA"'( PictouchE( *<( %( -$*N"&<%A( 3##A( 34%3(

%AA#5<( B&#I"<<*#$%AMS-%A*39( *$3"&%03*#$( 5*34( >-A3*M

<B"03&%A( <0%$<( #I( %$9( B%*$3*$;P( ]*03#-04( 0%$( 8"(

N*"5"'(-<*$;(%(5"8( 8&#5<"&( 5*34( 3&%'*3*#$%A( >#-<"(

%$'(7"98#%&'E( %<( 5"AA( %<(#$(<*$;A"M(%$'(>-A3*M3#-04(

<0&""$<(#I(N%&*#-<(<*."<P( :-&%3#&<( 0%$( 0#$I*;-&"(34"(

*$3"&I%0"(34&#-;4( %$( #$MA*$"( '%3%8%<"T( <39A"( <4""3<(

0#$I*;-&"( 34"( 0#$3"$3( 8%<"'( #$( 34"( <B"0*I*0( '"N*0"(

8"*$;(-<"'P(

(

Figure)8.)Our)multi=touch)screen)prototype)

@4*<( "%<"A( '"<*;$( 5%<( *$3"$'"'( 3#( #II"&( %( $%3-&%A( >-A3*M-<"&E(

%>8*'"K3&#-<(3#-04( *$3"&I%0"(34%3( 5#-A'( 0#>BA">"$3(%(>-<"->(

"K4*8*3P(

Touch)Screen)

)%<"'( #$( 34"( A"<<#$<( A"%&$"'( I&#>( '"BA#9*$;(34"(

Q"3B%*$3( *$3"&I%0"E( 5"( 4%N"( >%'"(*>B&#N">"$3<(

34%3( 0%$( 3%7"( %'N%$3%;"( #I( >-A3*M3#-04( 3"04$*S-"<(

3#( 8"( >#&"( -<"&MI&*"$'A9( *$( %( B-8A*0( 0#$3"K3P( @4"&"(

%&"( <"N"&%A( %'N%$3%;"<( 3#( %( >-A3*M3#-04( %BB&#%04L(

<"N"&%A( B"#BA"( 0%$( 5#&7( #$( '*II"&"$3( B%&3<( #I( 34"(

*>%;"( %3( #$0"T( >-A3*BA"(I*$;"&<(0%$(8"(-<"'(3#(

*$3"&%03( 5*34( %( A%&;"&( %&"%T( %$'( 34"( 3"K3-&"( #I( %(

>-A3*M3#-04('*<BA%9(*<(0#>BA*%$3E(B&#N*'*$;(%(B49<*0%A(

%00#>B%$*>"$3( 3#( 34"( N*<-%A( I""'8%07P( f%&A9(

"N%A-%3*#$( *$( 34"( A%8( <-;;"<3<(34%3(34*<( *<(%(N%<3(

*>B&#N">"$3(#N"&(34"(#&*;*$%A(Q"3B%*$3(*$3"&I%0"P(

R$(34"(#34"&(4%$'E(%(A%&;"(3#-04M<0&""$(>#$*3#&(0%$(

8"(%$("9"<#&"(*$(%(;%AA"&9(#I(%$0*"$3(B%*$3*$;<P(/*$0"(

>-A3*M<B"03&%A( <0%$<( 8"$"I*3( I&#>( 8"*$;( <4#5$( %3( %(

A%&;"(<*."( %$'(4*;4(&"<#A-3*#$E(5"(%&"("KB"&*>"$3*$;(

5*34(5%9<(3#(>#&"(<"%>A"<<A9(*$3";&%3"(34"(#8O"03(*$(

%( ;%AA"&9( 0#$3"K3P( ]*03#-04( 5%<( '"<*;$"'( 3#( "$;%;"(

34"( >-<"->;#"&<( *$( %( 3%03*A"( *$3"&%03*#$( 5*34( 34"(

B%*$3*$;( #$( 34"( 5%AAP( =&3( <3-'"$3<( #I3"$( *$<3%AA( %$(

"%<"A(*$(I&#$3(#I(%(B%*$3*$;(3#(0#B9(*3( %$'( A"%&$(I&#>(

34"( 3"04$*S-"<(-<"'(89(34"(#&*;*$%A(B%*$3"&U<DP(Q"(

8-*A3(%(5##'"$("%<"A(3#(<-BB#&3(%('*;*3%A(0%$N%<(U<""(

J*;P( `DP( =( <4#&3M34&#5( B&#O"03#&( B%*$3<( %$(*>%;"( #$(

34"( 0%$N%<E( 54*04( 0#$<*<3<( #I(%$(%0&9A*0(<4""3(

0#N"&"'( 5*34( %( IA"K*8A"( &"%&MB&#O"03*#$( <0&""$(

>">8&%$"P(@4"( %0&9A*0( <4""3(*<(>#'*I*"'(3#( 5#&7( %<(

%( >-A3*M3#-04( '*<BA%9( 8%<"'( #$( Frustrated& Total&

Internal& Refraction(UJ@C?D( Y++[P(@4"( %0&9A*0( <4""3( *<(

"';"M*AA->*$%3"'(5*34(*$I&%&"'(!fH<(%$'(0#%3"'(5*34(

%( 34*$( A%9"&( #I( 3&%$<B%&"$3( <*A*0#$"(&-88"&P( ]&"<<*$;(

#$( 34"( B&#O"03*#$( <-&I%0"<( 0#>B&"<<"<( 34"( &-88"&E(

'*II-<*$;( 34"( *$I&%&"'(A*;43P( =( N*'"#( 0%>"&%( 5*34( %$(

*$I&%&"'( 8%$'( B%<<( I*A3"&( 8"4*$' ( 34"( 0%$N%<('"3"03<(

34"( B#*$3<( 54"&"( 34"( <0&""$( *<( 3#-04"'( %$'(

0#>>-$*0%3"<( 34">( 3#( %( JA%<4( B&#;&%>(-<*$;(34"(

:#>>-$*39(:#&"(d*<*#$(>-A3*M3#-04(A*8&%&9( Y+^[P( @4"(

3%03*A"( B&#O"03*#$( <0&""$( %$'( *3<( <A#B"( *$N*3"( '*&"03(

*$3"&%03*#$P((

g"K3E(5"('"<*;$"'(%(B&#I"<<*#$%AMS-%A*39(*$3"&I%0"(3#(

"KBA#&"(>-A3*M<B"03&%A(<0%$<(*$(;&"%3('"3%*AP(Q"(5"&"(

*$<B*&"'( 89( 34"( 5#&7IA#5( #I( %&3( '*%;$#<3*0*%$<E( 8-3(

0%&"I-AA9( '"<*;$"'( 34"( *$3"&%03*#$( 3#( 8"( -$*N"&<%A(

%$'( 3#( B&"<"&N"( 34"( 8"%-39( #I( 34"( 5#&7( #I( %&3P(

@&%'*3*#$%AA9E( %$( %&3( '*%;$#<*<( 0#$<*<3<( #I( .##>*$;(

*$3#( N%&*#-<( '"3%*A<( #I( %( B%*$3*$; ( %3( 4*;4( &"<#A-3*#$P(

d%&*#-<( <0%$<( %&"( 0#>B%&"'( 89( %'O-<3*$;( 34"*&(

&"A%3*N"( #B%0*39P( =&"%<( #I( B%&3*0-A%&( *$3"&"<3( %&"(

<%N"'(I#&( A%3"&( <3-'9P( RN"&( 3*>"E(34"(%$$#3%3*#$<( #I(

<"N"&%A( '*%;$#<3*0*%$<( 0&"%3"( %( 0#>B#<*3"( *>%;"(

4*;4A*;43*$;( &"A"N%$3( %&"%<( I#&( *$3"&B&"3%3*#$( 89(

4*<3#&*%$<(%$'(0#$<"&N%3*#$*<3<P(

Use)Scenario)

?%B4%"AV<( Young& Woman& with& Unicorn(U+acbD( *<( %(

0-&*#-<( B%*$3*$;L( %( 3&%'*3*#$%A( ?"$%*<<%$0"( B#&3&%*3E(

34*<( '"B*03*#$(#I(%(5#>%$(8"I#&"(%$(*'"%A*."'(

A%$'<0%B"( *<( >%'"( *$0#$;&-#-<( 89( 34"( 8%89(-$*0#&$(

<4"( 4#A'<( *$( 4"&( %&><P(F%.*$;(%3(34"('*>*$-3*N"(

B%*$3*$;(*$( ?#>"V<( )#&;4"<"( F%AA"&9(%II#&'<(A*33A"(*$(

34"(5%9( #I( %$( "KBA%$%3*#$P( =A#$;<*'"(*3E(4#5"N"&E(%(

4*;4M&"<#A-3*#$('*<BA%9(<4#5<(<%>"( B%*$3*$;(I-AAM<*."(

5*34(%($->8"&(#I(#-3A*$"'(%&"%<P(Q4"$(9#-(3#-04(

#$"(#I(34"<"E(*3(.##><(3#(I*AA(34"(<0&""$P(@4"(-$*0#&$(

8";*$<(3#(I%'"E(%$'(*3(*<(&"N"%A"'(3#(8"($#34*$;(>#&"(

34%$(%( B-BB9P(H&%;;*$;(34"(<A*'"&(8"$"%34(34"('"3%*A(

%AA#5<(9#-( 3#( 8A"$'(34"(N*<*8A"(*>%;"(#I(34"(-$*0#&$(

%$'(34"(KM&%9(#I(34"(B-BB9P(J#A'*$;(#N"&(34"("';"(#I(

34"('"3%*A( <4#5<( 34"( #34"&( A%9"&<( %N%*A%8A"L(*$I&%&"'E(

-A3&%N*#A"3E( 34"(&#-;4( <7"304( 34%3( B&"0"'"'( 34"(

B%*$3*$;P( :#>B%&*$;( 34"( N*<*8A"( *>%;"( 5*34( 34*<(

<7"304( &"N"%A<( 34%3( ?%B4%"A( $"N"&( B%*$3"'( %$934*$;(

*$( 34"( 9#-$;( 5#>%$V<( %&><T( <4"( 4"A'( 34">( I#A'"'(

#$( 4"&( A%BP( !%3"&E( 34"( '#;( 5%<( %''"'T( *3( 5%<(

<-8<"S-"$3A9( &"BA%0"'( 89( &"A*;*#-<( %&3*I%03<E( %$'(

I*$%AA9( 89( 34"( -$*0#&$P(@#-04*$;(#-3<*'"(34"('"3%*A(

&"3-&$<(9#-(3#(34"(I-AAM<*."(#&*;*$%A(U<""(J*;P(^DP((

@4*<( *$3"&I%0"( 5%<( '"<*;$"'( 3#( 8"( <9>>"3&*0%AL( %$(

"KB"&3( 4%<( 34"( <%>"( %8*A*39( 3#( 0&"%3"( 0#>B#<*3"(

N*"5<(%<(%(>-<"->;#"&P(H&%;;*$;(%0&#<<(34"(I-AAM.*<"(

B%*$3*$;(%AA#5<(%(-<"&(3#('"I*$"(%$9(&"03%$;-A%&(%&"%(

3#(.##>(*$3#P(@4"(<A*'"&(%$'(B%;"(0#&$"&<(34"$(%AA#5(

4*>(3#( <"A"03(54*04(A%9"&<( 3#("KBA#&"E(%$'( %3("K%03A9(

(

Figure)9.)Our)professional)art)diagnostic)interface)design)

J&#>(A"I3(3#(&*;43L(I%*$3(#-3A*$"<(4*;4A*;43(%&"%<(#I(*$3"&"<3T(<"A"03*$;(%$(%&"%(0%-<"<(*3(3#(B#B(#-3(#I(34"(8%07;&#-$'T(34"(%&"%("KB%$'<(3#(I*AA(34"(

<0&""$(%$'(8";*$<(3#(I%'"(8"35""$(34"(-BB"&>#<3(A%9"&<T(-<"&<(0%$(<"A"03(54*04(A%9"&<(3#(I%'"(8"35""$(89(3-&$*$;(#N"&(%$(*>%;"("';"(%$'(

<"A"03*$;(I&#>(34"(B%;"(0#&$"&<(U34"(B%;"(0#&$"&(*$3"&%03*#$(*<('"&*N"'(I&#>(34"(J#A'($V(H&#B(3"04$*S-"((Y`[DP(

(

54%3( #B%0*39P( Q4"34"&( #&( $#3( %>%3"-&<( 0#$3&*8-3"(

<*;$*I*0%$3(0#>B#<*3"<E( 34"*&( -<%;"( B%33"&$<( %&"( %(

>"%$*$;I-A( ;%-;"( #I( 34"( #N"&%AA( B"&0"B3*#$( %$'(

-$'"&<3%$'*$;(#I(34"(5#&7(#I(%&3P((

]*03#-04(<4#-A'(8"("%<9(3#(0-<3#>*."(89(%$9(0-&%3#&P(

@4"(JA%<4(%BBA*0%3*#$(34%3( &"$'"&<(34"(N*<-%A("II"03<(

0#>>-$*0%3"<(34&#-;4(34"(JA*07&(=]C(5*34(%$(*>%;"(

0#AA"03*#$(<3#&"'(#$MA*$"P(G<*$;(JA*07&(%AA#5<(0-&%3#&<(

3#( "%<*A9( -BA#%'( B4#3#<( %$'( 3#( %$$#3%3"( <B"0*I*0(

%&"%<( I#&( N*<*3#&<( 3#( "K%>*$"P( @4"( #$MA*$"( B4#3#(

0#AA"03*#$( %-3#>%3*0%AA9( <%>BA"<( 34"( #&*;*$%A<( %3(

>-A3*BA"(&"<#A-3*#$<E(-<"I-A(I#&(B&#'-0*$;(*>%;"(3*A"<(

I#&( .##>*$;( <"%>A"<<A9( *$3#(N%&*#-<('"3%*A<P()9( 34"(

<%>"( 3#7"$E( %&"%<( #I( *$3"&"<3( #$( 34"( 3#-04( <0&""$(

%&"( -BA#%'"'( 3#( 34"( #$MA*$"( &"B#<*3#&9E(*$I#&>*$;(

0-&%3#&<(54*04(B%&3<(%&"(#I(>#<3(*$3"&"<3(3#(N*<*3#&<P(

Future)Work(

]*03#-04(5%<( '"<*;$"'(%<(%(0#>BA">"$3(3#( "K4*8*3<E(

A%8#&%3#&*"<( %$'( 0A%<<&##><P( R-&( *$3"&I%0"( *<( 8"*$;(

'"N"A#B"'( %A#$;<*'"( -<"&( <3-'*"<( %$'( A#$;M3"&>(

"N%A-%3*#$( 5*34( B&#I"<<*#$%A( '*%;$#<3*0*%$<E( %&3(

4*<3#&9( <3-'"$3<( %$'( >-<"->(N*<*3#&<P( )"9#$'(

&"I*$*$;( 34"( *$3"&I%0"E( *3( *<( *>B#&3%$3( 3#( -$'"&<3%$'(

54"34"&( *3( *<( B#<<*8A"( 3#( >#3*N%3"( %( <-<3%*$"'(

%BB&"0*%3*#$(#I(0#$<"&N%3*#$("II#&3<P((

Q4*A"(34"( <#I35%&"( 8"4*$'(]*03#-04(*<(>#'-A%&(%$'(

*$3"$'"'( 3#( 5#&7( *$( %( N%&*"39( # I( '*II"&"$3( 0#$3"K3<E(

34"( B49<*0%A( *$<3%AA%3*#$( 5*AA( N%&9( %00#&'*$;( 3#( 34"(

<B"0*I*0(<"33*$;P(C$(%( 0A%<<&##>(0#$3"K3E(I#&("K%>BA"E(

34"(*$3"&I%0"(0#-A'(8"(-<"I-A(#$(<3-'"$3<V(*$'*N*'-%A(

0#>B-3"&<E(5*34(34"(*$<3&-03#&(%8A"(3#(%;;&";%3"(34"(

<%>BA"<( 8"*$;( "KBA#&"'P( C$( B&#I"<<*#$%A( B&%03*0"E(

0#$N"$3*#$%A( 3#-04M<0&""$( *$3"&%03*#$( 5#-A'( 8"(

<-II*0*"$3(I#&(<>%AA(;&#-B<E(54*A"(%$( "N"$( A%&;"&(

'*<BA%9( 5*34( &">#3"( 0#$3&#A( 5#-A'( <"&N"( I#&(

B&"<"$3%3*#$<P(/*$0"(>-A3*M3#-04('*<BA%9<(%&"(<3*AA($#3(

5*'"A9( %N%*A%8A"E( >-<"->( ;%AA"&*"<( <""7*$;( 34">(

0#-A'( -<"( 0-<3#>( *$<3%AA%3*#$<( '"<*;$"'( 3#( I*3( *$3#(

34"( "K4*8*3( '"<*;$P(C$( 34"( I-3-&"E( 5"( 5*AA( <""7( 3#(

'"N"A#B(I%8&*0M8%<"'( >-A3*M3#-04( <"$<*$;E( %<( 5"AA(%<(

'*<BA%9( 3"04$#A#;*"<( 34%3( I#&;#( 34"( $""'( I#&( &"%&(

*AA->*$%3*#$P(

Conclusion)

@4"(#B"$( %$'( 0#AA"03*N"(3&%'*3*#$<(#I( 34"( *$3"&%03*#$(

0#>>-$*39( 0%$( 4%N"( %( N%<3( *>B%03( #$( 34"( 5%9( %&3(

4*<3#&9( *<( %$%A9."'( %$'( '*<0-<<"'P(RB"$( <#-&0"(

0#>>-$*3*"<( %&"( I#<3"&"'( 89( 34"( <9>>"3&9( #I(

0#>B-3%3*#$L(34"( 3##A<( -<"'( 3#( 0&"%3"(<#I35%&"(%$'(

34"( <%>"( 3##A<( 34%3( -<"( *3E( <#(%$9#$"(0%$(8"(%(

B&#;&%>>"&P(:#AA"03*N"(3##A<("K*<3(I#&(34"( "K04%$;"(

#I(3"K3E(<#I35%&"( 0#'"E( "N"$( B4#3#<( %$'( N*'"#<P( Q"(

%&"(8-*A'*$;(3##A<( <B"0*I*0%AA9(3%&;"3"'( 3#( "$0#-&%;"(

<-<3%*$"'( %$'( '*<3&*8-3"'( <4%&*$;( #I( %&3( 4*<3#&9(

*$I#&>%3*#$P( :-A3-&%A( 4"&*3%;"( *<( %( <4%&"'( &"<#-&0"T(

89(>%7*$;(%N%*A%8A"(*3<(W<#-&0"(0#'"V(5"(0%$(8&#%'"$(

34"( 0#>>-$*39( %03*N"A9( "$;%;"'( *$( *3<( B&"<"&N%3*#$(

%$'('*<<">*$%3*#$P(

Acknowledgements)

Q"(%&"(;&%3"I-A(I#&(34"(;"$"&#-<(<-BB#&3(#I(h#"(

)&%$0E(/"34(6-$3"&E(%$'(34"(<B#$<#&<(#I(34"(@4*$;<(

@4%3(@4*$7(0#$<#&3*->(%3(34"(,C@(,"'*%(!%8P(

References)

+P =;%&%5%A%E(=P( %$'( )%A%7&*<4$%$E(?P(1ccbP(i""B*$j(

*3( &"%AL( B-<4*$;( 34"( '"<73#B( >"3%B4#&( 5*34(

B49<*0<E(B*A"<(%$'( 34"( B"$P( C$(Proceedings&of& the&

SIGCHI& Conference& on& Human& Factors& in&

Computing& Systems(U,#$3&k%AE( l-k8"0E( :%$%'%E(

=B&*A(11(M(1ZE(1ccbDP(?P(F&*$3"&E(@P(?#''"$E(]P(=#7*E(

fP( :-3&"AAE( ?P( h"II&*"<E(%$'( FP( RA<#$E( f'<P( :6C( jcbP(

=:,E( g"5( m#&7E( gmE( +1`\M+1^1P( HRCn(

433BLoo'#*P%0>P#&;o+cP++_ao++1_ZZ1P++1_^ba(

1P )"$7#E( 6PE( C<4%7E( fP( QPE( %$'( J"*$"&E( /P( 1cc_P(

:#AA%8#&%3*N"( ,*K"'( ?"%A*39( d*<-%A*.%3*#$( #I( %$(

=&04%"#A#;*0%A( fK0%N%3*#$P( C$(Proceedings&of& the&

3rd&IEEE/ACM&international&Symposium&on&Mixed&

and& Augmented& Reality(Ug#N">8"&( c1( M(caE(

1cc_DP( /9>B#<*->( #$(,*K"'(%$'(=-;>"$3"'(

?"%A*39P( Cfff( :#>B-3"&( /#0*"39E(Q%<4*$;3#$E( H:E(

+\1M+_cP( HRCn(

433BLoo'KP'#*P#&;o+cP++c^oC/,=?P1cc_P1\P(

\P )#$%$$*E( !PE( =A#$<#E( hPE(:4%#E( gPE( d%&;%<E( FPE( %$'(

C<4**E( 6P( 1cc`P( 6%$'<%5L( 3%$;*8A"( "KBA#&%3*#$( #I(

N#A->"3&*0( '%3%( 89( '*&"03( 0-3MBA%$"( B&#O"03*#$P(

C$(Proceeding& of& the& TwentyJSixth& Annual& SIGCHI&

Conference& on& Human& Factors& in& Computing&

Systems(UJA#&"$0"E(C3%A9E( =B&*A( ca( M(+cE(1cc`DP(:6C(

jc`P( =:,E( g"5( m#&7E( gmE( 1a+M1a_P( HRCn(

433BLoo'#*P%0>P#&;o+cP++_ao+\aZca_P+\aZc^`P(

_P )#$%$$*E( !PE( 2*%#E( 2PE( 6#07"$8"&&9E( ,PE(

/-8&%>%$*E(]PE(C<4**E(6PE(/"&%0*$*E(,PE( %$'(/04-A."E(

hP(1cc^P(Q"3B%*$3L(<0&%B*$;(34&#-;4(>-A3*MA%9"&"'(

*>%;"<P( C$(Proceedings& of& the& 27th& international&

Conference& on& Human& Factors& in& Computing&

Systems(U)#<3#$E( ,=E( G/=E( =B&*A( c_( M(c^E(1cc^DP(

:6C( jc^P( =:,E( g"5( m#&7E( gmE( aZ+MaZ_P( HRCn(

433BLoo'#*P%0>P#&;o+cP++_ao+a+`Zc+P+a+`Z`^P(

aP )&#5$E( /3-%&3( JP( 6%$'<MR$( :#>B-3*$;L( 6#5(

,-A3*M@#-04( /0&""$<( :#-A'( :4%$;"( 34"( Q%9( Q"(

C$3"&%03( 5*34( :#>B-3"&<( %$'( f%04( R34"&P( C$(

/0*"$3*I*0(=>"&*0%$E(h-A9(1cc`P(

bP :%<<*$"AA*E( =P( %$'( C<4*7%5%E( ,P( 1ccaP( i4&#$#<(

B&#O"03#&P( C$(ACM& SIGGRAPH& 2005& Emerging&

Technologies(U!#<( =$;"A"<E( :%A*I#&$*%E( h-A9( \+( M(

=-;-<3( c_E( 1ccaDP( HP( :#KE( f'P( /CFF?=]6( jcaP(

=:,E( g"5( m#&7E( gmE( +cP( HRCn(

433BLoo'#*P%0>P#&;o+cP++_ao++`Z1^ZP++`Z\c`P(

ZP :#4$E( hP( ]P( U1cc`E( ,%&04DP( :*3*."$( /0*"$0"L( :%$(

d#A-$3""&<(H#(?"%A(?"<"%&04p()*#<0*"$0"E(a`U\DP(

`P H&%;*0"N*0E( ]P( 1cc_P( :#>8*$*$;( 0&#<<*$;M8%<"'(

%$'( B%B"&M8%<"'( *$3"&%03*#$( B%&%'*;><( I#&(

'&%;;*$;( %$'( '&#BB*$;( 8"35""$( #N"&A%BB*$;(

5*$'#5<P(C$(Proceedings&of&the&17th&Annual&ACM&

Symposium& on&User&interface&Software&and&

TechnologyU/%$3%(J"E( g,E( G/=E(R03#8"&( 1_( M(1ZE(

1cc_DP( GC/@( jc_P( =:,E( g"5( m#&7E( gmE( +^\M+^bP(

HRCn(

433BLoo'#*P%0>P#&;o+cP++_ao+c1^b\1P+c1^bbZP(

^P H-$$E(?P(1cc1P(@4"(N*&3-%A('*;P(C$(ACM&SIGGRAPH&

2002&Conference& Abstracts& and& Applications(U/%$(

=$3#$*#E( @"K%<E( h-A9( 1+( M(1bE(1cc1DP(/CFF?=]6(

jc1P( =:,E( g"5( m#&7E( gmE( +11M+1\P( HRCn(

433BLoo'#*P%0>P#&;o+cP++_ao+1_1cZ\P+1_1+\^P(

+cP JA*07&( B4#3#M<4%&*$;( <*3"E( %N%*A%8A"( %3(

433BLooIA*07&P0#>o(U%00"<<"'(h-$"(1cE(1cc^DP(

@4"( !*8&%&9( #I( :#$;&"<<( 0#AA"03*#$( *<( %N%*A%8A"(%3(

433BLoo555PIA*07&P0#>oA*8&%&9q#Iq0#$;&"<<o(

U%00"<<"'(h-$"(1cE(1cc^DP(

++P 6%$E( hP( mP( 1ccaP( !#5M0#<3( >-A3*M3#-04( <"$<*$;(

34&#-;4( I&-<3&%3"'( 3#3%A( *$3"&$%A( &"IA"03*#$P(

C$(Proceedings& of& the& 18th& Annual& ACM&

Symposium& on& User& interface& Software& and&

Technology(U/"%33A"E( Q=E( G/=E( R03#8"&( 1\( M(1bE(

1ccaDP( GC/@( jcaP( =:,E( g"5( m#&7E( gmE( ++aM++`P(

HRCn(

433BLoo'#*P%0>P#&;o+cP++_ao+c^ac\_P+c^aca_(

+1P 6%&&*<#$E()P(!PE(C<4**E(6PE(d*0"$3"E(iP(hPE(%$'()-K3#$E(

QP(=P(+^^aP(@&%$<B%&"$3(A%9"&"'(-<"&(*$3"&I%0"<L(

%$( "N%A-%3*#$( #I( %( '*<BA%9( '"<*;$( 3#( "$4%$0"(

I#0-<"'( %$'( '*N*'"'( %33"$3*#$P( C$(Proceedings& of&

the& SIGCHI& Conference& on& Human& Factors& in&

Computing& Systems(UH"$N"&E( :#A#&%'#E( G$*3"'(

/3%3"<E(,%9( cZ( M(++E(+^^aDP(CP(?P(i%3.E(?P(,%07E(!P(

,%&7<E( ,P( )P( ?#<<#$E( %$'( hP( g*"A<"$E( f'<P(

:#$I"&"$0"( #$( 6->%$( J%03#&<( *$( :#>B-3*$;(

/9<3"><P( =:,( ]&"<<o=''*<#$MQ"<A"9( ]-8A*<4*$;(

:#PE( g"5( m#&7E( gmE( \+ZM\1_P( HRCn(

433BLoo'#*P%0>P#&;o+cP++_ao11\^c_P11\^_aP(

+\P 6*$07A"9E(iPE( ]%-<04E( ?PE( F#8A"E(hP(:PE(%$'( i%<<"AAE(

gP(JP( +^^_P(]%<<*N"(&"%AM5#&A'(*$3"&I%0"(B&#B<(I#&(

$"-&#<-&;*0%A( N*<-%A*.%3*#$P( C$(Conference&

Companion& on& Human& Factors& in& Computing&

Systems(U)#<3#$E( ,%<<%04-<"33<E( G$*3"'( /3%3"<E(

=B&*A(1_(M(1`E(+^^_DP(:P(]A%*<%$3E(f'P(:6C(j^_P(=:,E(

g"5( m#&7E( gmE( 1\1P( HRCn(

433BLoo'#*P%0>P#&;o+cP++_ao1a^^b\P1bc__\.(

+_P C<4%7E( fP( QP( %$'( J"*$"&E( /P( iP( 1cc_P( C$3"&%03*$;(

5*34( 4*''"$( 0#$3"$3( -<*$;( 0#$3"$3M%5%&"( I&""M

<B%0"( 3&%$<B%&"$09P( C$Proceedings& of& the& 17th&

Annual& ACM& Symposium& on& User& interface&

Software& and& Technology(U/%$3%( J"E( g,E( G/=E(

R03#8"&(1_(M(1ZE(1cc_DP(GC/@(jc_P(=:,E(g"5(m#&7E(

gmE( +`^M+^1P( HRCn(

433BLoo'#*P%0>P#&;o+cP++_ao+c1^b\1P+c1^bbbP(

+aP C<4**E( 6P( %$'( GAA>"&E( )P( +^^ZP( @%$;*8A"( 8*3<L(

3#5%&'<( <"%>A"<<( *$3"&I%0"<( 8"35""$( B"#BA"E(

8*3<( %$'( %3#><P( C$(Proceedings& of& the& SIGCHI&

Conference& on& Human& Factors& in& Computing&

Systems(U=3A%$3%E( F"#&;*%E( G$*3"'( /3%3"<E( ,%&04(

11( M(1ZE(+^^ZDP( /P( ]">8"&3#$E( f'P( :6C( j^ZP( =:,E(

g"5( m#&7E( gmE( 1\_M1_+P( HRCn(

433BLoo'#*P%0>P#&;o+cP++_ao1a`a_^P1a`Z+aP(

+bP !"N#9E( ,PE( ]-AA*E( iPE( :-&A"<<E( )PE( ?-<*$7*"5*0.E( /PE(

i#AA"&E( HPE( ]"&"*&%E( !PE( F*$.3#$E( ,PE( =$'"&<#$E(/PE(

H%N*<E(hPE(F*$<8"&;E(hPE(/4%'"E(hPE(%$'(J-A7E(HP(1cccP(

@4"( '*;*3%A( ,*04"A%$;"A#( B&#O"03L( \H( <0%$$*$;(#I(

A%&;"( <3%3-"<P( C$(Proceedings& of& the& 27th& Annual&

Conference&on&Computer&Graphics&and&interactive&

Techniques(C$3"&$%3*#$%A( :#$I"&"$0"( #$(

:#>B-3"&( F&%B4*0<( %$'( C$3"&%03*N"( @"04$*S-"<P(

=:,( ]&"<<o=''*<#$MQ"<A"9( ]-8A*<4*$;( :#PE( g"5(

m#&7E( gmE( +\+M+__P( HRCn(

433BLoo'#*P%0>P#&;o+cP++_ao\__ZZ^P\__`_^P(

+ZP ,rAA"&E( :P( %$'( /"&%0*$*E( ,P( +^^bP( @4"( 34*&'(

'*>"$<*#$( #I( s?*3&%33#( '*( ;"$3*A-#>#eP( C$(ACM&

SIGGRAPH& 96& Visual& Proceedings:& the& Art& and&

interdisciplinary&Programs& of& SIGGRAPH&'96(Ug"5(

R&A"%$<E(!#-*<*%$%E(G$*3"'(/3%3"<E(=-;-<3(c_(M(c^E(

+^^bDP( )P( )A%-E( :P( H#'<5#&34E( !P( )&%$%;%$E( hP(

CBB#A*3#E(iP( ,-<;&%N"E(%$'(QP(Q%;;"$<B%07E(f'<P(

/CFF?=]6( j^bP( =:,E( g"5( m#&7E( gmE( ++P( HRCn(

433BLoo'#*P%0>P#&;o+cP++_ao1a\bcZP1a\b+_P(

+`P /04$##&E( hP( !P( U1ccZE( /"B3">8"&( +DP( Citizen&

ScienceP( f$N*&#$P( /0*P( @"04$#APE( _+U+ZDE( a^1\M

a^1\P(

+^P /"7-A"&("3( %AP( ]"&0"B3*#$E(J#-&34(f'*3*#$P()#<3#$L(

,0F&%5(6*AAE(1cc1E(BBP(\\+Ma+P(

1cP :#>>-$*39( :#&"( d*<*#$( >-A3*M3#-04( A*8&%&9(

UI#&>"&A9( 38"3%DE( gGC( F&#-B( :#>>-$*39P(

%N%*A%8A"( %3( 433BLoo00NP$-*;&#-BP0#>o(U%00"<<"'(

h-$"(1cE(1cc^D(

1+P Q*7*B"'*%( #$A*$"( "$090A#B"'*%P( =N%*A%8A"( %3(

433BLoo5*7*B"'*%P0#>o(U%00"<<"'(h-$"(1cE(1cc^DP(

11P t4%*E( /PE( )-K3#$E( QPE( %$'( ,*A;&%>E( ]P( +^^bP( @4"(

B%&3*%AM#00A-<*#$( "II"03L( -3*A*.*$;(

<">*3&%$<B%&"$09( *$( \H( 4->%$M0#>B-3"&(

*$3"&%03*#$P(ACM& Trans.& Comput.JHum.&

Interact.(\E( \( U/"BP( +^^bDE( 1a_M1`_P( HRCn(

433BLoo'#*P%0>P#&;o+cP++_ao1\_a1bP1\_a\1P(

The storytelling as a process of artistic and cultural appropriation: travel in the work of Hieronymus Bosch mediated by a tangible surface

Article

Full-text available

Design of an Interactive Experience with Medieval Illuminations: A Journey into the Beauty and Meaning of Medieval Portuguese Manuscripts

Article

Full-text available

May 2014

This article presents the design, implementation, and evaluation of an interactive installation to explore color in medieval illuminations and their context. The main goal of the installation is to promote wide dissemination of Portuguese medieval illuminations as well as to achieve engagement of the public in the conservation of this treasured heritage. The interactive installation is based on the experience and results obtained in a series of hands-on workshops, where “real” colored paints were produced using techniques and pigments similar to the originals. The design and development process of the interactive installation was carried out by a multidisciplinary team in computer engineering, design, illustration, art history, history, chemistry, and conservation science. The installation, after several iterations on the content and technology, explores innovative computational interfaces and how they can be developed and used in cultural heritage. It has three components that work independently or as a full installation: (1) Virtual Scriptorium, (2) Interactive Panel, and (3) Augmented Book. The design rational, implementation, and evaluation of the modular installation are described, as well as how this work contributes to the wide dissemination of information on these extraordinary medieval manuscripts.

Provenential Properties, Style, and the Aesthetic Value of History

Chapter

Jan 2024

Lisa Giombini

The augmented painting: Playful interaction with multi-spectral images

Conference Paper

Full-text available

Nov 2012

Museum conservators and researchers often take multi-spectral captures of the paintings they study, commonly using x-ray, infrared and ultraviolet equipment. Usually these captures are not accessible to the museum visitor, even though they offer valuable information about the painting. Since 2009 the AR Lab has been developing installations which allow museum visitors to explore these special captures in an user-friendly and playful way. This article describes and comments on the different phases this project went through, and gives a preview of our latest augmented reality application.

Restoration of traditional Chinese shadow play-Piying art from tangible interaction

Article

Jan 2014
COMPUT ANIMAT VIRT W

Piying, the world's intangible culture heritage, is a characteristic Chinese folk shadow play and one of the origins of modern movie. The spirit of traditional Piying is to express rich emotion and stories through impromptu action change by professional artists. Now Piying gradually fades away in people's lives, encountering the risk of extinction. We focus on transforming the traditional Piying play into an interactive system, which can be seamlessly performed by ordinary people and bring a strong sense of immersion to the users. Two interactive systems were developed, with Kinect-based interaction or sensors, users can create own digital Piying animations by employing their body movement as input. A field study was presented with 20 students in a primary school. The result showed that our system was far more effective in emotion induction and Piying understanding than traditional one. We demonstrated this system in a charitable foundation and a workshop of a tangible conference. It is also honored to be collected by China's intangible cultural heritage network. Copyright © 2013 John Wiley & Sons, Ltd.

Virtual restoration of deteriorated religious heritage objects using augmented reality technologies

Article

Full-text available

Apr 2013

In this paper, an approach for the virtual restoration of the religious heritage objects is proposed. The presented method is based on Augmented Reality technologies, which enable virtual restoration of the original heritage object by co-locating the reconstructed 3D virtual model with the real one. This method gives the opportunity to better perceive the damaged object. The proposed method consists in the following actions: obtain documentation about the damaged heritage object, processing of the documentation, 3D reconstruction of the monument, finishing and completing details, registration of the co-located 3D virtual model. The output of the proposed method is a reconstructed 3D model of heritage object, which can be visualized co-located with the real one by using common equipment such as Smartphone or Tablet PC. The application of the proposed methodology, which is used as a case study, was conducted in Brasov, at the Black Church. The proposed methodology may open new possibilities for the restoration of other religious heritage objects.

Khronos projector

Conference Paper

Full-text available

Jan 2005

The Khronos Projector is an interactive-art installation allowing people to explore pre-recorded movie content in an entirely new way. A classic video-tape allows a simple control of the reproducing process (stop, backward, forward, and elementary control on the reproduction speed). Modern digital players add little more than the possibility to perform random temporal jumps between image frames. The goal of the Khronos Projector is to go beyond these forms of exclusive temporal control, by giving the user an entirely new dimension to play with: by touching the projection screen, the user is able to send parts of the image forward or backwards in time. By actually touching a deformable projection screen, shaking it or curling it, separate "islands of time" as well as "temporal waves" are created within the visible frame. This is done by interactively reshaping a two-dimensional spatio-temporal surface that "cuts" the spatio-temporal volume of data generated by a movie.

Handsaw: tangible exploration of volumetric data by direct cut-plane projection

Conference Paper

Full-text available

Apr 2008

Tangible User Interfaces are well-suited to handling three-dimensional data sets by direct manipulation of real objects in space, but current interfaces can make it difficult to look inside dense volumes of information. This paper presents the Handsaw, a system that detects a virtual cut-plane projected by an outstretched hand or laser-line directly on an object or space and reveals sectional data on an adjacent display. By leaving the hands free and using a remote display, these techniques can be shared between multiple users and integrated into everyday practice. The Handsaw has been prototyped for scientific visualizations in medicine, engineering and urban design. User evaluations suggest that using a hand is more intuitive while projected light is more precise than keyboard and mouse control, and the Handsaw system has the potential to be used effectively by novices and in groups.

Wetpaint: Scraping Through Multi-Layered Images

Conference Paper

Full-text available

Apr 2009

ABSTRACT We introduce a technique for exploring multi-layered images byscraping,arbitrary areas to determine ,meaningful relationships. Our system, called Wetpaint, uses perceptual depth,cues ,to help ,users intuitively navigate between corresponding layers of an image, allowing a rapid assessment of changes ,and relationships between ,different views of the same area. Inspired by art diagnostic techniques, this tactile method ,could have distinct advantages ,in the general domain as shown by our user study. We propose that the physical metaphor ,of scraping ,facilitates the process of determining correlations between layers of an image because itcompresses the process of planning, comparison and annotation into a single gesture. We discuss applications for geography, design, and medicine. Author Keywords Touch Interface, Large Screen, Restoration, Visualization, Tangible User Interface. ACM Classification Keywords

The digital Michelangelo project

Conference Paper

Jan 2000

We describe a hardware and software system for digitizing the shape and color of large fragile objects under non-laboratory conditions. Our system employs laser triangulation rangefinders, laser time-of-flight rangefinders, digital still cameras, and a suite of software for acquiring, aligning, merging, and viewing scanned data. As a demonstration of this system, we digitized 10 statues by Michelangelo, including the well-known figure of David, two building interiors, and all 1,163 extant fragments of the Forma Urbis Romae, a giant marble map of ancient Rome. Our largest single dataset is of the David - 2 billion polygons and 7,000 color images. In this paper, we discuss the challenges we faced in building this system, the solutions we employed, and the lessons we learned. We focus in particular on the unusual design of our laser triangulation scanner and on the algorithms and software we developed for handling very large scanned models.

The virtual dig

Article

Jul 2002

Robert Dunn

The Virtual Dig is an interactive adventure for young people and provides an educational experience in archaeology and historical architecture. The web site was produced for the Israel Museum, Jerusalem, in collaboration with museum archaeologists and can be seen online at the addresses: "http://www.imj.org.il/arc-tel" and "http://www.arcv.org".

The third dimension of “Ritratto di gentiluomo”

Article

Jan 1996

Citizen Science: Can Volunteers Do Real Research?

Article

Sep 2009

JEFFREY P. COHN

Collaborations between scientists and volunteers have the potential to broaden the scope of research and enhance the ability to collect scientific data. Interested members of the public may contribute valuable information as they learn about wildlife in their local communities.

Keepin' it real: Pushing the desktop metaphor with physics, piles and the pen

Conference Paper

Apr 2006

We explore making virtual desktops behave in a more physically realistic manner by adding physics simulation and using piling instead of filing as the fundamental organizational structure. Objects can be casually dragged and tossed around, influenced by physical characteristics such as friction and mass, much like we would manipulate lightweight objects in the real world. We present a prototype, called BumpTop, that coherently integrates a variety of interaction and visualization techniques optimized for pen input we have developed to support this new style of desktop organization.

Transparent Layered User Interfaces: An Evaluation of a Display Design to Enhance Focused and Divided Attention.

Conference Paper

Jan 1995

Collaborative Mixed Reality Visualization of an Archaeological Excavation

Conference Paper

Jan 2004

We present VITA (visual interaction tool for archaeology), an experimental collaborative mixed reality system for offsite visualization of an archaeological dig. Our system allows multiple users to visualize the dig site in a mixed reality environment in which tracked, see-through, head-worn displays are combined with a multi-user, multi-touch, projected table surface, a large screen display, and tracked hand-held displays. We focus on augmenting existing archaeological analysis methods with new ways to organize, visualize, and combine the standard 2D information available from an excavation (drawings, pictures, and notes) with textured, laser range-scanned 3D models of objects and the site itself. Users can combine speech, touch, and 3D hand gestures to interact multimodally with the environment. Preliminary user tests were conducted with archaeology researchers and students, and their feedback is presented here.

Tangible Interfaces for Art Restoration

Abstract and Figures

Recommended publications

Tangible Interfaces for Art Restoration

Wetpaint: Scraping Through Multi-Layered Images

Stop-motion prototyping for tangible interfaces

Wipe-Off: An Intuitive Interface for Exploring Ultra-Large Multi-Spectral Data Sets for Cultural Her...