Content uploaded by Hideyoshi Yanagisawa
Author content
All content in this area was uploaded by Hideyoshi Yanagisawa on Nov 23, 2018
Content may be subject to copyright.
״਼ཀྵϠυϨϱή
غଶްՎʀέϫηϠʖξϩΝৼͶ
Mathematical modeling of perception
with focus on expectation effect and cross-modality
༆ᖔ ऴ٤
Hideyoshi Yanagisawa, PhD
Associate Professor of Design Engineering
Graduate School of Engineering, The University of Tokyo
ཀྵͳ״ؔͶʹΓ͑͵๑ଉ͍͗Ζ͖ʃ
ཀྵ
3K\VLFDO
״
3HUFHSWXDO
Artifacts Human
䠛
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 2
$JHQGD
״અܯָ
.DQVHL GHVLJQHQJLQHHULQJ
غଶްՎཀྵ ʛέϫηϠʖξϩ๑ଉ
([SHFWDWLRQHIIHFWWKHRU\t$ODZRI&URVVPRGDOSHUFHSWLRQ
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 3
״અܯ
.DQVHL GHVLJQ
Loudness
Fluctuation
strength
Sharpness
Roughness
Structure
Behavior
Physical
phenomena Perception Emotion
Meanings
䝣䜯䞁䞉䝰䞊䝍
䝝䜴䝆䞁䜾 㡢䞉ὶయ䞉ື 㡢㡪▱ぬ≉ᚩ
ᚰᆅ䜘䛔
Function/performance
Kansei design
e.g. 䝗䝷䜲䝲䞊
ϠόؽʀͶՅ͓ͱɾਕؔ״ְΏಊͶ͓Ζ
ܨݩʤH[SHULHQFHʥΝଲেͳͤΖઅܯ
Experience
Engineering design
ᛌ
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 4
״અܯָ
.
.DQVHL
GHVLJQHQJLQHHULQJ
״અܯͪΌཀྵɾ๏๑ɾघ๑
״࣯ࢨඬԿ (YDOXDWLRQFULWHULD
״਼ཀྵϠυϨϱή 0DWKHPDWLFDOPRGHOLQJ
״અܯ๏๑ɾࢩԋٗढ़ɾࣰભԢ༽ 0HWKRGDSS
ԽչԽઅܯ ࣙಊӣ҈ৼ״
ࡠकର״
ોࡒʀτέηοϡ࣯״
HJ
6RXQGYLEUDWLRQ 0DWHULDOWH[WXUH %HKDYLRU
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 5
״ࢨඬԿͳ״અܯʤչԽઅܯʥ
3HUFHLYHGTXDOLW\RISURGXFWVRXQG
չԽࢨඬԿͳඬԽઅఈ
અܯմʁ
ుಊૻ෫ؽΝώϋͲΖߑଆͶΓΕ৾ಊઊԓ
ఽୣر༫ིմੵʁ ຌର৾ಊ͗ࢩഓదͶӪڻ
೧ౕೖຌؽփָճৈʤٗढ़ʥ
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 6
ຌ࣯ద͵ୌ $QHVVHQWLDOLVVXH
״൝ʰ1HZWRQbVODZʱࡑ
ଲেͶғଚ͢͵͏ԍ៹Ն͵Ҳൢ๑ଉ
Expectation Effect Theory
Yanagisawa, H. (2016) J. Sens. Stud.
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 7
๑ଉࡠΕ๏ʁ ؾͳԍ៹
,VDDF1HZWRQ
-RKDQQHV.HSOHU
ʰίϕϧʖ๑ଉʱ
ϔϧʖΦ؏υʖνͶخͰ͚
ؾద๏๑ LQGXFWLRQ
˥
͗ʹΓ͑Ͷಊ͚͖
ʰຬ༙Ӏྙ๑ଉʱ
ΝՀఈʤޮཀྵʥͳͪ͢
ԍ៹ద๏๑ GHGXFWLRQ
˥
ରҲൢ͗ɾ͵ͧɾ
ͨΓ͑Ͷಊ͚͖
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 8
7\FKR %UDKH
Size-weight illusion (SWI)
͗͘͠ҡ͵ΖಋҲ॑ྖରΝർֳͤΖͳɾ
ঘ͠͏๏͚͗॑״ͣΖɿ
॑͠ >J@
ʻ
॑͠״>"@
ʾ
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 9
㼣㼑㼕㼓㼔㼠
ᣢ䛱ୖ䛢䜛๓
Prior expectation
ᐇ㝿䛾㔜䛥
=
ᣢ䛱ୖ䛢䛯ᚋ
Posterior perception
<
ண ㄗᕪ䜢㐣ホ౯
ண ㄗᕪ ண ㄗᕪ
<
6L]HZHLJKLOOXVLRQͺ͵ًͧ͞Ζ͖ʃ
ぢ䛯┠䛾㔜䛥
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 10
പϭϱ͗ϭϱͶ
Morrot, G. et al. 2001, Brain and Language.
(Université de Bordeaux)
$QH[DPSOHRIH[SHFWDWLRQHIIHFWFURVVPRGDO
䝷䝧䝹䛷䛾ホ౯䛜ኚ䜟䜛
Plassmann, H. et al. 2008, PNAS.
(CalTech)
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 11
どぬ䛻䜘䜛ᮇᚅ ぢ䛺䛔䛷ᣢ䛱ୖ䛢䜛
䠄ᮇᚅ䛺䛧䠅
㔜䛥
䊻ぢ䛶䛛䜙ᣢ䛱ୖ䛢䜛
䠄ᮇᚅ䛒䜚䠅
ྠ
㼍㼟㼟㼕㼙㼕㼘㼍㼠㼕㼛㼚
ᑐẚ
㼏㼛㼚㼠㼞㼍㼟㼠
ண ㄗᕪ 㼑㼞㼞㼛㼞
ᮇᚅ䛻㏆䛵䛟
ᮇᚅ䛛䜙㞳䜜䜛
䠎✀㢮䛾ᮇᚅຠᯝ 䡚ᑐẚ䛸ྠ
ᑐẚ䠄contrast䠅䠖 ᮇᚅ䛸䛾ᕪ䜢㐣ホ౯
ྠ䠄assimilation䠅䠖 ᮇᚅ䛸䛾ᕪ䜢㐣ᑠホ౯
䠅 㔜䛥䛾▱ぬ
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 12
ಋԿͳଲർʁ ࣎ؔʀۯؔ
ྠ
assimilation
ᑐẚ
contrast
㛫ⓗᩥ⬦
Temp o ra l
✵㛫ⓗᩥ⬦
Spatial
Size ĺweight
Color ĺsmell
Ebbinghaus illusionColor assimilation
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 13
ਈܨෘߺԿݬཀྵ
1HXUDOFRGLQJSULQFLSOHV
T
┿䛾≀⌮㔞
䠄䠊㔜䛥䠅
1
r
2
r
3
r
N
r
䠖
Nಶ䛾⚄⤒⣽⬊
䛾Ⓨⅆ⋡䝧䜽䝖䝹
Firing rate
ˆ
T
R
≀⌮㔞䛾᥎ᐃ
䠄䠊ឤ䛨䜛㔜䛥䠅
Encoding
䠄➢ྕ䠅
Decoding
䠄ྕ䠅
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 14
」ᩘ䛾⚄⤒⣽⬊(population)䛾
Ⓨⅆ⋡ศᕸ䛷≀⌮㔞䜢➢ྕ
Pouget, A., et al. (2000)
Nature Rev. Neurosci.
ˆ
T
Likelihood
Physical Perceptual
ϗζΠϱߺԿ Bayesian decoding
ᮇᚅ ឤぬ
Prior Likelihood
()p
T
▱ぬ
ˆ
T
Posterior
(| )pR
T
(|)pR
T
|(|) () ( )ppRpR
TTT
vu
Prior
䠄ᮇᚅ䠅
Likelihood
䠄ឤぬ䠅
Posterior
䠄▱ぬ䠅
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 15
ᮇᚅ䛸ឤぬ䛾䛡⟬䛷▱ぬ䛜Ỵ䜎䜛䠊
ࣰ֮ͳཛྷ 8QFHUWDLQW\QRLVH
Prior Likelihood
Posterior
()p
T
(| )pR
T
(|)pR
T
p
P
l
P
2
p
V
p
p
☜ᐇᛶ
Uncertainty
እ
Noise
22
ˆl
p
pl
PP
V
TV
v
ศᩓ䛾㏫ᩘ䛻䜘䜛ᮇᚅ್䛾㔜䜏䛡⥺ᙧ
䠄ṇつศᕸ䛻ᚑ䛖ሙྜ䠅
2
l
V
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 16
ᮇᚅ䛸ឤぬ䛾䛖䛱ಙ㢗ᛶ䛜㧗䛔᪉䜢▱ぬ䛩䜛䠊
ࣰ֮ ʾ ཛྷ
ᑬᗘ㛵ᩘ䛻ᐤ䜛
ண 䜘䜚⢭ᗘ䛾䜘䛔ឤぬ䛾᪉䛜㢗䜚䛻䛺䜛
ˆ
T
Prior
☜ᐇ䛺ᮇᚅ
Likelihood
Posterior
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 17
ࣰ֮ ʽ ཛྷ
๓ศᕸ䛻ᐤ䜛
ឤぬ䜘䜚⢭ᗘ䛾䜘䛔ண 䛾᪉䛜㢗䜚䛻䛺䜛
ˆ
T
Prior
☜ᐇ䛺ᮇᚅ Likelihood
Posterior
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 18
ᮇᚅ䛸ឤぬ䛾⥘ᘬ䛝
ްིదෘߺԿ Efficient encoding
๓ศᕸ䛜୍ᵝ䛸௬ᐃ䛾ሙྜ䛾
⚄⤒⣽⬊㞟ᅋ䛾Ⓨⅆ☜⋡ศᕸ
ཀྵۯؔͶ͕͜Ζਈܨࡋ๖܊Ւི֮ා
T
T
() ()Fpxdx
T
T
f
³
)(p
T
T
1
r
2
r
3
r
4
r
5
r
R
Prior
䠄ᮇᚅ䠅
Likelihood
ᮇᚅ್࿘㎶䛻ከ䛟䛾⚄⤒⣽⬊䜢䜚ᙜ䛶䜛䠊⋓ᚓ䛩䜛ሗ㔞䛾᭱
๓ศᕸ䛾〈㔝䛿
ᑬᗘ㛵ᩘ䛜ᕥྑ㠀
ᑐ⛠䛻䜖䛜䜐
1
()F
TT
Wei & Stocker (2015) Nature Neurosci.
Barlow, H. (1961) Sensory Communication, MIT
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 19
਼ౕؖඉଲসͶΓΖൕްՎ
5HSXOVLRQELDVDJDLQVWH[SHFWDWLRQFDXVHVFRQWUDVW
ӷ҄ ⁓⁛ ⁛⁞⁓⁛ ݣൔ ⁕⁓
ˆ
T
ˆ
T
ண ㄗᕪ 㼑㼞㼞㼛㼞 ண ㄗᕪ 㼑㼞㼞㼛㼞
ᮇᚅ್䛻ᘬ䛝ᐤ䛫䜙䜜䜛
䠄ㄏᘬస⏝ attraction bias䠅
ᮇᚅ್䛛䜙㞳䜜䜛
䠄Ⓨస⏝ repulsion bias䠅
prior likelihood
䠄ᑐ⛠䠅
prior likelihood
䠄㠀ᑐ⛠䠅
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 20
غଶͳ״ְ౹ͶΓΖஎְϠυϩ
㻼㼑㼞㼏㼑㼜㼠㼕㼛㼚㻌㼙㼛㼐㼑㼘㻌㼎㼍㼟㼑㼐㻌㼛㼚㻌㼚㼑㼡㼞㼍㼘㻌㼏㼛㼐㼕㼚㼓㻌㼜㼞㼕㼚㼏㼕㼜㼘㼑㼟
㻼㼞㼕㼛㼞㻌㼗㼚㼛㼣㼘㼑㼐㼓㼑
㻼㼞㼕㼛㼞㻌㼕㼚㼒㼛㼞㼙㼍㼠㼕㼛㼚
㻸㼕㼗㼑㼘㼕㼔㼛㼛㼐
㻼㼛㼟㼠㼑㼞㼕㼛㼞
㻿㼠㼕㼙㼡㼘㼕
㻼㼞㼕㼛㼞
㻼㼑㼞㼏㼑㼕㼢㼑㼐
㼜㼔㼥㼟㼕㼏㼍㼘㻌㼢㼍㼘㼡㼑
(| )pR
T
()p
T
T
ˆ
T
(|)pR
T
㻼㼔㼥㼟㼕㼏㼍㼘㻌㼢㼍㼘㼡㼑
㻱㼤㼜㼑㼏㼠㼍㼠㼕㼛㼚
㻿㼑㼚㼟㼍㼠㼕㼛㼚
Körding, K., et al. (2004). Nature.
Bayesian decoding
㼜㼞㼕㼛㼞 㼘㼕㼗㼑㼘㼕㼔㼛㼛㼐
㼜㼛㼟㼠㼑㼞㼕㼛㼞
|(|) () ( )ppRpR
TTT
vu
Wei X et al. (2015) Nat. Neurosci.
T
ˆ
T
Efficient encoding
Yanagisawa, H. (2016) J. Sens. Stud.
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 21
غଶްՎ਼ؖϠυϩ
$IXQFWLRQDOPRGHORIH[SHFWDWLRQHIIHFW
Expectation Effect
Assimilation / contrast
Prediction error
Uncertainty
Noise
f
ᮇᚅ䛸ᐇ㝿䛾ᕪ
ᮇᚅ䛾☜ᐇᛶ
ឤぬ䛻ΰධ䛩䜛እ
ྠ䞉ᑐẚ䠈䛭䛾ᗘྜ䛔
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 22
㼜㼞㼕㼛㼞 㼘㼕㼗㼑㼘㼕㼔㼛㼛㼐
㼜㼛㼟㼠㼑㼞㼕㼛㼞
T
ˆ
T
ಋԿͳଲർড়݇ʤVLPXODWLRQʥ
Expectation effect䠄
䠄ᮇᚅຠᯝ䠅
020 40 60 80 100 120
-1
-0.5
0
0.5
1
1.5
2
Prediction error
䠄ண ㄗᕪ䠖ᮇᚅ䛸ᐇ㝿䛾ᕪ䠅
ᑐẚ 㼏㼛㼚㼠㼞㼍㼟㼠
ྠ 㼍㼟㼟㼕㼙㼕㼘㼍㼠㼕㼛㼚
Yanagisawa, H. (2016) J. Sens. Stud.
ண ㄗᕪ䛾ቑ䛻క䛔䠈ྠ䛛䜙ᑐẚ䛻᥎⛣
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 23
ݗৄࡒྋ Size-weight illusion - SWI
॑͠ >J@
ʻ
॑͠״ʤଲർʥ
ʾ
Charpentier, A (1891). Arch. Physiol. Norm. Pathol.
:
Flanagan, J. R. et al. (2000). Nature Neurosci.
॑͠״ʤಋԿʥ
ʽ
Thesis 䠄ṇ䠅䠖
͢ɾಋԿਫ਼ͣΖ͵Δͻʀʀʀ
Antithesis 䠄䠅䠖
Synthesis 䠄ྜ䠅䠖
ᮇᚅຠᯝ⌮ㄽ Expectation effect theory
Yanagisawa, H. (2016) J. Sens. Stud.
1HZ
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 24
6:,H[SHULPHQWDOUHVXOW
180 280 380 480 580 680 780 880 980 1080
ᑠ䝃䞁䝥䝹䛸ẚ㍑䛧䛯䝃䞁䝥䝹䛾㔜䛥ឤホ౯
䠄
Expectation effect
䠅
ண䛸ᐇ㝿䛾㔜䛥䛾ᕪ䠄
Prediction error
䠅
(g)
small uncertainty & small noise
big uncertainty & small noise
small uncertainty & big noise
big uncertainty & big noise
㔜䛔
-2
䜔䜔㔜䛔
-1
ྠ⛬ᗘ
0
䜔䜔㍍䛔
1
㍍䛔
2
䛝䛔᪉䛜
Yanagisawa, H. (2016) J. Sens. Stud.
ᑐẚ
contrast
ྠ
assimilation
Anti-SWI
䠄䛝䛔᪉䛜㔜䛔䠅
SWI
䠄ᑠ䛥䛔᪉䛜㔜䛔䠅
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 25
எְ͠Η࣯ͪ
࣯ͶଲͤΖغଶ
࣯
ଲർ
༩ޣࠫ
ࣰࡏ࣯
״ಊ
ಋԿ
գঘՃ
غଶްՎқັʁغଶҐ
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 26
҈સͶଲͤΖغଶ
҈સ
ଲർ
༩ޣࠫ
எְ͠Ηͪ҈સ
ࣰࡏ҈સ
ࣨ
ಋԿ
ڒ༲
غଶްՎқັʁغଶҐԾ
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 27
غଶްՎΉͳΌ
ಋԿ
DVVLPLODWLRQ
ଲർ
FRQWUDVW
غଶҐ
([FHHGLQJH[SHFWDWLRQ
ʹ
գঘՃ
˗
״ಊ
غଶҐԾ
%HORZH[SHFWDWLRQ
˕
ڒ༲
ʹʹ
ࣨ
༩ޣࠫ HUURU VPDOO %LJ
ࣰ֮
XQFHUWDLQW\ 6PDOO 6PDOO
ཛྷ QRLVH %LJ 6PDOO
غଶްՎ
غଶͳࠫ
How?
What?
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 28
״ͺغଶͶଲ͢ͱ૮ଲదͲ͍Ζ
7KHRU\RIUHODWLYLW\LQSHUFHSWLRQ
ཀྵ
3K\VLFDO
״
3HUFHSWXDO
αϱτέηφ
&RQWH[WXDO
য়ڱɾڧ
ޛؖܐ
எࣟɾชԿ
࢙ܻ
VWLPXOL
غଶ
H[SHFWDWLRQ
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 29
0HUFLEHDXFRXS͍Ε͗ͳ͑͟͡͏Ήͪ͢
Reality is merely an illusion, albeit a very
persistent one.
…
Physics and psychology are only different
attempts to link our experiences together
by way of systematic thought.
Albert Einstein
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 30
ึଏࣁྋ
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 31
࣯எְͳ͢ͱ״࣯
Ε࣯
0XVWEH
࣯
3HUIRUPDQFH
ຳྙ࣯
$WWUDFWLYH
ैଏ
)XOILOOHG
ଏ
ຮଏ
ޒٮຮଏ
6DWLVILHG
Kano model
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 32
ॄෘߺԿ 3RSXODWLRQFRGLQJ
」
」ᩘ䛾⚄⤒⣽⬊
(
㞟ᅋ
)
䛾Ⓨⅆ⋡ศᕸ䛷≀⌮㔞䜢➢ྕ
⚄⤒⣽⬊䛾Ⓨⅆ⋡ r[Hz]
40ᗘ䛾⚄⤒⣽⬊⩌䛾Ⓨⅆ⋡䛸
ᑬᗘ㛵ᩘ
᪉ྥ䛻ᑐ䛩䜛⚄⤒⣽⬊⩌䛾Ⓨⅆศᕸ
Pouget, A., et al. (2000) Nature Rev. Neurosci.
ˆ
T
ᑬᗘ㛵ᩘ
(|)pR
T
䠅 ື䛝䛾᪉ྥ䛾coding @MT㔝䠄V5䠅
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 33
ߡࡱʁ ༩ޣࠫ
•ঘ͠͵༩ޣࠫͲͺغଶͶಋԿ
–գঘՃʀໃࢻ
–ݸΔΗͪஎࣁݱઇ༁
020 40 60 80 100 120
-1
-0.5
0
0.5
1
1.5
2
ண ㄗᕪ
ᑐẚ
ྠ
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo
•༩ޣ͚ࠫ͗͘͵Ζͳଲർ͗ਫ਼
–״ְྙΰϱΝ͝Ζ
–қͳࣟΝଇ
–న͵ߨಊʤյඈʀંۛʥ
–ָसؽճ
34
ߡࡱʁ ࣰ֮
ࣰ֮͗ঘ͠͏ΆʹغଶްՎکౕ͗͘͏
ܨݩʀஎࣟ͗͵ਕɾ
ۛɾఱܗ͗߶͏ଲেΆʹ
ಋԿʀଲർ͏ͥΗک͚ਫ਼ͣΖɿ
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 35
020 40 60 80 100 120
-1
-0.5
0
0.5
1
1.5
2
ண ㄗᕪ
ᑐẚ
ྠ
ࣰ֮қັ
•༩ɾغଶ৶೨ౕ͏ɿ༩ౕɿ
•ࣰ֮ͶӪڻͤΖҾࢢ
–ਇི֮ාʤྭɾγαϫ YVೖड़๏ֱʥ
–ఱܗɾϕϫφνϕʤ˕˕ͳ͏͓ͻ˕˕ʥ
–ંৰළౕʀۛʤྭɾஎ໌ౕɾϔϧϱχʥ
–ݺਕஎࣟʀܨݩʤྭɾϕϫʀΠϜɾ೧ྺʥ
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 36
༰ࣉͲͺࡪְ͕͗͘Ͷ͚͏
Fig. Discrimination accuracy as a function of real-size
difference and context for four age groups.
Doherty, M. J., Campbell, N. M., Tsuji, H., & Phillips, W. A.
(2010). The Ebbinghaus illusion deceives adults but not
young children. Developmental Science, 13(5), 714-721.
(c) 2018 Hideyoshi Yanagisawa, The University of Tokyo 37