Content uploaded by André Körner
Author content
All content in this area was uploaded by André Körner on Aug 06, 2018
Content may be subject to copyright.
www.allpsy2.de1
André Körner & Marc Urban∙General Psychology and Biopsychology ∙Chemnitz University of Technology, Germany
XXVIII. Annual Conference of the European
Association of Psychology and Law
Turku (FIN), June 26-29, 2018
Detecting Deception in Insurance Claims –
How Effective are Verifiability Approach and
Model Statement?
André Körner & Marc Urban
Chemnitz University of Technology, Germany, Chair for General Psychology and Biopsychology
www.allpsy2.de2
André Körner & Marc Urban∙General Psychology and Biopsychology ∙Chemnitz University of Technology, Germany
Agenda
Detecting Deception in Insurance Claims
Verifiability Approach and Model Statement
Implications, outlook
Methods, Coding Procedure
Results
Short introduction to insurance claims, VA
www.allpsy2.de3
André Körner & Marc Urban∙General Psychology and Biopsychology ∙Chemnitz University of Technology, Germany
Agenda
Detecting Deception in Insurance Claims
Verifiability Approach and Model Statement
Implications, outlook
Short introduction to insurance claims, VA
Methods, Coding Procedure
Results
www.allpsy2.de4
André Körner & Marc Urban∙General Psychology and Biopsychology ∙Chemnitz University of Technology, Germany
•estimated total loss of 4-5 billion EUR per year due to fraudulent
claims (Gesamtverband der Deutschen Versicherungswirtschaft e.V., 2017)
•insurance fraud is seen as a peccadillo (Knoll, 2011)
•easy opportunity for insurance fraud
in liability insurance and household insurance
(John, 2011)
•often incorrect knowledge about the product “insurance” (Knoll, 2011)
Why does insurance fraud (in Germany) matters?
Detecting Deception in Insurance Claims
Verifiability Approach and Model Statement
www.allpsy2.de5
André Körner & Marc Urban∙General Psychology and Biopsychology ∙Chemnitz University of Technology, Germany
Scientific findings for verbal reports –thus far
•without additional tools: no reliable discrimination between
deception and truth by lay persons or professionals
(Bond & DePaulo, 2006; Vrij, 2008)
•Criteria Based Contents Analysis (CBCA) or Reality Monitoring (RM):
Discrimination Accuracy ≈ 70% (Oberlader et al., 2016)
•Verifiability Approach (Nahari, Vrij & Fischer, 2014) in an insurance setting:
with Information Protocol (IP): Discrimination Accuracy = 80%
(Harvey, Vrij, Nahari, & Ludwig, 2016)
with IP and Model Statement (MS): Discrimination Accuracy = 90%
(Harvey, Vrij, Leal, Lafferty, & Nahari, 2017)
Detecting Deception in Insurance Claims
Verifiability Approach and Model Statement
www.allpsy2.de6
André Körner & Marc Urban∙General Psychology and Biopsychology ∙Chemnitz University of Technology, Germany
•Verbal veracity tool: examines frequency of checkable details in statements
truth-tellers
liars withhold
checkable
information
tell it all
provide many details to
appear credible
vs.
minimize risk
to get caught lying
Information
Management Dilemma
Different verbal strategies
What is the Verifiability Approach (VA)?
Detecting Deception in Insurance Claims
Verifiability Approach and Model Statement
www.allpsy2.de7
André Körner & Marc Urban∙General Psychology and Biopsychology ∙Chemnitz University of Technology, Germany
How to ‘stretch’ the difference between lie & truth
Information Protocol
•informs about the importance of including checkable information
(Nahari et al. 2014b)
•components: reporting, analysis, definition, falsifiability (Harvey et al. 2017)
Verifiable Details are:
i) Activities carried out with identifiable or named persons who the
interviewer can consult
ii) Activities that have been witnessed by identifiable or named persons
who the interviewer can consult
iii) Activities that the interviewee believes may have been captured on CCTV
iv) Activities that may have been recorded or documented, such as using
debit cards, mobile phones, or computers.
Detecting Deception in Insurance Claims
Verifiability Approach and Model Statement
www.allpsy2.de8
André Körner & Marc Urban∙General Psychology and Biopsychology ∙Chemnitz University of Technology, Germany
How to ‘stretch’ the difference between lie & truth
Information Protocol
•informs about the importance of including checkable information
(Nahari et al. 2014b)
•components: reporting, analysis, definition, falsifiability (Harvey et al. 2017)
Model Statement
•detailed example of an unrelated topic (Leal, Vrij, Warmelink, Vernham & Fisher, 2015)
•reference point for richness of detail and length
•in conjunction with IP: better understanding of verifiable details
•translated version (Harvey et al. 2017): 378 words, 49 verifiable details
Detecting Deception in Insurance Claims
Verifiability Approach and Model Statement
www.allpsy2.de9
André Körner & Marc Urban∙General Psychology and Biopsychology ∙Chemnitz University of Technology, Germany
•1: truth tellers will report more verifiable details than liars.
•2: liars will report more unverifiable details than truth tellers.
•3: truth tellers will show a higher percentage of verifiable details
(verifiable details/ total details).
•4: When using the predictor “percentage of verifiable details”,
the Verifiability Approach achieves a higher diagnostic efficacy in the
condition “IP + MS” than in the condition “IP”.
•Pre-Registration: www.osf.io/v3at5
Hypotheses
Detecting Deception in Insurance Claims
Verifiability Approach and Model Statement
www.allpsy2.de10
André Körner & Marc Urban∙General Psychology and Biopsychology ∙Chemnitz University of Technology, Germany
Agenda
Detecting Deception in Insurance Claims
Verifiability Approach and Model Statement
Implications, outlook
Short introduction to insurance claims, VA
Results
Methods, Coding Procedure
www.allpsy2.de11
André Körner & Marc Urban∙General Psychology and Biopsychology ∙Chemnitz University of Technology, Germany
Design
•
2 (Veracity: truth vs lie) x 3 (Intervention: IP vs IP+MS vs MS)
between-subjects design
Procedure
•
online-study (PC or Laptops)
•
Incentives
(3 x 50,- EUR Amazon voucher, course credit, SurveyCircle points)
•
quasi-experimental: veracity
(“Has any item of yours, worth between 100 and 1000,- EUR, been lost,
damaged or stolen in the last three years?”)
•
imagine to submit a genuine or fabricated insurance claim
•
randomized: intervention
•
task: writing free report, being as detailed as possible.
Convince the human analyst of being truthful.
•
… demographic information, post-interview-questionnaire
Methods: Designing an VA online study
Detecting Deception in Insurance Claims
Verifiability Approach and Model Statement
www.allpsy2.de12
André Körner & Marc Urban∙General Psychology and Biopsychology ∙Chemnitz University of Technology, Germany
Methods: (Quasi)-experimental design
Randomization
Intervention
IP IP + MS MS
Quasi-experimental
Veracity
Truth 20 20 20
Lie 20 20 20
Detecting Deception in Insurance Claims
Verifiability Approach and Model Statement
www.allpsy2.de13
André Körner & Marc Urban∙General Psychology and Biopsychology ∙Chemnitz University of Technology, Germany
Analyzed
Sample
•
N= 120 persons; 76 female, 42 males, 2 not specified
•
Age between 18 and 66 years, Mage = 26.37 (SD = 7.97)
•
71.7% students, 25% employed, 0.8% pupils, 2.5 % not specified
Coding:
procedure
and
training
1. identifying “information units” using RM criteria
(Vrij, 2008)
•perceptual details, spatial details, temporal details
•activities were considered perceptual details
2. categorization into verifiable vs. unverifiable details
•criteria as presented in the IP
coder training:
•consulting with experienced German expert
•content: background literature RM, written definitions and
examples, practice with sample texts, discussions and further
differentiations.
Methods: Sample and subsequent coding
Detecting Deception in Insurance Claims
Verifiability Approach and Model Statement
www.allpsy2.de14
André Körner & Marc Urban∙General Psychology and Biopsychology ∙Chemnitz University of Technology, Germany
Usage of MAXQDA as a coding tool
Detecting Deception in Insurance Claims
Verifiability Approach and Model Statement
www.allpsy2.de15
André Körner & Marc Urban∙General Psychology and Biopsychology ∙Chemnitz University of Technology, Germany
Agenda
Detecting Deception in Insurance Claims
Verifiability Approach and Model Statement
Results
Short introduction to insurance claims, VA
Implications, outlook
Methods, Coding Procedure
www.allpsy2.de16
André Körner & Marc Urban∙General Psychology and Biopsychology ∙Chemnitz University of Technology, Germany
Veracity
manipulation
check
•
Truthful claimants: high overall truthful rating (11p scale)
(M = 9.20, SD = 2.50)
•
Deceptive claimants had significantly lower truthful ratings
(M = 4.08 , SD = 3.32 )
•
t(109.760) = 9.54, p < 0.001, d = 1.74
Motivation
•
Reported motivation of the participants was high (7p scale)
(M = 5.63, SD = 1.04)
•
No main effect for Veracity or Intervention; no interaction effect
Word count
•
On average: 202 words (SD = 126); Mfabricated = 250; Mtruth = 176
•
Main effect for veracity: F(1,114) = 6.22, ηp2= .05, p = .014
•
Main effect for intervention: F(2, 114) = 6.846, ηp2= .11, p = .002
•
No significant Veracity x Intervention interaction effect.
Manipulation Checks
Detecting Deception in Insurance Claims
Verifiability Approach and Model Statement
www.allpsy2.de17
André Körner & Marc Urban∙General Psychology and Biopsychology ∙Chemnitz University of Technology, Germany
Results & trends after coding (thus far)
Detecting Deception in Insurance Claims
Verifiability Approach and Model Statement
IP IP+MS MS
truth false truth false truth false
N
o of details 17.15 (8.71)
20.65 (14.30)
21.05 (9.85)
32.20 (12.12)
31.30 (17.27)
29.45 (15.97)
Verifiable
details
9.50 (9.47)
15.80 (13.45)
14.00 (11.44)
18.55 (13.80)
20.35 (16.26)
16.75 (18.91)
Non
-verifiable
details
7.65 (6.81) 4.85 (5.58) 7.05 (8.11)
13.65 (11.20)
10.05 (11.41)
12.70 (11.95)
verifiable details/
total details
0.48 (0.41) 0.69 (0.36) 0.64 (0.37) 0.56 (0.32) 0.61 (0.36) 0.50 (0.39)
Note. All values are Means (SD) for the coded texts in the given cells.
www.allpsy2.de18
André Körner & Marc Urban∙General Psychology and Biopsychology ∙Chemnitz University of Technology, Germany
0. Truth tellers do NOT tell more details - overall
Detecting Deception in Insurance Claims
Verifiability Approach and Model Statement
0
10
20
30
40
IP IP+MS MS
mean frequence
number of details TOTAL true
false
Veracity: F = 3.04 ηp2= .026
Intervention: F = 7.63* ηp2= .118
A x B: F = 2.38 ηp2= .040
www.allpsy2.de19
André Körner & Marc Urban∙General Psychology and Biopsychology ∙Chemnitz University of Technology, Germany
1. Truth tellers do NOT give more verifiable details - overall
Detecting Deception in Insurance Claims
Verifiability Approach and Model Statement
0
10
20
30
40
IP IP+MS MS
mean frequence
number of details - VERIFIABLE true
false
Veracity: F = 0.87 ηp2= .008
Intervention: F = 1.70 ηp2= .030
A x B: F = 1.38 ηp2= .024
www.allpsy2.de20
André Körner & Marc Urban∙General Psychology and Biopsychology ∙Chemnitz University of Technology, Germany
2. Liars do NOT give more non-verifiable details
Detecting Deception in Insurance Claims
Verifiability Approach and Model Statement
Veracity: F = 1.14 ηp2= .010
Intervention: F = 3.70* ηp2= .061
A x B: F = 2.44 ηp2= .041
0
10
20
30
40
IP IP+MS MS
mean frequence
number of details - NON-VERIFIABLE true
false
www.allpsy2.de21
André Körner & Marc Urban∙General Psychology and Biopsychology ∙Chemnitz University of Technology, Germany
3. Truth tellers do NOT show a higher percentage of verifiable details
Detecting Deception in Insurance Claims
Verifiability Approach and Model Statement
0
1
IP IP+MS MS
mean frequence
verifiable details / total details true
false
Veracity: F = 0.00 ηp2= .000
Intervention: F = 0.17 ηp2= .003
A x B: F = 2.20 ηp2= .037
www.allpsy2.de22
André Körner & Marc Urban∙General Psychology and Biopsychology ∙Chemnitz University of Technology, Germany
Agenda
Detecting Deception in Insurance Claims
Verifiability Approach and Model Statement
Implications, outlook
Short introduction to insurance claims, VA
Methods, Coding Procedure
Results
www.allpsy2.de23
André Körner & Marc Urban∙General Psychology and Biopsychology ∙Chemnitz University of Technology, Germany
Scientific findings –where to go?
•VA with it’s various types is a promising tool
for lie detection in insurance claims
•At least in German: VA is a tricky thing?
•Rather artificial design: Verifiable details may lead to conviction in real life
•Wait for final coding by decision
•Pre-Registration is a must have
•Maybe highly dependent on language
•Need for multi-center studies, normalize coding procedure
•Chance for specific algorithm for a first screening
(e.g. Srour, Py, & Maillot in this session)?
Detecting Deception in Insurance Claims
Verifiability Approach and Model Statement
www.allpsy2.de24
André Körner & Marc Urban∙General Psychology and Biopsychology ∙Chemnitz University of Technology, Germany
Thanks for your attention
http://imgur.com/ccZ1F
XXVIII. Annual Conference of the European
Association of Psychology and Law
Turku (FIN), June 26-29, 2018
www.allpsy2.de25
André Körner & Marc Urban∙General Psychology and Biopsychology ∙Chemnitz University of Technology, Germany
Sources
Bond, C. F., & DePaulo, B. M. (2006). Accuracy of deception judgments. Personality and social psychology review : an official journal of the
Society for Personality and Social Psychology, Inc, 10(3), 214–234. https://doi.org/10.1207/s15327957pspr1003_2
Harvey, A. C., Vrij, A., Leal, S., Lafferty, M., & Nahari, G. (2017). Insurance based lie detection: Enhancing the verifiability approach with a model
statement component. Acta psychologica, 174, 1–8. https://doi.org/10.1016/j.actpsy.2017.01.001
Harvey, A. C., Vrij, A., Nahari, G., & Ludwig, K. (2016). Applying the Verifiability Approach to insurance claims settings: Exploring the effect of the
information protocol. Legal and Criminological Psychology, 22(1), 47–59. https://doi.org/10.1111/lcrp.12092
John, K. (Stand 2011). Versicherungsbetrug: aktuelle Entwicklungen, Muster und ihre Abwehr. Pressekonferenz des Gesamtverbandes der
Deutschen Versicherungswirtschaft e.V. Retrieved from http://www.gdv.de/wp-
content/uploads/2011/11/PK_Versicherungsbetrug_2011_Praes1_Versicherungsbetrug_in_Deutschland_GfK_KarstenJohn_n4.pdf
Gesamtverband der Deutschen Versicherungswirtschaft e.V. 2017
Knoll, J. (2011). Management von Betrugsrisiken in Versicherungsunternehmen (1. Aufl. 2011). Baden-Baden: Nomos.
https://doi.org/10.5771/9783845232874
Leal, S., Vrij, A., Warmelink, L., Vernham, Z., & Fisher, R. P. (2015). You cannot hide your telephone lies: Providing a model statement as an aid to
detect deception in insurance telephone calls. Legal and Criminological Psychology, 20(1), 129–146. https://doi.org/10.1111/lcrp.12017
Nahari, G., Vrij, A., & Fisher, R. P. (2014a). Exploiting liars' verbal strategies by examining the verifiability of details. Legal and Criminological
Psychology, 19(2), 227–239. https://doi.org/10.1111/j.2044-8333.2012.02069.x
Nahari, G., Vrij, A., & Fisher, R. P. (2014b). The Verifiability Approach: countermeasures facilitate its ability to discriminate between truths and
lies. Applied Cognitive Psychology, 28(1), 122–128. https://doi.org/10.1002/acp.2974
Oberlader, V. A., Naefgen, C., Koppehele-Gossel, J., Quinten, L., Banse, R., & Schmidt, A. F. (2016). Validity of content-based techniques to
distinguish true and fabricated statements: A meta-analysis. Law and human behavior, 40(4), 440–457.
https://doi.org/10.1037/lhb0000193
Vrij, A. (2008). Detecting lies and deceit: Pitfalls and opportunities (2nd ed.). Wiley series in the psychology of crime, policing and law. Chichester,
England, Hoboken, NJ: John Wiley & Sons.
Detecting Deception in Insurance Claims
Verifiability Approach and Model Statement