DataPDF Available

Technology in Language Assessment.pdf

Authors:
  • Chambre de commerce et d'industrie de Paris Île-de-France
  • Chambre de commerce et d'industrie de Paris Île de France
Data

Technology in Language Assessment.pdf

Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n
Paris Île - de-Fr a n c e
(Digital) Technology
in Language Testing
Dominique Casanova
Le français des Affaires
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n
Paris Île - de-Fr a n c e
Plan
Introduction
Impact of technology at the main stages
of the test administration process
Revising the equation
Conclusion
Questions
2 04.03.20
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n Pa ris Î l e -de-F r a n c e
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n
Paris Île - de-Fr a n c e
I N T R O D U C T I O N
G R AV I TAT I O N
04.03.20 3
Law of universal gravitation
Einstein field equation
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n
Paris Île - de-Fr a n c e
I N T R O D U C T I O N
T E ST U S E F U LN E S S
04.03.20 4
Bachman & Palmer (1996)
Usefulness = Reliability
+ Construct validity
+ Authenticity
+ Interactiveness
+ Impact
+ Practicality
+ 3 principles
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n
Paris Île - de-Fr a n c e
I N T R O D U C T I O N
T E EC HN O L O G Y
04.03.20 5
Collins Dictionary
Technology refers to methods, systems, and devices which are the
result of scientific knowledge being used for practical purposes.
Cambridge Dictionary
B1 (the study and knowledge of) the practical, especially industrial, use of
scientific discoveries:
computer technology
Modern technology is amazing, isn't it?
What this country needs is a long-term policy for investment in science and technology.
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n
Paris Île - de-Fr a n c e
I N T R O D U C T I O N
T E EC HN O L O G Y I N LT : A N O LD S TO RY
04.03.20 6
Technology
Efficiency, quality
Appropriatness
General
Specific
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n
Paris Île - de-Fr a n c e
Appropriatness:
Impact of technology at the
main stages of the test
administration process
Main stages
90’s organization
Tomorrow’s competition
7 04.03.20
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n Pa ris Î l e -de-F r a n c e
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n
Paris Île - de-Fr a n c e
I M P A C T O F T E C H N O L O G Y
M A IN S TA GE S
04.03.20 8
Test delivery
Registration process
Communication
of the results
Scoring
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n
Paris Île - de-Fr a n c e
I M P A C T O F T E C H N O L O G Y
R E GI ST R A T I O N P R O C E S S
Test delivery
Registration process
Communication
of the results
Scoring
9
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n
Paris Île - de-Fr a n c e
I M P A C T O F T E C H N O L O G Y
T E ST D E L I V E RY
Test delivery
Registration process
Communication
of the results
Scoring
10
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n
Paris Île - de-Fr a n c e
I M P A C T O F T E C H N O L O G Y
S C OR I N G A ND R E S U LT S
Test delivery
Registration process
Communication
of the results
Scoring
11
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n
Paris Île - de-Fr a n c e
I M P A C T O F T E C H N O L O G Y
B E T W E E N T H E S T A G E S
Test delivery
Registration
Communication
of the results Scoring
12
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n
Paris Île - de-Fr a n c e
I M P A C T O F T E C H N O L O G Y
9 0 ’ S O R G A N S AT I O N
Registration
Test taking
Results
Language tester
Language Assessment
Authorized Centre
13
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n
Paris Île - de-Fr a n c e
I M P A C T O F T E C H N O L O G Y
T O M O R R O W ’ S C O M P E T I T I O N
Language tester
Proctor
(Online Examiner)
Candidate
Registration,
Test Taking,
Results
14
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n
Paris Île - de-Fr a n c e
I M P A C T O F T E C H N O L O G Y
T O M O R R O W ’ S C O M P E T I T I O N
Test office
Test taking
Registration, Results
Recordings
Language tester
15
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n
Paris Île - de-Fr a n c e
Efficiency&Quality:
Revision of the equation
Test usfuleness revisited
Impact of digital technology on
usual terms of the equation
New terms of the equation
16 04.03.20
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n Pa ris Î l e -de-F r a n c e
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n
Paris Île - de-Fr a n c e
R E V I S I O N O F T H E E Q U A T I O N
T E ST U S E F U LN E S S R E V I S I T E D
Usefulness = Reliability + Security
+ Construct validity
+ Authenticity
+ Interactiveness
+ Impact
+ Practicality + Standardisation
+ Availability
17
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n
Paris Île - de-Fr a n c e
AI bot
R E V I S I O N O F T H E E Q U A T I O N
U S UA L TE R M S
Reliability
- Automated scoring
- Automated rating ?
- Automated screening ?
NLP
Construct validity
- Digitalized Corpora
validation studies
- Automated conception
Authenticity &
Interactiveness
- Item formats
- Test format
Practicality
- Space (centre, home)
- Equipment (computer, bandwidth, recordings)
- Administering time (oral production / interaction)
- Human resources (examiners)
18
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n
Paris Île - de-Fr a n c e
R E V I S I O N O F T H E E Q U A T I O N
AV A I L AB I L I T Y A N D A CC ES S I B I L I T Y
Test availability
Wherever I live? (home, work, post-office…)
Whenever I want? (on demand test sessions)
What services? (registration, delivery, results…)
Accessibility / special needs adaptivity
Items & test format
Available tools (magnifier, volume…)
Specific formats
19
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n
Paris Île - de-Fr a n c e
R E V I S I O N O F T H E E Q U A T I O N
S E C U R I T Y
Credit: Indian Express Credit: CNN
Credit: DHgate
20
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n
Paris Île - de-Fr a n c e
R E V I S I O N O F T H E E Q U A T I O N
S TA ND A R D I S AT I O N
Equipment
Testing conditions
- Sound insulation
Technical incidents
- audio/video quality
- speed of Internet for online tests
Practicality
Reliability
Fairness
21
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n
Paris Île - de-Fr a n c e
Conclusion
22 04.03.20
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n Pa ris Î l e -de-F r a n c e
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n
Paris Île - de-Fr a n c e
QUESTIONS?
dcasanova@cci-paris-idf.fr
23 04.03.20
Chambre de c ommerc e et d ’in d u s t r i e de r é g i o n Pa ris Î l e -de-F r a n c e

File (1)

ResearchGate has not been able to resolve any citations for this publication.
ResearchGate has not been able to resolve any references for this publication.