PresentationPDF Available

Ensuring Human Intelligence in Artificial Intelligence (AI) Hiring Tools: A Mixed Methods Exploration to the Current Impacts and Challenges of Algorithmic Hiring

Authors:
  • findhr - impactmania

Abstract

Fairness and Intersectional Non-Discrimination in Human Recommendation https://findhr.eu/wp-content/uploads/2024/01/FINDHR-Expert-Report_by-Paksy-Plackis-Cheng-et-al.pdf funded by EU https://cordis.europa.eu/project/id/101070212




BACK
GROUND
Paksy Plackis-Cheng (grad. Erasmus University Rotterdam)
impactmania, founder
created and led interdisciplinary programs for University of California, Santa Barbara,
Messaggero Veneto Scuola, U.S. Consulate, global corporations.
Staex GmbH, chief strategy officer
reliable and secure data infrastructure for intelligent machines
German Entrepreneurship GmbH, official start-up mentor
funded by German Federal Ministry of Economic Affairs and Climate Action
AI HIRING
INITIATIVE
• Gain a better understanding of the current use of AI in hiring
practices.
• Test resumes in Applicant Tracking System (ATS)
• Investigate job seekers’ experiences with AI hiring tools.


LABOR MARKET
 !"
#$#%$%$
%"%#%
"
&!&'#$$
($"
%)!)(!
$!"
AI Exacerbates the “Hidden” Workforce Challenge
*screen out many qualied
candidates !
'!+,($%"(
-).")"
/0$%
$%.12!"
34'5-"' 6'()32('1/7/8"*%."(-)9 4*%"
FIRSTHAND
EXPERT
KNOWLEDGE
A total of 110 participants
88 applicants uploaded their
resumes of which
23 people were interviewed
(mix of 1:1 interviews, focus
groups, questionnaire).
In addition, 22 expert interviews
were conducted with leading
talent intelligence tech
companies, global talent
solution firm, and corporate
Diversity & Inclusion- and
Talent Acquisition leaders.
PARTICIPANTS
QUESTIONS
ASKED —
JOB
APPLICANTS
1. Please describe one of your recent job search experiences.
2. Were you aware during the process that AI tools were used in sourcing
and selecting candidates for interviews?
3. How do you know this? How did you experience this?
4. Have you done anything differently because of this experience? What?
5. Recommendations on how to go about finding jobs that are a fit?
QUESTIONS
ASKED —
AI & TALENT
INTELLIGENCE
EXPERTS
1. What is your experience working w/ AI hiring tools? Please provide an
example.=
2. How do you minimize bias and discrimination in the hiring process?
3. How do you minimize bias working w/ AI hiring tools?
4. What do you recommend to current job seekers with respect to uploading
resumes (optimize search and qualification for invitation to interview).
5. Any other surprises working w/ AI hiring tools?
QUESTIONS
ASKED —
TALENT
ACQUISITION
LEADERS
1. What is your initial screening process?
2. What is your experience working w/ AI hiring tools? Please provide an
example.=If not working w/ AI tools, why not?
If yes, how are you using AI tools to find the right candidates you are looking
for?=
3. If you work w/would like to work w/ AI tools, what would you ideally want
from an AI tool?=
4. How do you actively minimize bias and discrimination in the hiring
process? How do you minimize bias working w/ AI tools?=
5. What do you recommend to current job seekers with respect to uploading
resumes (optimize search and qualification for invitation to interview).
JOB APPLICANTS
“I sent out before receiving only one interview in Berlin which
resulted in my current job. 
 , I still
heard back from less than 10% of the companies I applied to...” - 
“I strategically chose to use my middle name on my resume to enhance my career
prospects. Operating under the name Melissa.., !"#
! $
%3
!&'( 
 ' !
 )*but did not hear back from any. !
! * + 
  !,. It was an eye-
opening experience for me, and disheartening when I saw other peers, with a less
ful&lling career trajectory receive call-backs for interviews. I am leaving Europe at this
point.” 39
EXPERIMENTS
Experiment I (A)
::
!);3$'<9=>
=%
Experiment I (B)
::
$%
)!)
=" '?'.@
Experiment II

$!
)#9'A'
!53'9&"
EXPERIMENT
I(A)


EXPERIMENT
I(B)
$%)!)
9 BBC
=$B(D
)C


EXPERIMENT
II
=%)!)(#$C


 !"#
$
%"& 
 
"'
(&)*+#
!,+&-
"
&"#


FINDINGS
.&/saw a similar ratio %
 #0123
%4#
.5/&)*+
#
The ranking of identical job applicants can yield distinct outcomes, inuenced
by the machine learning derived from various historical datasets. 
.&/6&)*.7/
8&%$#8&&%$
9 
#&)*8$%
$8
#
High Likelihood of Bias Towards Migrant. :
; a
notable 80% of international resumes receiving lower rankings.
RECOMMENDATIONS
Short-term Recommendaons for Corporaons
!)"$#$E
)"D%@'
$#<
Long-term Recommendaons for Policymakers
!#!#%F&B#
9-!!
&!=.#
RECOMMENDATIONS
(('!3$
#&#!"$&('
'"?!$$(($
!"
464G=6HEE"E$
3EE/7/IE78E4G=6336J#!
39%!39%333"
Initiative to minimize systemic -, human -,
and computational biases in algorithmic
recruitment tools.
For more info:
https://www.impactmania.com/im/ai-hiring-eu/
https://www.linkedin.com/in/paksy/
paksy@impactmania.com
Berlin, July 5, 2023
ResearchGate has not been able to resolve any citations for this publication.
ResearchGate has not been able to resolve any references for this publication.