User comparisons of personal and AI performance based on accuracy improvements between Stage 2 and Stage 4

User comparisons of personal and AI performance based on accuracy improvements between Stage 2 and Stage 4

Source publication
Preprint
Full-text available
Human-AI collaboration for decision-making strives to achieve team performance that exceeds the performance of humans or AI alone. However, many factors can impact success of Human-AI teams, including a user's domain expertise, mental models of an AI system, trust in recommendations, and more. This work examines users' interaction with three simula...

Context in source publication

Context 1
... perceived performance level of the AI-Assistant may have impacted users' trust or reliance on the AI-Assistant's recommendations during Stage 4. Figure 8 shows user ratings of the AI-Assistant for users whose performance improved from Stage 2 to Stage 4 versus users whose performance degraded from Stage 2 to Stage 4. Of the eleven users whose performance degraded, five rated the AI-Assistant performance similarly to themselves, five rated the AI-Assistant lower, and one rated the AI-Assistant higher. This resulted in a mean rating of their own performance (¯ í µí±¥ = 3.55) ...

Similar publications

Preprint
Full-text available
People spend a significant amount of time trying to make sense of the internet, collecting content from a variety of sources and organizing it to make decisions and achieve their goals. While humans are able to fluidly iterate on collecting and organizing information in their minds, existing tools and approaches introduce significant friction into...