Valerie L. Shalin

Valerie L. Shalin
Wright State University | WSU · Department of Psychology

Ph.D.

About

145
Publications
40,507
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
2,261
Citations
Additional affiliations
August 2018 - present
Wright State University
Position
  • Professor (Full)
September 1978 - December 1985
University of Pittsburgh
Position
  • Research Assistant
January 1986 - August 1990
Honeywell
Position
  • Group Leader

Publications

Publications (145)
Preprint
Full-text available
Telegram emerged as a crucial platform for both parties during the conflict between Russia and Ukraine. Per its minimal policies for content moderation, Pro-Kremlin narratives and potential misinformation were spread on Telegram, while anti-Kremlin narratives with related content were also propagated, such as war footage, troop movements, maps of b...
Article
The lack of explainability in using relevant clinical knowledge hinders the adoption of artificial intelligence-powered analysis of unstructured clinical dialogue. A wealth of relevant, untapped Mental Health (MH) data is available in online communities, providing the opportunity to address the explainability problem with substantial potential impa...
Preprint
Full-text available
During Russia's invasion of Ukraine in February 2022, Telegram became an essential social media platform for Kremlin-sponsored propaganda dissemination. Over time, Anti-Kremlin Russian opposition channels have also emerged as a prominent voice of dissent against the state-sponsored propaganda. This study examines the dynamics of Anti-Kremlin conten...
Preprint
Full-text available
Several decades of research have investigated neural connections between stroke-induced brain damage and language difficulties. Typically, lesion-symptom mapping (LSM) studies addressing this connection have relied on mass univariate statistics, which do not account for intricate, multidimensional relationships between variables. Machine learning (...
Preprint
Full-text available
Background Mild cognitive impairment (MCI) is a prevalent condition among older adults and a potential marker for dementia. The current challenge lies in diagnosing MCI among healthy older populations. This diagnosis typically requires extensive neuropsychological evaluations using tools like the Mini-Mental State Examination (MMSE) or the MoCA (Mo...
Article
Grounding is a challenging problem, requiring a formal definition and different levels of abstraction. This article explores grounding from both cognitive science and machine learning perspectives. It identifies the subtleties of grounding, its significance for collaborative agents, and similarities and differences in grounding approaches in both c...
Preprint
The prevalence of smart devices with the ability to capture moments in multiple modalities has enabled users to experience multimodal information online. However, large Language (LLMs) and Vision models (LVMs) are still limited in capturing holistic meaning with cross-modal semantic relationships. Without explicit, common sense knowledge (e.g., as...
Article
A hallmark of intelligence is the ability to use a familiar domain to make inferences about a less familiar domain, known as analogical reasoning. In this article, we delve into the performance of large language models (LLMs) in dealing with progressively complex analogies expressed in unstructured text. We discuss analogies at four distinct levels...
Preprint
Full-text available
A hallmark of intelligence is the ability to use a familiar domain to make inferences about a less familiar domain, known as analogical reasoning. In this article, we delve into the performance of Large Language Models (LLMs) in dealing with progressively complex analogies expressed in unstructured text. We discuss analogies at four distinct levels...
Preprint
Full-text available
Psycholinguistic analyses provide a means of evaluating large language model (LLM) output and making systematic comparisons to human-generated text. These methods can be used to characterize the psycholinguistic properties of LLM output and illustrate areas where LLMs fall short in comparison to human-generated text. In this work, we apply psycholi...
Preprint
The summarization of conversation, that is, discourse over discourse, elevates pragmatic considerations as a pervasive limitation of both summarization and other applications of contemporary conversational AI. Building on impressive progress in both semantics and syntax, pragmatics concerns meaning in the practical sense. In this paper, we discuss...
Article
High-quality human annotations are necessary for creating effective machine learning-driven stream processing systems. We study hybrid stream processing systems based on a Human-In-The-Loop Machine Learning (HITL-ML) paradigm, in which one or many human annotators and an automatic classifier (trained at least partially by the human annotators) labe...
Article
Online platforms have become an increasingly prominent means of communication. Despite the obvious benefits to the expanded distribution of content, the last decade has resulted in disturbing toxic communication, such as cyberbullying and harassment. Nevertheless, detecting online toxicity is challenging due to its multi-dimensional, context sensit...
Article
Full-text available
Background In clinical diagnostic interviews, mental health professionals (MHPs) implement a care practice that involves asking open questions (eg, “What do you want from your life?” “What have you tried before to bring change in your life?”) while listening empathetically to patients. During these interviews, MHPs attempted to build a trusting hum...
Preprint
Full-text available
As the role of online platforms has become increasingly prominent for communication, toxic behaviors, such as cyberbullying and harassment, have been rampant in the last decade. On the other hand, online toxicity is multi-dimensional and sensitive in nature, which makes its detection challenging. As the impact of exposure to online toxicity can lea...
Article
Common ground processes [26] can improve performance in communication tasks [72, 42, 43, 24], and understanding these processes will likely benefit human--computer dialogue interfaces. However, there are multiple proposed theories with different implications for interface design. Fusaroli and Tylén [40] achieved a direct comparison by designing two...
Article
Full-text available
Background Hand motion analysis by video recording during surgery has potential for evaluation of surgical performance. The aim was to identify how technical skill during open surgery can be measured unobtrusively by video recording during a surgical procedure. We hypothesized that procedural-step timing, hand movements, instrument use and Shannon...
Preprint
Full-text available
Dementia is a group of irreversible, chronic, and progressive neurodegenerative disorders resulting in impaired memory, communication, and thought processes. In recent years, clinical research advances in brain aging have focused on the earliest clinically detectable stage of incipient dementia, commonly known as mild cognitive impairment (MCI). Cu...
Chapter
The convenience of social media has also enabled its misuse, potentially resulting in toxic behavior. Nearly 66% of internet users have observed online harassment, and 41% claim personal experience, with 18% facing severe forms of online harassment. This toxic communication has a significant impact on the well-being of young individuals, affecting...
Preprint
Full-text available
The convenience of social media has also enabled its misuse, potentially resulting in toxic behavior. Nearly 66% of internet users have observed online harassment, and 41% claim personal experience, with 18% facing severe forms of online harassment. This toxic communication has a significant impact on the well-being of young individuals, affecting...
Preprint
Full-text available
High-quality human annotations are necessary for creating effective machine learning-driven stream processing systems. We study hybrid stream processing systems based on a Human-In-The-Loop Machine Learning (HITL-ML) paradigm, in which one or many human annotators and an automatic classifier (trained at least partially by the human annotators) labe...
Article
We present a theoretically motivated design perspective, challenges, and applications of next-generation artificial intelligence (AI) systems. We envision systems with greater capabilities for meaningful human interaction, including socially adaptive behavior that incorporates personalization and sensitivity to social context and intentionality. Pe...
Article
Full-text available
This resource was created to support researchers who might be newly conducting crisis informatics research in light of the pandemic of 2020. It also might support creation of new course syllabi on related topics. It has been produced by members of the crisis informatics research community in May 2020 to consolidate and organize the literature on in...
Preprint
BACKGROUND In Clinical Diagnostic Interviews, mental health professionals (MHPs) implement a care practice that involves open questions (e.g., What do you want from your life? What have you tried before to bring change in your life?) and listening to a patient. Further, MHPs need to gather critical insights from an interview with a patient concerni...
Preprint
Full-text available
Intelligent systems designed using machine learning algorithms require a large number of labeled data. Background knowledge provides complementary, real world factual information that can augment the limited labeled data to train a machine learning algorithm. The term Knowledge Graph (KG) is in vogue as for many practical applications, it is conven...
Article
Full-text available
THIS ARTICLE USES WORDS OR LANGUAGE THAT IS CONSIDERED PROFANE, VULGAR, OR OFFENSIVE BY SOME READERS. The presence of a significant amount of harassment in user-generated content and its negative impact calls for robust automatic detection approaches. This requires the identification of different types of harassment. Earlier work has classified har...
Article
Full-text available
Intelligent systems designed using machine learning algorithms require a large number of labeled data. Background knowledge provides complementary, real-world factual information that can augment the limited labeled data to train a machine learning algorithm. The term Knowledge Graph (KG) is in vogue as for many practical applications, it is conven...
Article
Research and practice in medical decision making value consistency with standardized intervention, potentially neglecting the impact of various environmental features such as workload or the constraints of local work practice. This study presents both qualitative and quantitative analyses of emergency physicians’ decision-making processes in their...
Article
Full-text available
Terror attacks have been linked in part to online extremist content. Online conversations are cloaked in religious ambiguity, with deceptive intentions, often twisted from mainstream meaning to serve a malevolent ideology. Although tens of thousands of Islamist extremism supporters consume such content, they are a small fraction relative to peacefu...
Conference Paper
Imprecise composite location references formed using ad hoc spatial expressions in English text makes the geocoding task challenging for both inference and evaluation. Typically such spatial expressions fill in unestablished areas with new toponyms for finer spatial referents. For example, the spatial extent of the ad hoc spatial expression "north...
Article
Full-text available
The present study examines process and outcome measures associated with three forms of support for conducting an unfamiliar surgical task: an unaided control condition, a video resource condition and a remotely-located mentor. Twenty-eight surgeons performed four different uncommon trauma procedures while thinking aloud in either the control or vid...
Preprint
Full-text available
The assessment of trust between users is essential for collaboration. General reputation and ID mechanisms may support users' trust assessment. However, these mechanisms lack sensitivity to pairwise interactions and specific experience such as betrayal over time. Moreover, they place an interpretation burden that does not scale to dynamic, large-sc...
Article
Full-text available
The assessment of trust between users is essential for collaboration. General reputation and ID mechanisms may support users’ trust assessment. However, these mechanisms lack sensitivity to pairwise interactions and specific experience such as betrayal over time. Moreover, they place an interpretation burden that does not scale to dynamic, large-sc...
Preprint
Full-text available
Terror attacks have been linked in part to online extremist content. Although tens of thousands of Islamist extremism supporters consume such content, they are a small fraction relative to peaceful Muslims. The efforts to contain the ever-evolving extremism on social media platforms have remained inadequate and mostly ineffective. Divergent extremi...
Conference Paper
Natural disasters such as floods, forest fires, and hurricanes can cause catastrophic damage to human life and infrastructure. We focus on response to hurricanes caused by both river water flooding and storm surge. Using models for storm surge simulation and flood extent prediction, we generate forecasts about areas likely to be highly affected by...
Article
Participants in Fantasy Sports make a critical decision: selecting productive players for their fantasy team. The wellestablished Wisdom of Crowd effect can predict productive, rewarding players; popular, frequently selected players are potentially good choices. Previous performance data permits the identification of a subset of participants who co...
Preprint
Full-text available
Imprecise composite location references formed using ad hoc spatial expressions in English text makes the geocoding task challenging for both inference and evaluation. Typically such spatial expressions fill in unestablished areas with new toponyms for finer spatial refer-ents. For example, the spatial extent of the ad hoc spatial expression "north...
Conference Paper
Full-text available
Recent studies show that by combining network topology and node attributes, we can better understand community structures in complex networks. However, existing algorithms do not explore "contextually" similar node attribute values, and therefore may miss communities defined with abstract concepts. We propose a community detection and characterizat...
Chapter
Natural language dialogue is a desirable method for human-robot interaction and human-computer interaction. Critical to the success of dialogue is the underlying model for common ground and the grounding process that establishes, adds to, and repairs shared understanding. The model of grounding for human-computer interaction should be informed by h...
Chapter
Effective communication is critical to sociotechnical systems. Such systems may entail distributed authority and responsibility, and physical resources that are not collocated. This is certainly the case in crisis management. To improve communication during crisis management, researchers have tried to enhance the communication technology. However,...
Conference Paper
Full-text available
We employ multi-modal data (i.e., unstructured text, gazetteers, and imagery) for location-centric demand/request matching in the context of disaster relief. After classifying the Need expressed in a tweet (the WHAT), we leverage OpenStreetMap to geolocate that Need on a computationally accessible map of the local terrain (the WHERE) populated with...
Preprint
Full-text available
The presence of a significant amount of harassment in user-generated content and its negative impact calls for robust automatic detection approaches. This requires that we can identify different forms or types of harassment. Earlier work has classified harassing language in terms of hurtfulness, abusiveness, sentiment, and profanity. However, to id...
Conference Paper
Full-text available
Extracting location names from informal and unstructured social media data requires the identification of referent boundaries and partitioning compound names. Variability, particularly systematic variability in location names (Carroll, 1983), challenges the identification task. Some of this variability can be anticipated as operations within a stat...
Preprint
Full-text available
The ever-growing datasets published on Linked Open Data mainly contain encyclopedic information. However, there is a lack of quality structured and semantically annotated datasets extracted from unstructured real-time sources. In this paper, we present principles for developing a knowledge graph of interlinked events using the case study of news he...
Chapter
Full-text available
Social media research often exploits metrics based on frequency counts, e.g., to determine corpus sentiment. Hampton and Shalin [1] introduced an alternative metric examining the style and structure of social media relative to an Internet language baseline. They demonstrated statistically significant differ‐ ences in lexical choice from tweets coll...
Article
Background: Long-term retention of trauma procedural core-competency skills and need for re-training after a one-day cadaver-based course remains unknown. We measured and compared technical skills for trauma core competencies mean 14 months (38 residents), 30 months (35 practicing surgeons) and 46 months (10 experts) after training to determine if...
Conference Paper
Full-text available
A quality annotated corpus is essential to research. Despite the recent focus of the Web science community on cyberbullying research, the community lacks standard benchmarks. This paper provides both a quality annotated corpus and an offensive words lexicon capturing different types of harassment content: (i) sexual, (ii) racial, (iii) appearance-r...
Article
Due to Various factors including shorter training hours and changes in trauma prevalence and management, acquiring trauma surgical skills on‐the‐job is challenging for civilian and military surgeons. Surgical skills programs are used to supplement gaps in training opportunities. While these courses improve surgical knowledge, it is vital to underst...
Article
Full-text available
Objectives: Surgical residents express confidence in performing specific vascular exposures before training, but such self-reported confidence did not correlate with co-located evaluator ratings. This study reports residents' self-confidence evaluated before and after Advanced Surgical Skills for Exposure in Trauma (ASSET) cadaver-based training,...
Article
Full-text available
Having a quality annotated corpus is essential especially for applied research. Despite the recent focus of Web science community on researching about cyberbullying, the community dose not still have standard benchmarks. In this paper, we publish first, a quality annotated corpus and second, an offensive words lexicon capturing different types type...
Conference Paper
"Wisdom of Crowds" (WoC) refers to a form of collective intelligence in which the aggregate judgment of a group of individuals is, in most instances, superior to that of any one group member. For a crowd to be wise, its members must possess diverse knowledge and viewpoints. Such diversity leads to uncorrelated judgment errors that cancel out in agg...
Conference Paper
Full-text available
Natural language dialogue between multiple participants requires conversational grounding, a process whereby interlocutors achieve a shared understanding. However, the mechanisms involved in the grounding process are under dispute. Two prominent models of dialogue between multiple participants are: interactive alignment, a simpler model that relies...
Conference Paper
Trust is a fundamental construct underpinning modern society and the social exchanges it contains. The rise of Web 2.0 technologies and the increased use of online social networks, promotes the study of trust among users. Drawing on social and psychological theory, we detect pairwise and global trust relations between users in the context of emerge...
Conference Paper
Full-text available
In the current study we investigated the explicit representation of constraints or “rules” in a team-based planning task using shared representations. We manipulated the variable of text, which has had limited attention in human factors literature. In addition, we used the subject variable of gender, also unique in human factors research. We also d...
Conference Paper
Articulation work is an overlooked requirement for successful human-machine teams. Articulation work captures the often hidden task management activities human-human teams regularly perform in response to functional dependencies amongst team members. While human-human teams demonstrate articulation work through language, human-machine teams current...
Article
Background: Work-hour restrictions have reduced operative experience for residents. The Advanced Surgical Skills for Exposure in Trauma course fills this training gap. Cadaver use has limitations including cost and availability. Hyper-realistic synthetic models may provide an alternative to cadavers. We compared same surgeon performance between sy...
Article
Objective This paper identifies general properties of language style in social media to help identify areas of need in disasters. Background In the search for metrics of need in social media data, much of the existing literature ignores processes of language usage. Psychological concepts, such as narrative breach, Gricean maxims, and lexical marki...
Conference Paper
Full-text available
While the general analysis of named entities has received substantial research attention, the analysis of relations over named entities has not. In fact, a review of the literature on unstructured as well as structured data revealed a deficiency in research on the abstract conceptualization required to organize relations. We believe that such an ab...
Preprint
While the general analysis of named entities has received substantial research attention on unstructured as well as structured data, the analysis of relations among named entities has received limited focus. In fact, a review of the literature revealed a deficiency in research on the abstract conceptualization required to organize relations. We bel...
Conference Paper
This paper details the creation of a massive (over 32,000 messages) artificially constructed textquoteleftTwittertextquoteright microblog stream for a regional emergency preparedness functional exercise. By combining microblog conversion, manual production, and a control set, we created a web-based information stream providing valid, misleading, an...
Article
Full-text available
The growing literature on shared decision making and patient centered care emphasizes the patient’s role in clinical care, but research on clinical reasoning almost exclusively addresses physician cognition. In this article, we suggest clinical cognition is distributed between physicians and patients and assess how distributed clinical cognition fu...
Article
Full-text available
Despite increasing prominence, little is known about the cognitive processes underlying shared decision making. To investigate these processes, we conceptualize shared decision making as a form of distributed cognition. We introduce a Decision Space Model to identify physical and social influences on decision making. Using field observations and in...
Chapter
Full-text available
A property of general interest of real-time collaborative editors is delay. Delays exist between the execution of one user’s modification and the visibility of this modification to the other users. Such delays are in part fundamental to the network, as well as arising from the consistency maintenance algorithms and underlying architecture of collab...
Article
Test with an individual procedure score (IPS) to assess whether an unpreserved cadaver trauma training course, including upper and lower limb vascular exposure, improves correct identification of surgical landmarks, underlying anatomy, and shortens time to vascular control. Prospective study of performance of 3 vascular exposure and control procedu...
Article
Maintaining trauma-specific surgical skills is an ongoing challenge for surgical training programs. An objective assessment of surgical skills is needed. We hypothesized that a validated surgical performance assessment tool could detect differences following a training intervention. We developed surgical performance assessment metrics based on disc...
Article
Full-text available
Humanitarian and public institutions are increasingly relying on data from social media sites to measure public attitude, and provide timely public engagement. Such engagement supports the exploration of public views on important social issues such as gender-based violence (GBV). In this study, we examine Big (Social) Data consisting of nearly four...
Article
Full-text available
This paper details the creation and use of a massive (over 32,000 messages) artificially constructed 'Twitter' microblog stream for a regional emergency preparedness functional exercise. By combining microblog conversion, manual production, and a control set, we created a web based information stream providing valid, misleading, and irrelevant info...
Article
Full-text available
Effective crisis management has long relied on both the formal and informal response communities. Social media platforms such as Twitter increase the participation of the informal response community in crisis response. Yet, challenges remain in realizing the formal and informal response communities as a cooperative work system. We demonstrate a sup...