Piper Vasicek’s research while affiliated with Brigham Young University and other places

... 13 Large language models are frequently deficient in providing real papers and correctly matching authors to their own papers when generating citations, and therefore are at risk of creating fictitious citations that appear convincing despite incorrect information including digital object identifier numbers. 6,14 Studies evaluating perceptions of AI use in academic journals and strengths and weaknesses of the tools revealed no agreement on how to report the use of AI tools. 15 There are many tools; for example, some are used to improve grammar and others to generate content, yet parameters on substantive use versus nonsubstantive use are lacking. ...

Reference:

Use of artificial intelligence in family medicine publications: Joint statement from journal editors

... Although the deployment of LLMs in qualitative research is in 'its status nascendi' [in the state of being born] (De Paoli 2024, 3), there are ongoing debates about their role and effectiveness in processing and analyzing data. Some researchers (Byun, Vasicek, and Seppi 2023;Rietz and Maedche 2021) suggest that AI can match human capabilities in processing qualitative data and highlight the potential for LLMs to learn human coding practices and recognize linguistic patterns in textual analysis. This suggests that these models can mimic the subjective nature of qualitative analysis to a certain degree. ...

Reference:

Large Language Models and the challenge of analyzing discriminatory discourse: human-AI synergy in researching hate speech on social media