Siruo Zhou’s research while affiliated with Nanjing University of Posts and Telecommunications and other places

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (6)


Structural equation model with “Group” and “Type” as predictors of five linguistic factors (fluency, accuracy, complexity, cohesion, and emotion). Note that all parameters estimates are standardized. Dashed lines represent the indicators that are fixed in the fixed loading method
Five linguistic dimensions of Chinese writing produced by ChatGPT and 9-year-old children
Is ChatGPT like a nine-year-old child in theory of mind? Evidence from Chinese writing
  • Article
  • Publisher preview available

September 2024

·

58 Reads

·

1 Citation

Education and Information Technologies

·

Yizhong Xu

·

Tongquan Zhou

·

Siruo Zhou

ChatGPT has been demonstrated to possess significant capabilities in generating intricate human-like text, and recent studies have established that its performance in theory of mind (ToM) tasks is strikingly comparable to a nine-year-old child’s. However, it remains unknown whether ChatGPT outperforms children of this age group in Chinese writing, a task credibly related to ToM. To justify the claim, this study compared ChatGPT with nine-year-old children in making Chinese compositions (i.e., science-themed and nature-themed narratives), aiming to unveil the relative advantages and disadvantages by human writers and ChatGPT in Chinese writing. Based on the evaluative framework comprising of four indices (i.e., fluency, accuracy, complexity, and cohesion) to test writing quality, this study added an often-overlooked index “emotion” to extend the framework. Afterward, we collected 120 writing samples produced by ChatGPT and children and used the confirmatory factor analysis (CFA) and structural equation modelling (SEM) for data analysis and comparison. The results revealed that this age group of children surpassed ChatGPT in fluency and cohesion while ChatGPT transcended the children in accuracy. With respect to complexity, the children exhibited better skills in science-themed writing, but ChatGPT better in nature-themed writing. Most importantly, this study unlocked the pioneering discovery that children display more potent emotional expressions than ChatGPT in Chinese writing, providing an instance of evidence that ChatGPT is really even poorer than a nine-year-old child in ToM to some extent.

View access options

On the Novel Chinese Modifier-Head Construction Shejian Shang de X : An Analysis of Meaning Construction

September 2023

·

15 Reads

Chinese Journal of Applied Linguistics

Since the documentary A Bite of China (i. e. Shejian shang de Zhongguo ( 《舌尖上的中国》), where shejian shang literally means “on the tip of the tongue”), was broadcast in May 2012, a great number of expressions like shejian shang de Russia/world/Olympics/safety have begun to gradually converge into a novel modifier-head construction Shejian Shang de X , illustrating a typical evolution of modern Chinese.This study aims to analyze the construction’s meaning from the perspective of cognitive linguistics. Our investigation and analysis indicate that (1) Shejian Shang de X differs from the classic Chinese construction PP de X in both semantics and syntax; (2) as a modifier-head construction, Shejian Shang de X shows its variations in the head X’s multiple category options (noun, verb and adjective), therefore extending the scope of nominalization in Chinese and simultaneously triggering the construction’s diversified meanings; (3) the construction’s non-compositionality results mainly from its modifier components shejian and shang and is in general construed metonymically and metaphorically; (4) as a whole, the construction is a double-scope network consisting of two different organizing frames: the frame of shejian (“tip of the tongue”), a body part term and the frame of X, a dynamically changing entity (physical or abstract). The surface semantic incompatibility between the modifier and the head can be solved only by virtue of conceptual blending, producing the novel meaning [X relevant to the function of the tip of the tongue] of the whole construction.


Chinese intermediate English learners outdid ChatGPT in deep cohesion: Evidence from English narrative writing

September 2023

·

30 Reads

·

15 Citations

System

Tongquan Zhou

·

·

Siruo Zhou

·

[...]

·

Aijing He

ChatGPT is a publicly available chatbot that can quickly generate texts on given topics, but it remains unknown whether the chatbot is as good as or even superior to human writers in all aspects of writing, and whether the chatbot's writing quality can be significantly improved by updating commands. To investigate these issues, this study compared writing performance on a narrative topic by ChatGPT and Chinese intermediate English (CIE) learners so as to reveal the chatbot's advantages and disadvantages in writing. The data were analyzed by virtue of the five discourse components using Coh-Metrix (a special instrument for analyzing language discourse), and the results revealed that ChatGPT performed better than human writers in narrativity, word concreteness, and referential cohesion, but worse in syntactic simplicity and deep cohesion in its initial version. After its commands were updated, the resulting version was better in its syntactic simplicity, but it still lagged far behind the CIE learners’ writing in deep cohesion. In addition, a correlation analysis of the discourse components suggests that narrativity was correlated with referential cohesion for both ChatGPT and the human writers, but the correlations varied within each group.


Figure 3. Correlations of discourse components for ChatGPT (left) and CIE learners (right)
Correlations separately for ChatGPT (above) and CIE learners (below)
Five components of the first and revised version of writing from ChatGPT and CIE learners
Chinese Intermediate English Learners outdid ChatGPT in deep cohesion: Evidence from English narrative writing

March 2023

·

296 Reads

ChatGPT is a publicly available chatbot that can quickly generate texts on given topics, but it is unknown whether the chatbot is really superior to human writers in all aspects of writing and whether its writing quality can be prominently improved on the basis of updating commands. Consequently, this study compared the writing performance on a narrative topic by ChatGPT and Chinese intermediate English (CIE) learners so as to reveal the chatbot's advantage and disadvantage in writing. The data were analyzed in terms of five discourse components using Coh-Metrix (a special instrument for analyzing language discourses), and the results revealed that ChatGPT performed better than human writers in narrativity, word concreteness, and referential cohesion, but worse in syntactic simplicity and deep cohesion in its initial version. After more revision commands were updated, while the resulting version was facilitated in syntactic simplicity, yet it is still lagged far behind CIE learners' writing in deep cohesion. In addition, the correlation analysis of the discourse components suggests that narrativity was correlated with referential cohesion in both ChatGPT and human writers, but the correlations varied within each group.


Screening process of the reviewed papers.
Classification of online peer feedback (OPF).
A review of the ESL/EFL learners’ gains from online peer feedback on English writing

October 2022

·

343 Reads

·

16 Citations

Peer feedback is essential in writing English as a Second/Foreign Language (ESL/EFL). Traditionally, offline PF was more widely favored but nowadays online peer feedback (OPF) has become frequent in ESL/EFL learners’ daily writing. This study is undertaken to probe into the gains of using OPF in ESL/EFL writing on the basis of 37 research articles published in core journals from 2012 till 2022. In order to accurately cover the previous researches, we capitalize on three methods to evaluate and analyze the data, i.e., database search, citation search and manual search. Results show that from the perspective of the ESL/EFL learners’ gains, the OPF is basically divided into two categories (cognitive OPF and affective OPF), involving eight aspects in all: face-based strategies, revision-based comments, writing performance, learning environment, reflection/critical thinking/responsibility, writing emotion, motivation, and attitudes; and OPF can be well supported by a set of theories like Process-oriented Writing Theory, Collaborative Learning Theory, Interactionist Theory of L2 Acquisition and Vygotsky’s sociocultural theory. By comparison, the gains from OPF outperform those from offline PF in many dimensions (e.g., face-based strategies), despite some overlaps (e.g., the shift of the role) that were revealed in several investigations. Based on the past studies, we propose some pedagogical implications on OPF from ESL/EFL writing, including accenting the “student-centered” teaching strategy, providing students with OPF on the basis of incremental knowledge, adopting OPF regularly in ESL/EFL writing activities to shape personalities and outlooks and putting OPF into its full play with recourse to abundant internet-based vehicles. This review is desired to provide a guideline for both the peer feedback practice and the upcoming scholarly researches with respect to EFL/ESL writing.


N400 Indexing the Motion Concept Shared by Music and Words

June 2022

·

47 Reads

·

1 Citation

The two event-related potentials (ERP) studies investigated how verbs and nouns were processed in different music priming conditions in order to reveal whether the motion concept via embodiment can be stimulated and evoked across categories. Study 1 (Tasks 1 and 2) tested the processing of verbs (action verbs vs. state verbs) primed by two music types, with tempo changes (accelerating music vs. decelerating music) and without tempo changes (fast music vs. slow music) while Study 2 (Tasks 3 and 4) tested the processing of nouns (animate nouns vs. inanimate nouns) in the same priming condition as adopted in Study 1. During the experiments, participants were required to hear a piece of music prior to judging whether an ensuing word (verb or noun) is semantically congruent with the motion concept conveyed by the music. The results show that in the priming condition of music with tempo changes, state verbs and inanimate nouns elicited larger N400 amplitudes than action verbs and animate nouns, respectively in the anterior regions and anterior to central regions, whereas in the priming condition of music without tempo changes, action verbs elicited larger N400 amplitudes than state verbs and the two categories of nouns revealed no N400 difference, unexpectedly. The interactions between music and words were significant only in Tasks 1, 2, and 3. Taken together, the results demonstrate that firstly, music with tempo changes and music without tempo prime verbs and nouns in different fashions; secondly, action verbs and animate nouns are easier to process than state verbs and inanimate nouns when primed by music with tempo changes due to the shared motion concept across categories; thirdly, bodily experience differentiates between music and words in coding (encoding and decoding) fashion but the motion concept conveyed by the two categories can be subtly extracted on the metaphorical basis, as indicated in the N400 component. Our studies reveal that music tempos can prime different word classes, favoring the notion that embodied motion concept exists across domains and adding evidence to the hypothesis that music and language share the neural mechanism of meaning processing.

Citations (4)


... However, its writing proficiency remains uncharted territory, especially in comparison to children. A study by Cao et al. (2024) compared ChatGPT's writing skills with those of nine-yearold children in composing Chinese narratives, exploring the relative strengths and weaknesses of both. The study found that while ChatGPT excelled in accuracy, children outperformed it in fluency, cohesion, and emotional expression. ...

Reference:

Chatbots for Writing Skills: A Synthesis of Research
Is ChatGPT like a nine-year-old child in theory of mind? Evidence from Chinese writing

Education and Information Technologies

... Findings of our study reveal unexpected shortcoming of AI in guiding coherence and cohesion revision, which contradicts with the prior notion that AI-feedbackguided revision significantly improves writing quality in this respect (Zhou et al., 2023). Minimal enhancement in anaphora and conceptual continuity following AIguided revision highlights limitations of AI feedback in boosting referential cohesion, aligning with past findings on shortcomings of AI tools in pronoun correction (Park, 2019). ...

Chinese intermediate English learners outdid ChatGPT in deep cohesion: Evidence from English narrative writing
  • Citing Article
  • September 2023

System

... Recent research also points to the fact that feedback has made an important contribution to the process of writing. For example, Cao et al. (2022) investigated the effect of peer feedback on the writing of ESL students. This study indicates that when peer reviews are done correctly, a significant improvement in the quality of student writing, especially in grammar, vocabulary, and coherence, is realized. ...

A review of the ESL/EFL learners’ gains from online peer feedback on English writing

... In particular, the N400 component (a negative deflection peaking between 250 to 600 ms after stimulus presentation) (Kutas and Federmeier, 2011) is a key marker of the integration of action concepts evoked by images, videos, and verbs (Amoruso et al., 2013;Cervetto et al., 2021). In HPs, indeed, early (~250-300 ms) fronto-central N400 effects index the processing of action images (Amoruso et al., 2013) and efficient detection of incongruency between them (Amoruso et al., 2013;Bach et al., 2009;Mudrik et al., 2010;Proverbio and Riva, 2009;Proverbio et al., 2010), whereas later (~350-500 ms) effects are observed for action verbs (Cervetto et al., 2021;Dalla Volta et al., 2018;Zhou et al., 2022). ...

N400 Indexing the Motion Concept Shared by Music and Words