The use of control groups in artificial grammar learning

Department of Psychology, University of Bern, Bern, Switzerland.
The Quarterly Journal of Experimental Psychology A 02/2003; 56(1):97-115. DOI: 10.1080/02724980244000297
Source: PubMed


Experimenters assume that participants of an experimental group have learned an artificial grammar if they classify test items with significantly higher accuracy than does a control group without training. The validity of such a comparison, however, depends on an additivity assumption: Learning is superimposed on the action of non-specific variables-for example, repetitions of letters, which modulate the performance of the experimental group and the control group to the same extent. In two experiments we were able to show that this additivity assumption does not hold. Grammaticality classifications in control groups without training (Experiments 1 and 2) depended on non-specific features. There were no such biases in the experimental groups. Control groups with training on randomized strings (Experiment 2) showed fewer biases than did control groups without training. Furthermore, we reanalysed published research and demonstrated that earlier experiments using control groups without training had produced similar biases in control group performances, bolstering the finding that using control groups without training is methodologically unsound.

Download full-text


Available from: Rolf Reber
  • Source
    • "A potential hypothesis may be that an online-learning effect depends on the proportion of grammatical chunks contained in the ungrammatical structures. A detailed exploration for, and explanation of, this effect, as well as the questions raised in the discussion following Redington and Chater (1996), Reber and Perruchet (2003) and Dienes and Altmann (2003) requires further experimental work. "
    [Show abstract] [Hide abstract]
    ABSTRACT: The cognition of music, like that of language, is partly rooted in enculturative processes of implicit and incidental learning. Musicians and nonmusicians alike are commonly found to possess detailed implicit knowledge of musical structure which is acquired incidentally through interaction with large samples of music. This paper reports an experiment combining the methodology of artificial grammar learning with musical acquisition of melodic structure. Participants acquired knowledge of grammatical melodic structures under incidental learning conditions in both experimental and untrained control conditions. Subsequent analysis indicates a large effect of unsupervised online learning in the experimental and control group throughout the course of the testing phase suggesting an effective ongoing learning process. Musicians did not outperform nonmusicians, indicating that musical expertise is not advantageous for the learning of a new, unfamiliar melodic system. Confidence ratings suggest that participants became aware of the knowledge guiding their classification performance despite the incidental learning conditions.
    Full-text · Article · Jun 2011 · Consciousness and Cognition
  • Source
    • "The 30 consonant-vowel syllables were constructed by exhaustively combining six consonants and five vowels that occur in the phoneme inventories of French, Dutch, and English: /p, b, m, f, s, k/, and /a, i, ε, Å, u/. There is always the possibility that listeners may come to an ALL task with biases that influence word-boundary detection during the exposure phase Reber and Perruchet, 2003. For example, certain syllables, consonants, or vowels may occur with a higher probability at word boundaries in the listener's native language, and combinations of syllables in the artificial language may resemble real words. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Two artificial-language learning experiments directly compared English, French, and Dutch listeners' use of suprasegmental cues for continuous-speech segmentation. In both experiments, listeners heard unbroken sequences of consonant-vowel syllables, composed of recurring three- and four-syllable "words." These words were demarcated by (a) no cue other than transitional probabilities induced by their recurrence, (b) a consistent left-edge cue, or (c) a consistent right-edge cue. Experiment 1 examined a vowel lengthening cue. All three listener groups benefited from this cue in right-edge position; none benefited from it in left-edge position. Experiment 2 examined a pitch-movement cue. English listeners used this cue in left-edge position, French listeners used it in right-edge position, and Dutch listeners used it in both positions. These findings are interpreted as evidence of both language-universal and language-specific effects. Final lengthening is a language-universal effect expressing a more general (non-linguistic) mechanism. Pitch movement expresses prominence which has characteristically different placements across languages: typically at right edges in French, but at left edges in English and Dutch. Finally, stress realization in English versus Dutch encourages greater attention to suprasegmental variation by Dutch than by English listeners, allowing Dutch listeners to benefit from an informative pitch-movement cue even in an uncharacteristic position.
    Full-text · Article · Aug 2009 · The Journal of the Acoustical Society of America
  • Source
    • "Moreover, the fact that effects of grammaticality as well as associative chunk strength can develop already during classification prior to acquisition suggest that the mechanism engaged (not necessarily the same as in artificial grammar learning proper) can work on surprisingly scarce input. For example, Reber and Perruchet (2003) list a number of features (e.g., number of letters in strings, multiple letter position, letter repetitions, and bigram reoccurrence) which they suggested untrained subjects might employ during baseline or the initial classification phase. However, in this context in the current study, it is important to observe that the participants classified at random at the very beginning of the baseline classification and that the instruction effects developed subsequently over the baseline session (see Fig. 3a). "
    [Show abstract] [Hide abstract]
    ABSTRACT: Human implicit learning can be investigated with implicit artificial grammar learning, a paradigm that has been proposed as a simple model for aspects of natural language acquisition. In the present study we compared the typical yes-no grammaticality classification, with yes-no preference classification. In the case of preference instruction no reference to the underlying generative mechanism (i.e., grammar) is needed and the subjects are therefore completely uninformed about an underlying structure in the acquisition material. In experiment 1, subjects engaged in a short-term memory task using only grammatical strings without performance feedback for 5 days. As a result of the 5 acquisition days, classification performance was independent of instruction type and both the preference and the grammaticality group acquired relevant knowledge of the underlying generative mechanism to a similar degree. Changing the grammatical stings to random strings in the acquisition material (experiment 2) resulted in classification being driven by local substring familiarity. Contrasting repeated vs. non-repeated preference classification (experiment 3) showed that the effect of local substring familiarity decreases with repeated classification. This was not the case for repeated grammaticality classifications. We conclude that classification performance is largely independent of instruction type and that forced-choice preference classification is equivalent to the typical grammaticality classification.
    Full-text · Article · Aug 2008 · Brain Research
Show more