-
[show abstract]
[hide abstract]
ABSTRACT: (1) To determine if consonant-vowel-consonant (CVC) syllables [Hillenbrand J, Getty L, Clark M, Wheeler K. Acoustic characteristics of American English vowels. J Acoust Soc Am 1995;97:3099-3111] could be used to evoke cortical far field response patterns in humans, (2) to characterize the effects of cochlear implant-simulated channel number on the perception and physiological detection of these same CVC stimuli, and (3) to define the relationship between perception and the morphology of the physiological responses evoked by these speech stimuli.
Ten normal hearing monolingual English speaking adults were tested. Unprocessed CVC naturally spoken syllables, containing medial vowels, as well as processed versions (2, 4, 8, 12, and 16 spectral channels) were used for behavioral and physiological testing.
(1) CVC stimuli evoked a series of overlapping P1-N1-P2 cortical responses. (2) Amplitude of P1-N1-P2 responses increased as neural conduction time (latency) decreased with increases in the number of spectral channels. Perception of the CVC stimuli improved with increasing number of spectral channels. (3) Coinciding changes in P1-N1-P2 morphology did not significantly correlate with changes in perception.
P1-N1-P2 responses can be recorded using CVC syllables and there is an effect of channel number on the latency and amplitude of these responses, as well as on vowel identification. However, the physiological detection of the acoustic changes does not fully account for the perceptual performance of these same syllables.
These results provide evidence that it is possible to use vocoded CVC stimuli to learn more about the physiological detection of acoustic changes contained within speech syllables, as well as to explore brain-behavior relationships.
Clinical neurophysiology: official journal of the International Federation of Clinical Neurophysiology 03/2009; 120(4):776-82. · 3.12 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: This paper discusses the development and implementation of three novel implantable technologies that have advanced the communication abilities of hearing-impaired individuals who cannot benefit from conventional hearing aids. This paper will discuss clinical indications and outcomes and include current technological limitations and future research efforts.
Proceedings of the IEEE 08/2008; · 6.81 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: Speech recognition was measured as a function of spectral resolution (number of spectral channels) and speech-to-noise ratio in normal-hearing (NH) and cochlear-implant (CI) listeners. Vowel, consonant, word, and sentence recognition were measured in five normal-hearing listeners, ten listeners with the Nucleus-22 cochlear implant, and nine listeners with the Advanced Bionics Clarion cochlear implant. Recognition was measured as a function of the number of spectral channels (noise bands or electrodes) at signal-to-noise ratios of + 15, + 10, +5, 0 dB, and in quiet. Performance with three different speech processing strategies (SPEAK, CIS, and SAS) was similar across all conditions, and improved as the number of electrodes increased (up to seven or eight) for all conditions. For all noise levels, vowel and consonant recognition with the SPEAK speech processor did not improve with more than seven electrodes, while for normal-hearing listeners, performance continued to increase up to at least 20 channels. Speech recognition on more difficult speech materials (word and sentence recognition) showed a marginally significant increase in Nucleus-22 listeners from seven to ten electrodes. The average implant score on all processing strategies was poorer than scores of NH listeners with similar processing. However, the best CI scores were similar to the normal-hearing scores for that condition (up to seven channels). CI listeners with the highest performance level increased in performance as the number of electrodes increased up to seven, while CI listeners with low levels of speech recognition did not increase in performance as the number of electrodes was increased beyond four. These results quantify the effect of number of spectral channels on speech recognition in noise and demonstrate that most CI subjects are not able to fully utilize the spectral information provided by the number of electrodes used in their implant.
The Journal of the Acoustical Society of America 09/2001; 110(2):1150-63. · 1.55 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: The multichannel auditory brainstem implant (ABI) has been used successfully to treat deafness in individuals with neurofibromatosis type II. The device has been implanted in nearly 150 recipients worldwide, and clinical trials with the device are approaching completion. The implantation and fitting of the multichannel ABI differ significantly from cochlear implantation, and the processes are illustrated in a series of case studies. Performance data also are included from recipients with up to 7 years experience.
Otolaryngologic Clinics of North America 05/2001; 34(2):485-99. · 1.65 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: Speech recognition performance was measured as a function of electrode in two experiments with the Nucleus-22 cochlear implant using 4-electrode SPEAK speech processors. In experiment 1, the four stimulated electrode pairs were shifted in 0.75-mm steps over 3 mm in the apical-basal direction. In experiment 2, the four electrodes were closely spaced and positioned apically, medially, or basally. An additional condition spaced the four electrodes as widely as possible. In experiment 1, City University of New York sentence scores showed a significant decrease in performance as the electrodes were shifted basally; no other speech measures showed a significant change with electrode location. For experiment 2, all scores were the best with the processor that had the electrodes spaced as widely as possible. In both experiments, all 4-electrode SPEAK processors produced significantly poorer speech recognition than the subject's own 20-electrode processor. These results indicate that the location of electrodes is an important factor in implant performance.
Journal of the American Academy of Audiology 10/2000; 11(8):418-28. · 1.30 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: To determine the consequences for phoneme recognition of errors in setting threshold and loudness levels in cochlear implant listeners using a 4-channel continuous interleaved sampling (CIS) speech processor.
Three Nucleus-22 cochlear implant listeners, who normally used the SPEAK speech processing strategy participated in this study. An experimental 4-channel CIS speech processor was implemented in each listener as follows. Speech signals were band-pass filtered into four broad frequency bands and the temporal envelope of the signal in each band was extracted by half-wave rectification and low-pass filtering. A power function was used to convert the extracted acoustic amplitudes to electric currents. The electric currents were dependent on the exponent of the mapping power function and the electrode dynamic range, which was determined by the minimum and maximum stimulation levels. In the baseline condition, the minimum and maximum stimulation levels were defined as the psychophysically measured threshold level (T-level) and maximum comfortable level (C-level). In the experimental conditions, the maximum stimulation levels were fixed at the C-level and the dynamic range (in dB) was changed by varying the minimum stimulation levels on all electrodes. This manipulation simulates the effect of an erroneous measurement of the T-level. Phoneme recognition was obtained as the dynamic range of electrodes was changed from 1 dB to 20 dB and as the exponent of the power-law amplitude mapping function was changed from 0.1 to 0.4.
For each mapping condition, the electric dynamic range had a significant, but weak effect on vowel and consonant recognition. For a strong compression (p = 0.1), best vowel and consonant scores were obtained with a large dynamic range (12 dB). When the exponent of the mapping function was changed to 0.2 and 0.4, the dynamic range producing the highest scores decreased to 6 dB and 3 dB, respectively.
Phoneme recognition with a 4-channel CIS strategy was only mildly affected by large changes in both electric threshold and loudness mapping. Errors in threshold by a factor of 2 (6 dB) and in the loudness mapping exponent by a factor of 2 were required to produce a significant decrease in performance. In these extreme conditions, the effect of the electric dynamic range on phoneme recognition could be due to two independent factors: abnormal loudness growth and a reduction in the number of discriminable intensity steps. The decrease in performance caused by a reduced electric dynamic range can be compensated by a more expansive power-law mapping function, as long as the number of discriminable intensity steps is moderately large (e.g., >8).
Ear and Hearing 07/2000; 21(3):227-35. · 2.58 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: Adult listeners are able to recognize speech even under conditions of severe spectral degradation. To assess the developmental time course of this robust pattern recognition, speech recognition was measured in two groups of children (5-7 and 10-12 years of age) as a function of the degree of spectral resolution. Results were compared to recognition performance of adults listening to the same materials and conditions. The spectral detail was systematically manipulated using a noise-band vocoder in which filtered noise bands were modulated by the amplitude envelope from the same spectral bands in speech. Performance scores between adults and older children did not differ statistically, whereas scores by younger children were significantly lower; they required more spectral resolution to perform at the same level as adults and older children. Part of the deficit in younger children was due to their inability to utilize fully the sensory information, and part was due to their incomplete linguistic/cognitive development. The fact that young children cannot recognize spectrally degraded speech as well as adults suggests that a long learning period is required for robust acoustic pattern recognition. These findings have implications for the application of auditory sensory devices for young children with early-onset hearing loss.
The Journal of the Acoustical Society of America 06/2000; 107(5 Pt 1):2704-10. · 1.55 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: Loudness estimates were obtained in a group of four adult subjects implanted with the Nucleus-22 multielectrode cochlear implant device, for a range of pulse amplitudes and different fixed phase durations and electrode separations. The stimulus was a 200-ms long train of biphasic pulses presented at 500 pulses/s. Subjects estimated loudness as a number from 0 ("don't hear it") to 100 ("uncomfortably loud"). Loudness was found to grow exponentially with pulse amplitude, at a rate that was dependent upon the phase duration as well as the electrode separation. An equation of the form L = e(lambda + gamma M)(D theta)I, where L is the estimated loudness, M is the separation between electrodes of a stimulating pair, D is the phase duration, I is current amplitude, and lambda, gamma, and theta are constants, appears to describe the observed data adequately. The findings are remarkably consistent across subjects.
The Journal of the Acoustical Society of America 04/2000; 107(3):1637-44. · 1.55 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: This study investigated the effect of pulsatile stimulation rate on medial vowel and consonant recognition in cochlear implant listeners. Experiment 1 measured phoneme recognition as a function of stimulation rate in six Nucleus-22 cochlear implant listeners using an experimental four-channel continuous interleaved sampler (CIS) speech processing strategy. Results showed that all stimulation rates from 150 to 500 pulses/s/electrode produced equally good performance, while stimulation rates lower than 150 pulses/s/electrode produced significantly poorer performance. Experiment 2 measured phoneme recognition by implant listeners and normal-hearing listeners as a function of the low-pass cutoff frequency for envelope information. Results from both acoustic and electric hearing showed no significant difference in performance for all cutoff frequencies higher than 20 Hz. Both vowel and consonant scores dropped significantly when the cutoff frequency was reduced from 20 Hz to 2 Hz. The results of these two experiments suggest that temporal envelope information can be conveyed by relatively low stimulation rates. The pattern of results for both electrical and acoustic hearing is consistent with a simple model of temporal integration with an equivalent rectangular duration (ERD) of the temporal integrator of about 7 ms.
The Journal of the Acoustical Society of America 02/2000; 107(1):589-97. · 1.55 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: Phoneme recognition performance in patients implanted with the Nucleus 22 cochlear implant is affected by the frequency-to-electrode assignment.
Multiple electrodes in modern cochlear implants are intended to deliver frequency-specific information to different tonotopic locations along the cochlea. However, the relation between the electrode locations, distribution of frequency information, and performance has not been explored thoroughly.
Ten listeners were tested on vowel and consonant identification tasks immediately after receiving each of the 15 speech processors. Experimental processors were created with 4, 7, and 20 activated electrodes. Five different frequency allocations were tested with all electrode conditions.
For 7- and 20-electrode maps, best vowel recognition performance was obtained with frequency tables 7 and 9, with subjects showing best performance with the table with which they were most familiar. With 4-electrode maps, no change in vowel recognition performance was observed as a function of the frequency allocation. Consonant scores showed only a small effect of frequency allocation across all processors. Results were similar across listeners with different electrode insertion depths.
The allocation of frequency ranges to electrodes in the Nucleus-22 cochlear implant can affect vowel recognition, when more than four electrodes are used, but is less important for consonant recognition. The allocation of frequency ranges to electrodes is an important factor in multichannel implants with more than four electrodes. The similarity of results across implant listeners with different electrode insertion depths implies that the optimal frequency allocation is one that best matches the allocation to which they've become accustomed, rather than one that matches the original tonotopic location of the electrodes.
The American journal of otology 12/1999; 20(6):729-34.
-
The Journal of the Acoustical Society of America 12/1999; 106(6):L65-70. · 1.55 Impact Factor
-
The Journal of the Acoustical Society of America 09/1999; 106(2):L18-23. · 1.55 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: The objective of this paper was to determine how phoneme identification was affected by the cochlear location and spacing of the electrodes in cochlear implant listeners.
Subjects were initially programmed with the full complement of 20 active electrodes, in which each electrode was assigned to represent the output of one filter in the normal SPEAK processor. In the present study several four-electrode processors were constructed by assigning the output of more than one filter to a single electrode. In all conditions speech sounds were still analyzed into 20 frequency bands and processed according to the usual SPEAK processing strategy, but the location and spacing of the four stimulated electrode pairs were varied systematically. In Experiment I, the spacing between stimulated electrodes was fixed at 3.75 mm and the cochlear location of the four electrode pairs was shifted from the most-apical position up to 3.0 mm toward the base in 0.75 mm steps. In Experiment II, the spatial separation between the four electrode pairs (each bipolar-plus-one) was systematically changed from 1.5 mm to 4.5 mm while holding the most apical active electrode fixed. In Experiment III, the spacing of active electrodes was varied to represent equal tonotopic spacing to equal linear frequency intervals between pairs. Recognition of medial vowels and consonants was measured in three subjects with these custom four-electrode speech processors.
In Experiment I, results showed that both vowel and consonant recognition were best when the electrodes were in the most apical locations. In Experiment II, best speech recognition occurred when electrode pairs were separated by 3 to 3.75 mm. In Experiment III, both vowel and consonant recognition scores decreased when the spacing of electrode pairs was changed from equal tonotopic spacing to equal linear frequency intervals. Overall, vowel and consonant recognition were best at the most apical electrode locations and when the spacing of electrodes matched the frequency intervals of the analysis filters. Consonant recognition was relatively robust to alterations in electrode location and spacing. The best vowel scores with four-electrode speech processors were about 10 percentage lower than scores obtained with the full 20-electrode speech processors. However, the best consonant scores with four-electrode speech processors were similar to those obtained with the full 20-electrode speech processors. Information transmission analysis revealed that temporal envelope cues (voicing and manner) were not strongly affected by changes in electrode location and spacing, whereas spectral cues, as represented by vowel recognition and consonantal place of articulation, were strongly affected. Both spectral and temporal phoneme cues were strongly affected by the degree of tonotopic warping, created by altering both the location and spacing of the activated electrodes.
The cochlear location and spacing of the activated electrodes had a clear effect on phoneme recognition. Temporal cues were less affected by tonotopic shifts or linear tonotopic stretching or shrinking, but were susceptible to nonlinear tonotopic warping. Spectral cues were sensitive to all tonotopic manipulations: shifting, linear stretching, and nonlinear warping. However, the present experiments could not differentiate whether the optimal mapping between analysis frequency bands and stimulation electrodes was determined by the normal acoustic tonotopic pattern or by the pattern learned from experience with the 20-electrode implant.
Ear and Hearing 09/1999; 20(4):321-31. · 2.58 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: This study was conducted to understand vowel recognition in cochlear implants as a function of the cochlear location and separation of the stimulated electrode pairs and as a function of the matching between speech spectral information and the location of the stimulated electrodes.
Four-electrode speech processors with a continuous interleaved sampling speech processing strategy were implemented through a custom interface in five subjects implanted with the Nucleus-22 cochlear implant. The temporal envelopes from four broad frequency bands were used to modulate 500 pps, 100 microsec/phase interleaved pulse trains delivered to four electrode pairs. Ten different frequency allocations and five sets of four-electrode configurations were tested. Each frequency allocation represented the same cochlear extent but different cochlear locations based on Greenwood's frequency-to-place formula. Recognition of multi-talker medial vowels was measured for each combination of parameters with no period of practice or adjustment.
Results showed that recognition of multi-talker vowels was highly dependent on frequency allocation for all electrode configurations. For a given electrode configuration maximum vowel recognition was observed with a specific frequency allocation. When the stimulated electrodes were shifted basally by 3 mm, the frequency allocation that produced the best performance also shifted basally by 3 mm. A similar pattern of vowel recognition was observed as a function of frequency allocation for electrode configurations that had the same apical-most electrode in each pair, regardless of location of the basal-most electrode in the pair. Subjects with different electrode insertion depths had similar trends in vowel recognition for each frequency allocation.
For a given electrode configuration, the best performance was obtained with processors with a specific frequency allocation. In addition, the apical-most member of each electrode pair had a much stronger influence on vowel recognition in electric hearing. Finally, results from this study also suggest that over time, patients with implants can partially adapt to a basal shift in place of stimulation.
Ear and Hearing 09/1999; 20(4):332-44. · 2.58 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: Psychophysical laws relate the intensity of a physical stimulus to its perceived magnitude. G.T. Fechner hypothesized 150 years ago that the psychophysical law can be derived by measuring intensity discrimination, but modern scientists favor a direct magnitude estimation approach and are still divided on whether and how intensity discrimination is related to sensation magnitude. This controversy is partially due to the uncertainty of the role of the sensory organ in the psychophysical law. Here we bypass the auditory sensory organ with electric stimulation of the human auditory nerve and find a close coupling between intensity discrimination and loudness functions in electric hearing. Our results support Fechner's hypothesis in principle but not the exact relationship from which he derived his logarithmic law.
Neuroreport 07/1999; 10(9):1931-5. · 1.66 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: The present study measured phoneme recognition as a function of the signal-to-noise level under conditions of spectral smearing and nonlinear amplitude mapping. Speech sounds were divided into 16 analysis bands. The envelope was extracted from each band by half-wave rectification and low-pass filtering and was then distorted by a power-law transformation whose exponents varied from a strongly compressive (p=0.3) to a strongly expanded value (p=3.0). This distorted envelope was used to modulate a noise which was spectrally limited by the same analysis filters. Results showed that phoneme recognition scores in a quiet condition were reduced only slightly with either expanded or compressed amplitude mapping. As the level of background noise was increased, performance deteriorated more rapidly for both compressed and linear mapping than for the expanded mapping. These results indicate that, although an expansive amplitude mapping may slightly reduce performance in quiet conditions, it may be beneficial in noisy listening conditions
Acoustics, Speech, and Signal Processing, 1999. ICASSP '99. Proceedings., 1999 IEEE International Conference on; 04/1999
-
[show abstract]
[hide abstract]
ABSTRACT: The present study measured the recognition of spectrally degraded and frequency-shifted vowels in both acoustic and electric hearing. Vowel stimuli were passed through 4, 8, or 16 bandpass filters and the temporal envelopes from each filter band were extracted by half-wave rectification and low-pass filtering. The temporal envelopes were used to modulate noise bands which were shifted in frequency relative to the corresponding analysis filters. This manipulation not only degraded the spectral information by discarding within-band spectral detail, but also shifted the tonotopic representation of spectral envelope information. Results from five normal-hearing subjects showed that vowel recognition was sensitive to both spectral resolution and frequency shifting. The effect of a frequency shift did not interact with spectral resolution, suggesting that spectral resolution and spectral shifting are orthogonal in terms of intelligibility. High vowel recognition scores were observed for as few as four bands. Regardless of the number of bands, no significant performance drop was observed for tonotopic shifts equivalent to 3 mm along the basilar membrane, that is, for frequency shifts of 40%-60%. Similar results were obtained from five cochlear implant listeners, when electrode locations were fixed and the spectral location of the analysis filters was shifted. Changes in recognition performance in electrical and acoustic hearing were similar in terms of the relative location of electrodes rather than the absolute location of electrodes, indicating that cochlear implant users may at least partly accommodate to the new patterns of speech sounds after long-time exposure to their normal speech processor.
The Journal of the Acoustical Society of America 04/1999; 105(3):1889-900. · 1.55 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: Current multichannel cochlear implant devices provide high levels of speech performance in quiet. However, performance deteriorates rapidly with increasing levels of background noise. The goal of this study was to investigate whether the noise susceptibility of cochlear implant users is primarily due to the loss of fine spectral information. Recognition of vowels and consonants was measured as a function of signal-to-noise ratio in four normal-hearing listeners in conditions simulating cochlear implants with both CIS and SPEAK-like strategies. Six conditions were evaluated: 3-, 4-, 8-, and 16-band processors (CIS-like), a 6/20 band processor (SPEAK-like), and unprocessed speech. Recognition scores for vowels and consonants decreased as the S/N level worsened in all conditions, as expected. Phoneme recognition threshold (PRT) was defined as the S/N at which the recognition score fell to 50% of its level in quiet. The unprocessed speech had the best PRT, which worsened as the number of bands decreased. Recognition of vowels and consonants was further measured in three Nucleus-22 cochlear implant users using either their normal SPEAK speech processor or a custom processor with a four-channel CIS strategy. The best cochlear implant user showed similar performance with the CIS strategy in quiet and in noise to that of normal-hearing listeners when listening to correspondingly spectrally degraded speech. These findings suggest that the noise susceptibility of cochlear implant users is at least partly due to the loss of spectral resolution. Efforts to improve the effective number of spectral information channels should improve implant performance in noise.
The Journal of the Acoustical Society of America 01/1999; 104(6):3586-96. · 1.55 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: This study is part of a program to develop an auditory prosthesis for the profoundly deaf, based on multichannel microstimulation in the cochlear nucleus. The functionality of such a device is dependent on its ability to access the tonotopic axis of the human ventral cochlear nucleus in an orderly fashion. In these studies, we utilized the homologies between the human and feline ventral cochlear nuclei and the known tonotopic organization of the central nucleus of the inferior colliculus (IC). In anesthetized cats, stimuli were delivered to three or four locations along the dorsal-to-ventral axis of the posteroventral cochlear nucleus (PVCN), and for each stimulus location, we recorded the multiunit neuronal activity and the field potentials at 20 or more locations along the dorsolateral-ventromedial (tonotopic) axis of the IC. The current source-sink density (CSD), which delimits regions of neuronal activity, was computed from the sequence of field potentials recorded along this axis. The multiunit activity and the CSD analysis both showed that the tonotopic organization of the PVCN can be accessed in an orderly manner by intranuclear microstimulation in several regions of the PVCN, using the range of stimulus pulse amplitudes that have been shown in previous studies to be noninjurious during prolonged intranuclear microstimulation via chronically implanted microelectrodes. We discuss the applicability of these findings to the design of clinical auditory prostheses for implantation into the human cochlear nucleus.
IEEE Transactions on Rehabilitation Engineering 01/1999; 6(4):391-9.
-
[show abstract]
[hide abstract]
ABSTRACT: This study is part of a program to develop an auditory prosthesis
for the profoundly deaf, based on multichannel microstimulation in the
cochlear nucleus. The functionality of such a device is dependent on its
ability to access the tonotopic axis of the human ventral cochlear
nucleus in an orderly fashion. In these studies, the authors utilized
the homologies between the human and feline ventral cochlear nuclei and
the known tonotopic organization of the central nucleus of the inferior
colliculus (IC). In anesthetized cats, stimuli were delivered to three
or four locations along the dorsal-to-ventral axis of the posteroventral
cochlear nucleus (PVCN), and for each stimulus location, the authors
recorded the multiunit neuronal activity and the field potentials at 20
or more locations along the dorsolateral-ventromedial (tonotopic) axis
of the IC. The current source-sink density (CSD), which delimits regions
of neuronal activity, was computed from the sequence of field potentials
recorded along this axis. The multiunit activity and the CSD analysis
both showed that the tonotopic organization of the PVCN can be accessed
in an orderly manner by intranuclear microstimulation in several regions
of the PVCN, using the range of stimulus pulse amplitudes that have been
shown in previous studies to be noninjurious during prolonged
intranuclear microstimulation via chronically implanted microelectrodes.
The authors discuss the applicability of these findings to the design of
clinical auditory prostheses for implantation into the human cochlear
nucleus
IEEE Transactions on Rehabilitation Engineering 01/1999;
