National Institute on Deafness and Other Communication Disorders (NIDCD)
NIDCD/ORD Workshop on Brain Computer Interfaces for Speech Synthesis
May 25 – 26, 2006 • Bethesda, MD
Agenda
| Thursday, May 25 |
|
| 7:30 a.m. | Registration |
| 8:00 a.m. | Welcome: Orientation Lana Shekim, Ph.D. Roger Miller, Ph.D. |
| 8:15 a.m. | The Locked-in Patient: Current Best Practices for Care and Rehabilitation David Beukelman, Ph.D. |
| 9:00 a.m. | Locked-in Patient: Initial Progress with BCI Phil Kennedy, M.D., Ph.D. |
| 10:15 a.m. | BCI-EEG and other Minimally Invasive Methods Theresa Vaughn |
| 11:00 a.m. | BCI-ECoG Electrodes and Conservatively Invasive Methods Erik Edwards (Robert Knight, M.D., Lab) |
| 1:00 p.m. | Low Bandwidth Communication Technologies Carol Espy-Wilson, Ph.D. |
| 1:45 p.m. | Roundtable Discussion: Minimally Invasive Approaches of BCI Control and Speech Synthesis Dan Sklare |
| 2:45 p.m. | Learning BCI Control of an Arm Prosthesis Meel Velliste, Ph.D. (Andy Schwartz, Ph.D., Lab) |
| 3:30 p.m. | Neural Control of Fine Motor Movement and Speech Michael Weinrich, M.D. |
| 4:15 p.m. | Contemporary Designs for Recording Electrodes: Cyberkinetic Electrode Leigh Hochberg, M.D., Ph.D. |
| 5:00 p.m. | Contemporary Designs for Recording Electrodes: Michigan Electrode Pamela Bhatti (Ken Wise, Ph.D., Lab) |
| 5:45 p.m. | Adjourn |
| Friday, May 26 |
|
| 8:00 a.m. | Cortical Implant Technology: Lessons Learned from Cortical Stimulation in the Occipital Cortex Philip Troyk, Ph.D. |
| 8:45 a.m. | Speech Synthesis from High Bandwidth BCIs: Lessons Learned from the Cochlear Implant Leslie Collins, Ph.D. |
| 9:30 a.m. | Statistical Analysis of Neural Responses for Communication Technologies Anthony Brockwell, Ph.D. |
| 10:30 a.m. | Using Laryngeal Nerve Output and Speech Synthesis to Improve Electrolarynx Communication Robert Hillman, Ph.D. |
| 11:15 a.m. | Roundtable Discussion: Clinical Issues for Invasive Approaches, User Training, and Rehabilitation |
| 12:00 noon | Wrap-up and Final Panel Recommendations |
| 12:30 p.m. | Adjourn |
Speakers
| David Beukelman, Ph.D. Professor Special Education and Communication Disorders University of Nebraska/Lincoln P.O. Box 830732 Lincoln, NE 68583-0732 Pamela Bhatti Anthony Brockwell, Ph.D Leslie Collins, Ph.D. Uri Tzvi Eden, Ph.D. Erik Edwards Carol Espy-Wilson, Ph.D. Robert Hillman, Ph.D Leigh Hochberg, M.D., Ph.D. Phil Kennedy, M.D., Ph.D. Philip Troyk, Ph.D. Jan Van Santen, Ph.D. Theresa Vaughn Meel Velliste, Ph.D. Michael Weinrich, M.D. Kathryn Yorkston, Ph.D. |
Summary
| The National Institute on Deafness and Other Communication Disorders (NIDCD) and the NIH Office of Rare Diseases jointly sponsored a workshop to evaluate the potential for brain-computer interfaces (BCIs) to provide a means for speech synthesis and control of other forms of assistive technology that support communication in patients who are locked in. The workshop was held May 26–27 at the Bethesda Hyatt Regency Hotel. Sixteen scientists and clinicians attended to discuss topics ranging from BCI data acquisition and analysis, cortex neurophysiology, speech synthesis, augmentative and alternative communication, and patient care needs for the locked-in patient.
The meeting began with an overview of the practices currently used to provide augmentative and alternative communication for patients. These techniques make effective use of existing technology, such as laser pointers, and residual movement control in patients. Other presentations highlighted the potential for advancement in this area by pioneering patient studies. For example, one patient has already been implanted with a recording electrode in Broca’s area of the cortex. Research and development activities are under way to create a means for this patient to control speech synthesis software, based on signals recorded from clusters of neurons. Other groups have developed an approach based on an array of electrodes that has been implanted in a patient’s cortex. The activity of cortical neurons is varied by the patient and control over the horizontal and vertical movement of a computer cursor has been demonstrated. Further research and development in these areas holds great promise for the development of a high-bandwidth controller that could be used to benefit both paralyzed and locked-in individuals. Useful control signals can also be obtained from electrodes placed near the surface of the cortex or outside of the skull; these techniques were reviewed at the workshop and their relative merits were discussed. Signals are based on the correlated activity taken from many cortical neurons in this approach. Trained users using electroencephalograph electrodes have demonstrated the ability to control the vertical and horizontal movement of a computer curser to achieve a variety of tasks, including the control of spelling software. Although the field is poised to make substantial progress based on the use of BCIs as they reach the stage of translation from the laboratory benchtop, substantial obstacles remain. The goal of creating software capable of extracting the intended action and/or communication, based on the neural response acquired, is likely to be a challenging problem. A number of different algorithms that could be used to decode the patient’s intended speech, based on changes in neural activity, were discussed by experts in this area of statistics and engineering. Algorithm development for control signals will be a substantial challenge in this area, but a number of approaches are already in development and are likely to accelerate efforts. The basic acoustic parameters that vary during normal speech production were also reviewed by experts in this field. Issues that affect the intelligibility of speech in patients with damage to the larynx and laryngeal nerve were discussed. Intelligent spelling algorithms were identified as useful tools in this area, such as the Dasher software that assists the users by taking into account the relative probability of subsequent letters and words based on those preceding them. Development efforts would also need access to shared software libraries that provide communication capabilities that scale up in capability according to the quality of the control signals. The need for shared resources extends to the raw data acquired from cortex neurons in subjects attempting to speak or speaking normally; various means of sharing available data across groups interested in this new area of research were explored. In the concluding discussions, there was widespread agreement that research and development in this area would benefit from input across a number of interdisciplinary groups. NIDCD is actively encouraging continued development in this area through the NIDCD Translational Research funding opportunity announcements and investigator-initiated R01 grant applications. Support for continued meetings that foster development of this technology as a communication device is also likely to be useful; the meeting participants were encouraged to formulate plans for further conferences specifically devoted to this topic. |
 |
|
 |