TiD-Introducing and Benchmarking an Event-Delivery System for Brain-Computer Interfaces.

In this paper, we present and analyze an event distribution system for brain-computer interfaces. Events are commonly used to mark and describe incidents during an experiment and are therefore critical for later data analysis or immediate real-time processing. The presented approach, called Tools for brain-computer interaction interface D (TiD), delivers messages in XML format via a buslike system using transmission control protocol connections or shared memory. A dedicated server dispatches TiD messages to distributed or local clients. The TiD message is designed to be flexible and contains time stamps for event synchronization, whereas events describe incidents, which occur during an experiment. TiD was tested extensively toward stability and latency. The effect of an occurring event jitter was analyzed and benchmarked on a reference implementation under different conditions as gigabit and 100-Mb Ethernet or Wi-Fi with a different number of event receivers. A 3-dB signal attenuation, which occurs when averaging jitter influenced trials aligned by events, is starting to become visible at around 1-2 kHz in the case of a gigabit connection. Mean event distribution times across operating systems are ranging from 0.3 to 0.5ms for a gigabit network connection for 106 events. Results for other environmental conditions are available in this paper. References already using TiD for event distribution are provided showing the applicability of TiD for event delivery with distributed or local clients.

A hybrid three-class brain-computer interface system utilizing SSSEPs and transient ERPs.

OBJECTIVE: This paper investigates the fusion of steady-state somatosensory evoked potentials (SSSEPs) and transient event-related potentials (tERPs), evoked through tactile simulation on the left and right-hand fingertips, in a three-class EEG based hybrid brain-computer interface. It was hypothesized, that fusing the input signals leads to higher classification rates than classifying tERP and SSSEP individually. APPROACH: Fourteen subjects participated in the studies, consisting of a screening paradigm to determine person dependent resonance-like frequencies and a subsequent online paradigm. The whole setup of the BCI system was based on open interfaces, following suggestions for a common implementation platform. During the online experiment, subjects were instructed to focus their attention on the stimulated fingertips as indicated by a visual cue. The recorded data were classified during runtime using a multi-class shrinkage LDA classifier and the outputs were fused together applying a posterior probability based fusion. Data were further analyzed offline, involving a combined classification of SSSEP and tERP features as a second fusion principle. The final results were tested for statistical significance applying a repeated measures ANOVA. MAIN RESULTS: A significant classification increase was achieved when fusing the results with a combined classification compared to performing an individual classification. Furthermore, the SSSEP classifier was significantly better in detecting a non-control state, whereas the tERP classifier was significantly better in detecting control states. Subjects who had a higher relative band power increase during the screening session also achieved significantly higher classification results than subjects with lower relative band power increase. SIGNIFICANCE: It could be shown that utilizing SSSEP and tERP for hBCIs increases the classification accuracy and also that tERP and SSSEP are not classifying control- and non-control states with the same level of accuracy.

The Role of Transient Target Stimuli in a Steady-State Somatosensory Evoked Potential-Based Brain-Computer Interface Setup.

In earlier literature, so-called twitches were used to support a user in a steady-state somatosensory evoked potential (SSSEP) based brain-computer interface (BCI) to focus attention on the requested targets. Within this work, we investigate the impact of these transient target stimuli on SSSEPs in a real-life BCI setup. A hybrid BCI was designed which combines SSSEPs and P300 potentials evoked by twitches randomly embedded into the streams of tactile stimuli. The EEG of fourteen healthy subjects was recorded, while their left and right index fingers were simultaneously stimulated using frequencies selected in a screening procedure. The subjects were randomly instructed by a cue on a screen to focus attention on one or none of the fingers. Feature for SSSEPs and P300 potentials were extracted and classified using separately trained multi-class shrinkage LDA classifiers. Three-class classification accuracies significantly better than random could be reached by nine subjects using SSSEP features and by 12 subjects using P300 features respectively. The average classification accuracies were 48.6% using SSSEP and 50.7% using P300 features. By means of a Monte Carlo permutation test it could be shown that twitches have an attenuation effect on the SSSEP. Significant SSSEP blocking effects time-locked to twitch positions were found in seven subjects. Our findings suggest that the attempt to combine different types of stimulation signals like repetitive signals and twitches has a mutual influence on each other, which may be the main reason for the rather moderate BCI performance. This influence is originated at the level of stimulus generation but becomes apparent as physiological effect in the SSSEP. When designing a hybrid BCI based on SSSEPs and P300 potentials, one has to find an optimal tradeoff depending on the overall design goals or individual subjects' performance. Our results give therefore some new insights that may be useful for the successful design of hybrid BCIs.

A Tactile Stimulation Device for EEG Measurements in Clinical Use.

A tactile stimulation device for EEG measurements in clinical environments is proposed. The main purpose of the tactile stimulation device is to provide tactile stimulation to different parts of the body. To stimulate all four major types of mechanoreceptors, different stimulation patterns with frequencies in the range of 5-250 Hz have to be generated. The device provides two independent channels, delivers enough power to drive different types of electromagnetic transducers, is small and portable, and no expensive components are required to construct this device. The generated stimulation patterns are very stable, and deterministic control of the device is possible. To meet electrical safety requirements, the device was designed to be fully galvanically isolated. Leakage currents of the entire EEG measurement system including the tactile stimulation device were measured by the European Testing and Certifying Body for Medical Products Graz (Notified Body 0636). All measured currents were far below the maximum allowable currents defined in the safety standard EN 60601-1:2006 for medical electrical equipment. The successful operation of the tactile stimulation device was tested during an EEG experiment. The left and right wrist of one healthy subject were randomly stimulated with seven different frequencies. Steady-state somatosensory evoked potential (SSSEPs) could successfully be evoked and significant tuning curves at electrode positions contralateral to the stimulated wrist could be found. The device is ready to be used in clinical environment in a variety of applications to investigate the somatosensory system, in brain-computer interfaces (BCIs), or to provide tactile feedback.

Stability and distribution of steady-state somatosensory evoked potentials elicited by vibro-tactile stimulation.

Steady-state somatosensory evoked potentials (SSSEPs) have been elicited applying vibro-tactile stimulation to all fingertips of the right hand. Nine healthy subjects participated in two sessions within this study. All fingers were stimulated 40 times with a 200-Hz carrier frequency modulated with a rectangular signal. The frequencies of the rectangular signal ranged between 17 and 35 Hz in 2 Hz steps. Relative band power tuning curves were calculated, introducing two different methods. Person-specific resonance-like frequencies were selected based on the data from the first session. The selected resonance-like frequencies were compared with the second session using an ANOVA for repeated measures to investigate the stability of SSSEPs over time. To determine, if SSSEPs can be classified with a classifier based on unseen data, an LDA classifier was trained with data from the first and applied to data from the second session. Person-specific resonance-like frequencies within a range from 19 to 29 Hz were found. The relative band power of the resonance-like frequencies did not differ significantly between the two sessions. Significant differences were found for the two methods and the used channels. SSSEPs were classified with a hit rate from 51 to 96 %.

Proposing a standardized protocol for raw biosignal transmission.

In this paper, we propose a standardized interface called TiA (TOBI interface A) to transmit raw biosignals, supporting multirate and block-oriented transmission of different kinds of signals from various acquisition devices (e.g., EEG, electrooculogram, near-infrared spectroscopy signals, etc.) at the same time. To facilitate a distinction between those kinds of signals, so-called signal types are introduced. TiA is a single-server, multiple-client system, whereby clients can connect to the server at runtime. Information transfer between client and server is divided into control and data connections. The control connections use transmission control protocol (TCP) and transmit extensible-markup-language (XML)-encoded meta information. The data transmission utilizes a user datagram protocol (UDP) or TCP with a binary data stream. A standardized handshaking procedure for the connection setup and a standardized binary data packet has been defined. Thus, a standardized layer, abstracting used hardware devices and facilitating distributed raw data transmission in a standardized way, has been evolved. A cross-platform library, implemented in C ++, is available for download.

Tools for Brain-Computer Interaction: A General Concept for a Hybrid BCI.

The aim of this work is to present the development of a hybrid Brain-Computer Interface (hBCI) which combines existing input devices with a BCI. Thereby, the BCI should be available if the user wishes to extend the types of inputs available to an assistive technology system, but the user can also choose not to use the BCI at all; the BCI is active in the background. The hBCI might decide on the one hand which input channel(s) offer the most reliable signal(s) and switch between input channels to improve information transfer rate, usability, or other factors, or on the other hand fuse various input channels. One major goal therefore is to bring the BCI technology to a level where it can be used in a maximum number of scenarios in a simple way. To achieve this, it is of great importance that the hBCI is able to operate reliably for long periods, recognizing and adapting to changes as it does so. This goal is only possible if many different subsystems in the hBCI can work together. Since one research institute alone cannot provide such different functionality, collaboration between institutes is necessary. To allow for such a collaboration, a new concept and common software framework is introduced. It consists of four interfaces connecting the classical BCI modules: signal acquisition, preprocessing, feature extraction, classification, and the application. But it provides also the concept of fusion and shared control. In a proof of concept, the functionality of the proposed system was demonstrated.

Somatosensory evoked potentials elicited by stimulating two fingers from one hand--usable for BCI?

Steady-state somatosensory evoked potentials (SSSEPs) have been elicited using vibro-tactile stimulation on two fingers of the right hand. Fourteen healthy subjects participated in this study. A screening session, stimulating each participant's thumb, was conducted to determine individual optimal resonance-like frequencies. After this screening session, two stimulation frequencies per subject were selected. Stimulation was then applied simultaneously on the participant's thumbs and middle finger. It was investigated whether it is possible to classify SSSEP changes based on an attention modulation task to determine possible BCI applications. A cue indicated the participants to shift their attention to either the thumb or the middle finger. Offline classification with a lock-in analyzer system (LAS) and a linear discriminant analysis (LDA) classifier was performed. One bipolar channel and no further optimization methods were used. All participants except one reached classification results above chance level classifying a reference period without focused attention against focused attention either to the thumb or the middle finger. Only two subjects reached accuracies above chance, classifying focused attention to the thumb vs. attention to the middle finger.

A concept to standardize raw biosignal transmission for brain-computer interfaces.

With this concept we introduced the attempt of a standardized interface called TiA to transmit raw biosignals. TiA is able to deal with multirate and block-oriented data transmission. Data is distinguished by different signal types (e.g., EEG, EOG, NIRS, …), whereby those signals can be acquired at the same time from different acquisition devices. TiA is built as a client-server model. Multiple clients can connect to one server. Information is exchanged via a control- and a separated data connection. Control commands and meta information are transmitted over the control connection. Raw biosignal data is delivered using the data connection in a unidirectional way. For this purpose a standardized handshaking protocol and raw data packet have been developed. Thus, an abstraction layer between hardware devices and data processing was evolved facilitating standardization.

Switching between Manual Control and Brain-Computer Interface Using Long Term and Short Term Quality Measures.

Assistive devices for persons with limited motor control translate or amplify remaining functions to allow otherwise impossible actions. These assistive devices usually rely on just one type of input signal which can be derived from residual muscle functions or any other kind of biosignal. When only one signal is used, the functionality of the assistive device can be reduced as soon as the quality of the provided signal is impaired. The quality can decrease in case of fatigue, lack of concentration, high noise, spasms, tremors, depending on the type of signal. To overcome this dependency on one input signal, a combination of more inputs should be feasible. This work presents a hybrid Brain-Computer Interface (hBCI) approach where two different input signals (joystick and BCI) were monitored and only one of them was chosen as a control signal at a time. Users could move a car in a game-like feedback application to collect coins and avoid obstacles via either joystick or BCI control. Both control types were constantly monitored with four different long term quality measures to evaluate the current state of the signals. As soon as the quality dropped below a certain threshold, a monitoring system would switch to the other control mode and vice versa. Additionally, short term quality measures were applied to check for strong artifacts that could render voluntary control impossible. These measures were used to prohibit actions carried out during times when highly uncertain signals were recorded. The switching possibility allowed more functionality for the users. Moving the car was still possible even after one control mode was not working any more. The proposed system serves as a basis that shows how BCI can be used as an assistive device, especially in combination with other assistive technology.