Full text
sensors Article Characterizing Computer Access Using a One-Channel EEG Wireless Sensor Alberto J. Molina-Cantero 1,*,†, Jaime Guerrero-Cubero 1,†, Isabel M. Gómez-González 1,†, Manuel Merino-Monge 1,† and Juan I. Silva-Silva 2 1Departamento de Tecnología Electrónica, ETS Ingeniería Informática, Universidad de Sevilla, Campus de Reina Mercedes, Sevilla 41012, Spain; jaimer[email protected] (J.G.-C.); [email protected] (I.M.G.-G.); [email protected] (M.M.-M.) 2ASPACE Sevilla, Dos Hermanas, Sevilla 41704, Spain; [email protected] *Correspondence: [email protected]; Tel.: +34-9545-52787 † Current address: ETS Ingeniería Informática, Campus de Reina Mercedes sn, Sevilla 41012, Spain Received: 1 June 2017; Accepted: 26 June 2017; Published: 29 June 2017 Abstract: This work studies the feasibility of using mental attention to access a computer. Brain activity was measured with an electrode placed at the Fp1 position and the reference on the left ear; seven normally developed people and three subjects with cerebral palsy (CP) took part in the experimentation. They were asked to keep their attention high and low for as long as possible during several trials. We recorded attention levels and power bands conveyed by the sensor, but only the first was used for feedback purposes. All of the information was statistically analyzed to find the most significant parameters and a classifier based on linear discriminant analysis (LDA) was also set up. In addition, 60% of the participants were potential users of this technology with an accuracy of over 70%. Including power bands in the classifier did not improve the accuracy in discriminating between the two attentional states. For most people, the best results were obtained by using only the attention indicator in classification. Tiredness was higher in the group with disabilities (2.7 in a scale of 3) than in the other (1.5 in the same scale); and modulating the attention to access a communication board requires that it does not contain many pictograms (between 4 and 7) on screen and has a scanning period of a relatively high tscan ≈10 s. The information transfer rate (ITR) is similar to the one obtained by other brain computer interfaces (BCI), like those based on sensorimotor rhythms (SMR) or slow cortical potentials (SCP), and makes it suitable as an eye-gaze independent BCI. Keywords: cerebral palsy; attention; brain computer interface; wireless EEG sensor; linear discriminant analysis 1. Introduction Communication is vital for human beings. A system allowing people with disabilities to access a computer or a communication system reliably, with little effort and as fast as possible, would be highly beneficial. There are several devices on the market and scientific papers which translate user intentionality into events. The simplest and one of the most extended is based on a binary switch (on/off contacts). A good survey for assistive devices can be found in [1]. Most organizations that give care to people with disabilities use such devices on a massive scale so that they can use software applications, particularly those based on scanning methods, by simply connecting the switch to an adapted device which translates user movements into software selections (mouse clicks, enter keystroke, etc.). For people with severe disabilities, such as those with hypothonic, ataxic neuro-muscular diseases or ALS (amyotrophic lateral sclerosis), these simple devices are still very difficult to use. For them, BCI (brain computer interfaces) systems could be a feasible alternative. Sensors 2017,17, 1525; doi:10.3390/s17071525 www.mdpi.com/journal/sensors
Sensors 2017,17, 1525 2 of 23 BCI systems [ 2 , 3 ] are based on recording cortical neuronal activity, and one way to achieve this is by means of EEG (Electro-Encephalo-Graphy), which requires several electrodes placed on the scalp. One possible drawback with these systems is their cost, which prevents most people with disabilities from acquiring it. Nevertheless, some companies, such as Emotiv (San Francisco, CA, USA) and Neurosky (San Jose, CA, USA) have released their wireless BCI headsets (Emotiv Epoc, Neurosky mindwave, · · · ) for entertainment uses such as brain gaming and mind monitoring with affordable prices for the consumers. Emotiv has up to 14 channels covering all of the cerebral lobes and the two hemispheres, and it has also been studied as a potential BCI system for people with disabilities [ 4 ]. NeuroSky mindwave is cheaper than the Emotiv epoc, and it only has one channel placed at the pre-frontal left position, Fp1. In [ 5 ], a comparison was carried out between both low-cost systems to detect cognitive loads. The authors found that Emotiv provided better results but recognized the advantages of Neurosky because it is more user-friendly, easier to setup and maintain. Neurosky’s devices have been used in scientific research, for example, as low-cost EEG-based sleep or drowsiness detection systems [ 6 , 7 ], to measure the subject’s workload in [ 8 , 9 ] during the performance of different tasks, as an emergency call system [ 10 ], to assist people with reduced mobility in the school inclusion process [ 11 ], to categorize elite’s archers capability of attention control during shooting process [ 12 ] or for detecting or recognizing emotional [ 13 – 15 ], attentional [ 16 – 18 ] or relaxation [19,20] states. Neurosky mindwave delivers information that we can classify in three levels of processing. From lowest to higher levels, they are: raw EEG signal, power bands and eSense, which includes propietary meters for attention and meditation. Power bands and eSense signals help reduce the processing of the raw signals in external devices and allow for using digital systems with low computation resources. This work looks into the feasibility of using cognitive skills, like attention, to control a system in a binary way (on, -high attention-, off -low attention-), such as a switch. The experiment was performed first by normally developed people and then by people with cerebral palsy (CP) with severe motor dysfunction but with good intellectual capabilities. It includes the eSense attention signal and the power bands as well. Prior work can be found in [ 21 ], wherein people with CP took part in a experiment in which they had to control their attention and relaxation signals to play with different games. In those games, the players had to reach a certain level of attention and/or to keep it over a preset value to make the game advance. Results showed that the participants with CP could control their attentional level in a similar way to people without disabilities. However, using the attention to access a computer (i.e., to a communication application) requires a little more complex ability: to keep the attention low/high for a while and being volitionally able to switch between them. In this work, we first investigated the accuracy in detection of the high/low levels of attention by means of a linear discriminant classifier and then proposed a method to estimate the accuracy of using a communication system. Section 2briefly explains the fundamentals of attention and some techniques used to measure it. Section 3describes the methodology followed in experimentation, Sections 4and 5the results and how we used them to characterize the computer access, and, finally, Sections 6and 7contain the discussion and the conclusions respectively. 2. Measuring the Attention Attention is the ability to focus continuously on a particular action, thought or object. Attention is controlled by both cognitive top-down factors, such as knowledge, expectation and current goals, and bottom-up factors that reflect sensory stimulation. For example, brightly colored or fast moving objects are often important and are therefore salient stimuli (bottom-up). However, intelligent behavior depends on top-down control signals that can modulate sensory processing in favor of inputs more relevant to achieving long-term goals. Neurophysiological studies have begun to distinguish the circuitry, within a shared frontal-parietal network, that guides top-down and bottom-up attention. Namely, cognitive factors in attention (top-down) arises from the lateral prefrontral cortex (LPFC) [22,23] (see Figure 1).
Sensors 2017,17, 1525 3 of 23 Figure 1. On the left, the lateral prefrontral cortex (LPFC) and the Brodmann areas related to it. On the right, the electrodes’ placement in the 20-20 international system mainly affected by LPFC. The position of the Neurosky’s electrode is also shown. Several physiological markers can be used to indicate attention levels: eye tracking is a popular and a simple approach for estimating the focus of visual attention; eye pupil dilation, which is proportional to attention; the blinking rate, which decreases as attention level increases [ 24 , 25 ] and the modulation of the EEG activity. From a temporal point of view, attention makes EEG signals more complex, so its measurement could be based on its fractal dimension. Several works have shown the reliability of such an approach [ 26 – 29 ]. There have also been some works on the effects that attention or cognitive skills have on power bands. In general, the α band increases as the difficulty of the task diminishes or after task practice, suggesting that fewer cortical resources are required [ 30 ]. In the same work, increases in θ suggested that focusing attention or increasing the memory load require more effort. A prolonged period of cognitive activity leads to mental fatigue which is associated with an increment in frontal θ and α activity [ 31 ], but after α power reaches a value, θ goes on increasing. In [ 32 ], an increment was reported in δ activity related to attention to internal processing during the performance of a mental task. The use of the ratio between frequency bands like θ/β , known as TBR, has also been reported as an indicator for attention deficit disorder (ADD) or hyperactivity disorder (ADHD) patients [33]. TBR is increased in frontocentral children suffering from attention deficit disorders. Some papers have shown the feasibility of detecting different relaxation and attention states using a reduced number of electrodes. For instance, in [ 34 ], two sets of electrodes were used to control the position of an object on a computer screen by means of concentration. One set had 16 electrodes covering different areas and hemispheres on the scalp. The other set had only one electrode placed at the Pz position. Results showed that a high percentage of participants (70%) in the experiment could control the game using only one electrode. Such a percentage increased when the first set of electrodes was used. In [ 35 ], two electrodes at positions Fp1 and Fp2 were used to detect the relaxation level. Authors reported that the sum of α+θ , and α+β+θ were good indexes for the measurement of relaxation. In [36], five different bipolar configurations of two electrodes were investigated during attention exercises. Results showed that EEG rhythms were observed with more amplitude in two EEG channels: Fp1-A1 and FP1-T3. They adopted the configuration Fp1-A1 because those positions are free of hair, which allows an easy electrode placement (these are the positions used in the Neurosky mindwave). They also found that the α , β and γ rhythms presented significant differences (p< 0.05) between low- and high-attention levels. For this reason, they proposed an index, named attention power (AP), based on the sum of the power α and β bands to control a game. Eighty percent of the subjects found correlation between his/her attention level and the effect exerted over the game. Neurosky’s manufacturer states that attention signal has more emphasis on beta wave, but the exact algorithm has not been published.
Sensors 2017,17, 1525 4 of 23 Nevertheless, several studies have shown the feasibility of using this device for measuring the attention level. In [ 16 ], it was shown that there is a positive correlation between the reported attention level of this device and the self-reported attention levels of the participants in an experiment that analyzed the Neurosky usability in an assessment exercise. In [ 37 ], the single-channel EEG device accurately measured the overall level of mental attention in children with developmental coordination disorders clinically and was not significantly influenced by eye blinking. 3. Methodology 3.1. Materials Neurosky’s mindwave is a device that measures brain activity using a sensor on the forehead (Fp1) and a clip located on the left ear that acts as a ground and reference. It can provide a raw signal at a sampling rate of 512 Hz and 12 bits of resolution as well as processed information like power bands δ , θ , α , β and γ , attention and meditation indicators. However, bands and indicators are sent at a rate of 1 Hz. We also developed a training software, running on a tablet computer with an Android operative system and 10 00 screen, so that subjects could practice the control of their attention. Such software captures data conveyed from Neurosky’s sensor and stores them in an internal database. For neuro-feedback purposes, the whole screen shows a bar that moves up and down, changing its color according to the received attention values that ranged from 0 to 100 like a percentage. The higher the attention value, the higher the bar shown on the screen (Figure 2). The color of such a bar is green for an attention level over 60%, red if it is under 40% and yellow otherwise. Figure 2. Screenshot during attention and non-attention trials. The left picture shows a big green bar associated to high values of attention. The right one shows a small red bar associated to low attention values. 3.2. Artifact Rejection The software checks the POORSIGNAL indicator sent by Neurosky’s mindave every second. A value of 0 in this indicator guarantees good contact between electrodes and the skin and, therefore, a good quality signal. In the case of poor signal quality, the attention value is rejected and not recorded by the software. On the other hand, the manufacturer also guarantees that the attention is obtained from applying an algorithm after removing the ambient noise and muscle movements from the raw brain signal [ 38 ]. Nevertheless, we included a second stage of verification of signal quality based on artifact detection in the non-overlapping epochs of 512 samples (1 s of duration) previous to the time the attention value
Sensors 2017,17, 1525 5 of 23 is updated. If such an epoch does not contain muscle activity or blinks, then the attention value is admitted as a valid one. To accomplish this, we have used two features: the difference between the maximum and minimum sample value (MinMax), and the total energy (ESF) of the signal after applying a Savitzky–Golay lowpass filter (order 2 and length 35) [ 39 ] and substracting it to the raw signal. Figure 3shows a segment of an EEG signal highly contaminated by EMG and Blinks artifacts and the obtained space of features. Epochs containing muscular activity have values of the MinMax feature that are similar or a bit higher than those of the epochs with only EEG, but with more energy from the filtered signal (ESF). Blinking or EEG-only windows have similar values in the ESF feature but differ in MinMax. Finally, windows with motion artifact contain values of these features that surround those obtained by other types of artifacts. For all of these reasons, the use of thresholds (maximum and minimum) of each dimension of the feature space has been proposed, to limit and facilitate the automatic detection of valid EEG container segments and blinks (as shown in Figure 3) with an accuracy of 96% and 98%, respectively. The method followed is conservative in the selection of valid epochs, reducing the number of false positives. Figure 3. ( a ) a segment of a raw signal containing Electromyographic (EMG) artifacts and Blinks artifacts; ( b ) feature space wherein EEG signal epochs are in black, while epochs containing EMG, blink or motion artifacts are in blue, green and pink, respectively.
Sensors 2017,17, 1525 6 of 23 3.3. Participants Seven normally developed subjects (A1, · · · , A7) aged 36.4 ± 10.2 formed group A (control group) and three subjects with CP (B1, · · · , B3) aged 35.3 ± 1.2 made up group B, who were recruited from ASPACE Sevilla, a non-governmental organization specialized in cerebral palsy. The recruitment into group B was done according to the following inclusion criteria: 1. The access to a computer by traditional switch-based devices is usually very hard to be carried out or almost impossible. 2. Have good intellectual capabilities. 3. Gross Motor Functional Classification System (GMFCS) Level V [40]. 4. Communication Function Classification System (CFCS) Level IV [41]. Although ASPACE is the most important association dedicated to deal with people with CP in the province of Seville, there were not many people who met the inclusion criteria, so it was difficult to perform the experimentation with a large population. Only six out of 69 subjects met it, but just three of them took part in this experiment. The participants agreed to take part in the experiment and in the case of group B, their families were informed and allowed their participation. The Ethics Committee of the University of Seville also approved this experiment. 3.4. Conditions Experimentation was carried out in a quiet room with dim lighting. The experiment was considered correct if there were no interruptions. Participants belonging to group A were told to set the environmental conditions (temperature, lighting) so that they were comfortable during the experiment. For group B subjects, experimentation was conducted by a caregiver who was always present and set the environmental conditions. 3.5. Phases in Experimentation Experimentation consisted of two phases (see Figure 4). As explained below, in the first phase, the participants had to find the strategies to control their attention. Those who would not have been able to control their mental state properly did not perform the following phase. The second phase was similar to the first with the difference that we recorded the information sent by the sensor during the attention/non-attention trials. 3.5.1. Phase 1 The main goal of phase 1, also called ”Freestyle”, was to practice and try to find the best strategies to control attention levels. Previously, they were told to follow a series of basic strategies. For instance, to practice attention we told them: ”try to perform mathematical operations”, ”try to plot an object mentally”, etc. To practice non-attention, we suggested: ”try not to think about anything”, ”make your mind go blank”, etc. These suggestions were to get them going, and they each had to find the best way of controlling her/his level of attention. We used the software explained above to give participants feedback about how they were performing the experimentation. The caregiver sometimes asked participants in group B to perform several attention/non-attention actions to get some feedback about their achievements. The number of sessions in phase 1 depended on the subject, but to prevent this phase from becoming too drawn out, we set an upper limit of 10, roughly 15 min sessions.
Sensors 2017,17, 1525 7 of 23 Figure 4. Experimental time sequence. Phase 1: Subjects must find the strategies to control their attention levels. A maximum of ten 15-min sessions was set. Phase 2: Five 14-min sessions with seven attention/non-attention trials. Each trial contains an ending relaxing period of 30 s. At the end of each session in this phase, group A participants were asked to fill in a short questionnaire about how well they had performed the experiment. Those who admitted not having controlled attention properly in more than two out of the last five sessions were excluded from the following phase. In group B, the caregiver was responsible for discriminating such participants. 3.5.2. Phase 2 In this phase, participants performed a sequence of 5, 14-min sessions (one per day). Each session consisted of 14, 1-min, trials divided into two 30-s parts. In the first part, subjects had to keep their attention level above or below a threshold of 50% as soon as the application requested it. In the last 30-s part of the trial, the subject had to relax and, to help participants do so, the software showed an idyllic landscape on screen. Attention/non-attention experiments were made in odd and even trials, respectively. Figure 4shows the time schedule of this phase. The software recorded the processed information sent by Neurosky (attention level, power bands, etc., see Section 3for more details). For each participant and session, a total of 10 parameters/s × 14-min × 60 s/min were obtained for posterior analysis. As in the previous phase, a three-question survey (Table 1) was given to participants to be answered using a three Likert item rating as follows: 1 (no, badly), 2 (neutral), 3 (yes, well). Obviously, for group B, the survey was filled in by the caregiver after asking and interpreting subjects’ answers. The difficulty in interpreting subjects’ answers was the main reason to select such a reduced number of responses on the Likert’s scale. Table 1. Test questions to be answered at the end of each session in phase 2. (a) Could you keep your attention level high when required? (b) Could you keep your attention level low when required? (c) Did you get tired? 4. Results Data were analyzed using GNU Octave version 3.8.1 and R version 3.0.2. The first analysis was to find out how the method for identifying attentional states had worked. As the variable selected to control feedback to the user was the attention signal, the exploratory analysis was based solely on this. Furthermore, we will look at other signals in the study at a later stage. Phase 1 removed four participants from group A and one for group B. Namely, participants A5–A7 and B1 were unable to control their attention level and did not go on the following phase.
Sensors 2017,17, 1525 8 of 23 4.1. Exploratory Analysis Figure 5shows boxplots containing the results of phase 2 for each subject and session, differentiating between attention trials (green boxes) and non-attention ones (red boxes). Each box contains seven values representing the average of the attention percentages of a trial in a session. The figure shows that subjects A1, A2 and A3 performed the experiment rather well, as the attention boxes generally contained higher values (above the 50% threshold) than the non-attention ones (below 50%) and there was not excessive overlapping among them. It was clearly not easy to perform all sessions of the experiment perfectly. For example, participant A1 did not obtain good results in the last session; neither did A2 in the first and second sessions nor A3 mainly in the attention trials in session 3. Participants A4 and B3 behaved differently; they did not fulfill the goals since many of their results in the attention trials were below the threshold and many of those in the non-attention trials were above it. However, we should remark that for these two subjects in each session, the median values in the attention trials were higher than in the non-attention ones. Participant B2 performed similarly to A4 and B3 in the last three sessions. In the others, the subject’s attention level was almost always above the threshold with non-attention mean values higher than those in attention trials. Figure 5. Attention levels for participants and sessions. Green boxes contain averaged values for attention trials; red boxes the averaged values for non-attention trials. Table 2shows the mean and standard errors of some quantitative features that may characterize experimental results: • Successful score (SS). Percentage of time the subject met the goals: that is, when the attention level was kept above the threshold of 50% in attention trials or below it in non-attention ones. • The initial time, ¯ ti or time elapsed, on average, from the beginning of the trial until the subject made the attention level go above/below the threshold in attention/non-attention trials, respectively. We can differentiate ¯ tifor attention and non-attention trials calling it ton and to f f , respectively.
Sensors 2017,17, 1525 9 of 23 • Sustained attention time, ¯ ts , shows how long, on average, the subject could maintain the attention level without crossing the threshold. Table 2. Successful score, initial time and sustained attention time for each participant. Standard errors (SE) are also shown. Subject Condition SS (%)¯ ti±SE (s) ¯ ts±SE (s) A1 Attention 86.0 2.48 ±0.87 19.3 ±3.7 Non-attention 85.4 2.08 ±1.02 18.6 ±5.8 A2 Attention 79.1 4.29 ±1.44 18.8 ±4 Non-attention 83.6 2.19 ±0.62 17.7 ±1.9 A3 Attention 80.8 2.06 ±0.30 16.1 ±1.5 Non-attention 86.0 1.69 ±0.19 12.5 ±0.8 A4 Attention 57.9 2.91 ±0.66 10.7 ±2.5 Non-attention 63.1 4.63±1.67 11.4±2.0 B2 Attention 71.9 2.2 ±0.60 12.4 ±1.8 Non-attention 46.8 5.0 ±2.14 7.8 ±2.8 B3 Attention 69.5 2.0 ±0.46 11.0 ±1.3 Non-attention 63.7 2.6 ±0.62 11.0 ±2.5 Successful score and sustained time are fulfillment indicators of the experiment and they are dependent to a certain extent; thus, as SS increases, so does the sustained time. People who obtained high SS values in both types of trials performed the experiment better than those who obtained lower SS values (close to 50%) or unbalanced results between trials. Sustained time, ¯ ts , is strongly affected by the number of threshold crossings. Therefore, further away from the threshold, the attention level produced by the subject, the higher the value of the sustained time. A participant producing an attention level close to the threshold value is more likely to cross it and obtain a lower sustained time. According to these parameters, in group A, participants A1, A2, A3 performed the experiments quite well, since their successful scores were high and balanced between attention and non-attention trials. The sustained times were, in general, long (greater than 16.1 s) for them, although participant A3 obtained a lower result in non-attention trials. Participant A4 found it difficult to keep the attention level above/below the threshold so the SS values and the sustained time were the lowest achieved by participants in group A. In group B, participant B2 obtained unbalanced percentages between trials, which meant it was difficult for him to maintain the non-attention state for long. The sustained time for this participant also confirms this fact. Subject B3 was able to control the two states in a balanced way but not for long, as the sustained time indicates. In general, participants in group B performed worse than the other participants. Initial time ¯ ti and sustained time ¯ ts are related to the time needed to select a pictogram on a communicator board, when accessing a computer by changing the attentional state. Firstly, a threshold establishes the border between these two states, so a subject who wants to select a pictogram has to exceed such a threshold for a time. The time ¯ ti in attention trials ( ton ) shows the average time to cross such a threshold and reach the attention state. In the same way, the time ¯ ti in non-attention trials ( to f f ) shows the time taken to go back to the non-attention state. In between them, the attention level must be kept high for tw seconds so that the system can detect the user’s intention (see Figure 6). The dwell time or scanning period tscan depends on such temporal parameters. For example, participant A1 took ton = 2.48 s to change from ’resting’ to the attentional state and to f f = 2.08 s to come back again. This means that the scanning period, tscan has to be greater than 2.48 s (Equation (1)) on average and the tw greater than 2.08 s to avoid selecting the pictogram next to the preselected one (Equation (2)). The selection time, tw , is also related to sustained time, ¯ ts , as the latter sets the upper limit for the
Sensors 2017,17, 1525 16 of 23 whose accuracy curves showed a negative dependency on tw ). Other participants had high accuracy for a wide range of twvalues, so their accuracies would be relatively unaffected by this fact. Figure 9. Accuracy against window length, tw , for each participant and set of features. For most participants, the highest accuracies were obtained using the Set1 of features and short window lengths. Figure 10. Average Np against tw for each participant and set of features. As expected, Np decreases as twincreases. Optimal twmust be chosen to reduce Np, increase the accuracy and minimize tscan .
Sensors 2017,17, 1525 17 of 23 Table 7. Optimal accuracy and tw for Nicons = 4. Temporal parameters for the highlighted set of features are also included. Accuracy (topt w)(%) topt w(s) ton (s) tof f (s) Subject Set1 Set2 Set3 Set1 Set2 Set3 ¯ ton σton ¯ tof f σtof f A1 92.5 85.5 83.5 85 4 2.43 0.8 2.57 1.7 A2 72 69.5 72 8 5 42.74 1.1 1.82 0.5 A3 93.0 89.5 78.5 44 5 3.3 2 1.8 0.3 A4 67.5 72 54 15* 86 3.14 1.1 2.02 0.6 B2 73 70 66 55 4 3.24 1.9 2.5 1.3 B3 79.0 62.0 58.0 55 3 2.6 0.9 2.64 1 5.3. Information Transfer Rate The information transfer rate (ITR) [ 49 , 50 ] depends on the number of choices or thoughts (two in our case: attention high/low), the accuracy and the time the classifier needs to make a prediction. Figure 9shows that for the shortest window length used for classification, tw = 2 s, the accuracy is roughly over 80% for all participants when Set1 is used. Therefore, the participants in group A obtained an averaged ITR of 12.74 bits/min while the others had 11.34 bits/min. 5.4. Comparison with BCI Systems According to [ 2 ], these values of ITR would place this BCI method with others like those based on slow cortical potential (SCP), with an ITR between 5–12 bits/min, and sensorimotor rhythms (SMR), with an ITR between 3–35 bits/min, and approaching others such as the 14.4 bits/min obtained for healthy people using a P300 system [ 51 ]. However, these results are far away from other systems, such as steady-state visual evoked potentials (SSVEP). For example, in [ 52 ], the authors obtained an ITR that was equal to 105 bits/min. Other BCI interfaces are based on the hemodynamic response instead of the firing activity of the cortical neurons. Near Infrared Spectroscopy (NIRS) is a relatively new measurement modality [ 53 ] that measures such a response. As the hemodynamic is temporally delayed from the onset of the underlying neural activity, it is expected for a latency of several seconds to appear in response to a change in participants’ behavioral or mental states. This might severely limit the practical use of such systems. BCIs based on NRIS try to classify subjects’ intentions during motor imagery [ 54 , 55 ], arithmetic tasks [ 56 – 58 ] or both [ 59 ]. Typical ITRs for these systems are below the 4 bits/min [ 2 ] with accuracies ranging between 65–96.3% among them. Nevertheless, in a recent study [ 60 ], a complex NIRS device with 30 channels and a four-class classifier obtained an ITR equal to 5.82 bits/min with an accuracy of 87.58%. This result outperforms previous NIRS systems, but it is still far from the upper limit of our proposal. 5.5. Comparison with Non-BCI Systems For people with severe disabilities, a system that reliably allows them to access a computer as fast as possible and with low effort would be highly beneficial. For example, in late stages of ALS, some people can control their eye movements. This lets them use several interface techniques such as eye tracking interfaces (ETI), BCI or Blink/Wink detection systems. A blink or a wink detection can be carried out by both measuring the electrical activity of the muscles controlling the eyelids or through image processing. A comparison between ETI and P300 interfaces was accomplished in [ 61 ]. Results showed that ITR and usability of the eye tracker were higher than the P300. Moreover, the cognitive workload was higher for the BCI. A more recent study [ 62 ] showed that an SSVEP BCI obtained results comparable to the ETI in terms of accuracy and ITR. In particular, when the size of a target was relatively small, the BCI had significantly better performance than the ETI. In [ 63 ], an image processing system is described
Sensors 2017,17, 1525 18 of 23 to detect voluntary winks with an accuracy of of 95% for temporal windows of 2 s, which makes an ITR equal to 21.5 bits/min, in the range of P300 BCI systems [ 2 ]. According to this information, only SSVEP systems can outperform the interfaces based on eye tracking or blink/wink detection. Nevertheless, not all people with severe disabilities can control their eyes. For example, some people with ALS or with locked-in syndrome (LIS) can not move the eye accurately or simply open/close their eyelids. For them, the ETI or the blink/wink detection systems are not suitable, In [ 64 ], the authors evaluated electrooculography, an eye tracker and an auditory brain-computer interface as access methods for an LIS subject. He was able to communicate with slow residual eye movements and rated the ease of use of the BCI as the highest among the tested systems, because no precise eye movements were required, but also as the most tiring. When no eye control is possible, an eye-gaze independent BCI system could get into action. We can classify these BCI systems according to the stimulus: tactile, auditory or visual. The latter is a BCI system that does not require the subject to look at different parts of the screen. All information appears very close and around a central point or sequentially in the same position. In [ 65 ], there is a comparison among such systems. The faster auditory BCI that the authors found has an accuracy of 94% and an ITR equal to 10 bits/min, better than tactile and similar to visual BCI but based on the rapid serial visual presentation paradigm (RSVP). Our proposal could easily be adapted as a gaze independent BCI depending on whether the pictograms are shown sequentially in the same place. To sum up, the modulation of attention can be used as a gaze independent BCI for people with residual eye movement with slightly higher ITR than other counterpart BCIs and outperforms other techniques that are not applicable there. 5.6. Training Time SCP- or SMR-based BCIs require long training times in comparison to the method of modulating the attention. In this study, we used up to 150 min (10 session of 15 min) of training, although some participants achieved the required skills in a few sessions. In [ 66 ], a range between 240–320 min of training was carried out to train an SMR BCI system. Longer periods of training have been reported for SCP-based systems. For example, in [67], two people with ALS were trained for more than one year. 6. Discussion This study shows that not all participants were able to manage their attentional state well enough. Three participants from group A and one from B were not able to start the phase 2 (40%) after 150 min of training. An overall amount of 60% of the initial participants turned out to be potential users of this technology by achieving an accuracy of over 70%, which is the threshold proposed in [ 68 ]. It is well known that not everybody can control a BCI system, being known as “BCI illiterates”. According to [69,70] , about 20% of subjects are not proficient with a typical BCI system. This percentage was reduced down to 3.59% in SSVEP BCI [ 71 ] where 53 people took part in only four sessions. Therefore, the percentage of “illiterates” obtained in this experiment was large compared to the normal percentages in other sorts of brain computer interactions. Nevertheless, a study with healthy people controlling a BCI system by means of SCP [ 72 ] reported that, after 180 min of training, the percentage of people who could achieve significant voluntary control of brain signals was 66%, similar to the one obtained in this study. In group B, participants achieved the skills with an accuracy of 76%. However, it is also remarkable how tired this method of access made people with disabilities, scoring it an average 2.7 out of 3. For group A, all participants achieved the skills with an average accuracy of 82.4%, and they did not get tired during the experimentation (1.5). For group A participants, the average tscan was equal to 10.95 s, whereas for group B, it was similar at 10.16 s A higher number of icons in the communicator means increasing the tw (which diminishes Np ) to reduce the number of errors committed during the non-attention phase. Thus, the
Sensors 2017,17, 1525 19 of 23 communication board should not contain too many icons (estimated between four and seven). This methodology has an ITR close to other classical BCI methods such as SCP and SMR but lower in comparison with others based on P300 or SSVEP and non-BCI such us ETI or wink detection systems. Moreover, we can use it as an independent eye BCI with similar results as other counterparts BCI. There were significant differences in attention values between types of trials for most of the participants, whereas the θ/β ratio was also significant in four out of six participants and other power bands were significant in three out of six participants. Our study reveals that the δ power band and θ/β ratio decreased in attention trials in comparison with non-attention ones, since the γ power band had the opposite behavior, increasing during attention trials and decreasing in the other trials. Including power bands into the classifier did not improve the accuracy in discriminating the two attentional states. The best results were obtained by using only the attention indicator in classification. 7. Conclusions This study has presented some findings about using the modulation of attention as an input method for people with disabilities. However, further research must be carried out including the communicator in the experimentation, with a larger sample of subjects with disabilities (even other collectives such as people with ALS) and other kinds of classifiers. Acknowledgments: The authors would like to thank the staff of ASPACE for their support in the realization of this work. Finally, we want to thank the anonymous reviewers. Their comments helped us improve the manuscript. Author Contributions: Alberto J. Molina-Cantero, Jaime Guerrero-Cubero and Isabel Gómez-González conceived and designed the experiments; Jaime Guerrero-Cubero designed the software application; Alberto J. Molina-Cantero and Manuel Merino-Monge analyzed the data; Juan I. Silva-Silva performed the experiments; Alberto J.Molina-Cantero wrote the paper. Conflicts of Interest: The authors declare no conflict of interest. Abbreviations The following abbreviations are used in this manuscript: ADD Attention Deficit Disorder ADHD Attention Deficit Hyperactivity Disorder ALS Amyotrophic Lateral Sclerosis AUC Area under Curve CP Cerebral Palsy BCI Brain Computer Interface CFCS Communication Function Classification System EMG ElectroMyoGram ETI Eye Tracking Interface GMFCS Gross Motor Function Classification System IQR Interquartile Range ITR Information transfer rate LDA Linear Discriminant Analysis LIS Locked-in Syndrome LPFC Lateral Prefrontal Cortex NIRS Near Infrared Spectroscopy ROC Receiver Operating Characteristic Curve RSVP Rapid Serial Visual Presentation SMR Sensorimotor Rhythms SCP Slow Cortical Potentials SSVEP Steady State Visual Evoked Potential TBR Theta Beta Ratio
Sensors 2017,17, 1525 20 of 23 References 1. McMurrough, C.; Ferdous, S.; Papangelis, A.; Boisselle, A.; Heracleia, F.M. A survey of assistive devices for cerebral palsy patients. In Proceedings of the 5th International Conference on PErvasive Technologies Related to Assistive Environments, Heraklion, Greece, 6–9 June 2012; p. 17. 2. Nicolas-Alonso, L.F.; Gomez-Gil, J. Brain computer interfaces, a review. Sensors 2012,12, 1211–1279. 3. Millán, J.D.R.; Rupp, R.; Müller-Putz, G.R.; Murray-Smith, R.; Giugliemma, C.; Tangermann, M.; Vidaurre, C.; Cincotti, F.; Kübler, A.; Leeb, R.; et al. Combining brain-computer interfaces and assistive technologies: State-of-the-art and challenges. Front. Neurosci. 2010,4, 161. 4. Welton, T.; Brown, D.J.; Evett, L.; Sherkat, N. A brain-computer interface for the Dasher alternative text entry system. Univers. Access Inf. Soc. 2016,15, 77–83. 5. Das, R.; Chatterjee, D.; Das, D.; Sinharay, A.; Sinha, A. Cognitive load measurement—A methodology to compare low cost commercial EEG devices. In Proceedings of the International Conference on Advances in Computing, Communications and Informatics (ICACCI), Greater Noida, India, 24–27 September 2014; pp. 1188–1194. 6. Van Hal, B.; Rhodes, S.; Dunne, B.; Bossemeyer, R. Low-cost EEG-based sleep detection. In Proceedings of the 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Chicago, IL, USA, 26–30 August 2014; pp. 4571–4574. 7. Lim, C.K.A.; Chia, W.C.; Chin, S.W. A mobile driver safety system: Analysis of single-channel EEG on drowsiness detection. In Proceedings of the 2014 International Conference on Computational Science and Technology (ICCST), Kota Kinabalu, Malaysia, 27–28 August 2014; pp. 1–5. 8. Rostami, S.; Shenfield, A.; Sigurnjak, S.; Fakorede, O. Evaluation of mental workload and familiarity in human computer interaction with integrated development environments using single-channel EEG. In Proceedings of the PPIG 2015-26th Annual Workshop, Bournemouth, UK, 15–17 July 2015. 9. Mak, J.N.; Chan, R.H.; Wong, S.W. Evaluation of mental workload in visual-motor task: Spectral analysis of single-channel frontal EEG. In Proceedings of the 39th Annual Conference of the IEEE Industrial Electronics Society, Vienna, Austria, 10–14 November 2013; pp. 8426–8430. 10. An, K.O.; Kim, J.B.; Song, W.K.; Lee, I.H. Development of an emergency call system using a brain computer interface (BCI). In Proceedings of the 2010 3rd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob 2010), Tokyo, Japan, 26–29 September 2010; pp. 918–923. 11. Heidrich, R.D.O.; Branco, M.A.; Mossmann, J.A.B.; Schuh, A.R.; Jensen, E. Development of BCI Based Softwares to Assist People with Mobility Limitations in the School Inclusion Process. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility, Lisbon, Portugal, 26–28 October 2015; ACM: New York, NY, USA, 2015; pp. 397–398. 12. Lee, K. Evaluation of attention and relaxation levels of archers in shooting process using brain wave signal analysis algorithms. Sci. Sensit. 2009,12, 341–350. 13. Yoon, H.; Park, S.W.; Lee, Y.K.; Jang, J.H. Emotion recognition of serious game players using a simple brain computer interface. In Proceedings of the 2013 International Conference on ICT Convergence (ICTC), Jeju Island, Korea, 14–16 October 2013; pp. 783–786. 14. Crowley, K.; Sliney, A.; Pitt, I.; Murphy, D. Evaluating a brain-computer interface to categorise human emotional response. In Proceedings of the 2010 10th IEEE International Conference on Advanced Learning Technologies, Sousse, Tunisia, 5–7 July 2010; pp. 276–278. 15. Maki, Y.; Sano, G.; Kobashi, Y.; Nakamura, T.; Kanoh, M.; Yamada, K. Estimating Subjective Assessments Using a Simple Biosignal Sensor. In Proceedings of the 13th ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing, Kyoto, Japan, 8–10 August 2012; pp. 325–330. 16. Rebolledo-Mendez, G.; Dunwell, I.; Martínez-Mirón, E.A.; Vargas-Cerdán, M.D.; De Freitas, S.; Liarokapis, F.; García-Gaona, A.R. Assessing neurosky’s usability to detect attention levels in an assessment exercise. In Human-Computer Interaction. New Trends; Springer: Bernlin, Germany, 2009; pp. 149–158. 17. Fernandez, A.; Eid, M. ReadGoGo!: Towards real-time notification on readers’ state of attention. In Proceedings of the 2013 23rd International Conference on Artificial Reality and Telexistence (ICAT), Tokyo, Japan, 11–13 December 2013; pp. 1–6.
Sensors 2017,17, 1525 21 of 23 18. Garzotto, F.; Gelsomini, M.; Pappalardo, A.; Sanna, C.; Stella, E.; Zanella, M. Using Brain Signals in Adaptive Smart Spaces for Disabled Children. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, San Jose, CA, USA, 7–12 May 2016; pp. 1684–1690. 19. Jimenez, C.O.S.; Mesa, H.G.A.; Rebolledo-Mendez, G.; De Freitas, S. Classification of cognitive states of attention and relaxation using supervised learning algorithms. In Proceedings of the 2011 IEEE International Conference on Games Innovation (IGIC), Orange, CA, USA, 2–3 November 2011; pp. 31–34. 20. Shirazi, A.S.; Hassib, M.; Henze, N.; Schmidt, A.; Kunze, K. What’s on Your Mind? Mental Task Awareness Using Single Electrode Brain Computer Interfaces. In Proceedings of the 5th Augmented Human International Conference, Kobe, Japan, 7–9 March 2014; ACM: New York, NY, USA, 2014. 21. Heidrich, R.O.; Jensen, E.; Rebelo, F.; Oliveira, T. A comparative study: Use of a Brain-computer Interface (BCI) device by people with cerebral palsy in interaction with computers. Anais da Academia Brasileira de Ciências 2015,87, 1929–1937. 22. Arnsten, A.F.T.; Rubia, K. Neurobiological Circuits Regulating Attention, Cognitive Control, Motivation, and Emotion: Disruptions in Neurodevelopmental Psychiatric Disorders. J. Am. Acad. Child Adolesc. Psychiatry 2012,51, 356–367. 23. Corbetta, M.; Shulman, G.L. Control of goal-directed and stimulus-driven attention in the brain. Nat. Rev. Neurosci. 2002,3, 201–215. 24. Iwanaga, K.; Saito, S.; Shimomura, Y.; Harada, H.; Katsuura, T. The Effect of Mental Loads on Muscle Tension, Blood Pressure and Blink Rate. J. Physiol. Anthropol. Appl. Hum. Sci. 2000,19, 135–141. 25. Schleicher, R.; Galley, N.; Briest, S.; Galley, L. Blinks and saccades as indicators of fatigue in sleepiness warnings: Looking tired? Ergonomics 2008,51, 982–1010. 26. Wang, Q.; Sourina, O.; Nguyen, M.K. EEG-Based “Serious” Games Design for Medical Applications. In Proceedings of the 2010 International Conference on Cyberworlds (CW), Singapore, 20–22 October 2010; pp. 270–276. 27. Wang, Q.; Sourina, O. Real-Time Mental Arithmetic Task Recognition From EEG Signals. IEEE Trans. Neural Syst. Rehabil. Eng. 2013,21, 225–232. 28. Lee, J.M.; Park, K.S.; Lee, Y.; Shin, I.; Park, K.S. Characterizing EEG during mental activity using non-linear measures: The more concentration, the higher correlation dimension. In Proceedings of the 22nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Chicago, IL, USA, 26–30 August 2000; Volume 2; pp. 1326–1328. 29. Siamaknejad, H.; Loo, C.K.; Liew, W.S. Fractal dimension methods to determine optimum EEG electrode placement for concentration estimation. In Proceedings of the 2014 Joint 7th International Conference on Soft Computing and Intelligent Systems (SCIS) and 15th International Symposium on Advanced Intelligent Systems (ISIS), Kita-Kyushu, Japan, 3–6 December 2014; pp. 952–955. 30. Gevins, A.; Smith, M.E.; McEvoy, L.; Yu, D. High-resolution EEG mapping of cortical activation related to working memory: Effects of task difficulty, type of processing, and practice. Cereb. Cortex 1997,7, 374–385. 31. Wascher, E.; Rasch B.; Sänger J.; Hoffmann S.; Schneider D.; Rinkenauer G.; Heuer H.; Gutberlet I. Frontal theta activity reflects distinct aspects of mental fatigue. Biological Psychology 2014,96, 57–64. 32. Harmony, T.; Fernández, T.; Silva, J.; Bernal, J.; Díaz-Comas, L.; Reyes, A.; Marosi, E.; Rodríguez, M.; Rodr ´ guez, M. EEG delta activity: An indicator of attention to internal processing during performance of mental tasks. Int. J. Psychophysiol. 1996,24, 161–171. 33. Lubar, J.F. Discourse on the development of EEG diagnostics and biofeedback for attention-deficit/hyperactivity disorders. Biofeedback Self-Regul. 1991,16, 201–225. 34. George, L.; Lotte, F.; Abad, R.; Lecuyer, A. Using scalp electrical biosignals to control an object by concentration and relaxation tasks: Design and evaluation. In Proceedings of the 2011 33rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Boston, MA, USA, 30 August–3 September 2011; pp. 6299–6302. 35. Lin, T.A.; John, L.R. Quantifying mental relaxation with EEG for use in computer games. In Proceedings of the International Conference on Internet Computing, Las Vegas, NV, USA, 26–29 June 2006; pp. 409–415. 36. Rodríguez, M.; Giménez, R.; Diez, P.; Avila, E.; Laciar, E.; Orosco, L.; Correa, A.G. Playing with your mind. J. Phys. Conf. Ser. 2013,477, 012038.
Sensors 2017,17, 1525 22 of 23 37. Fong, S.S.M.; Tsang, W.W.N.; Cheng, Y.T.Y.; Ki, W.Y.; Ma, A.W.W.; Macfarlane, D.J. Single-channel Electroencephalographic Recording in Children with Developmental Coordination Disorder: Validity and Influence of Eye Blink Artifacts. J. Nov. Physiother. 2015,5, 270. 38. MindWave User’s Guide; NeuroSky, Brain-Computer Interface Technologies: San Jose, CA, USA, 2011. 39. Schafer, R. What Is a Savitzky-Golay Filter? [Lecture Notes]. IEEE Signal Process. Mag. 2011,28, 111–117. 40. Palisano, R.; Rosenbaum, P.; Bartlett, D.; Livingston, M. Development and reliability of a system to classify gross motor function in children with cerebral palsy. Dev. Med. Child Neurol. 1997,39, 214–223. 41. Hidecker, M.J.; Paneth, N.; Rosenbaum, P.L.; Kent, R.D.; Lillie, J.; Eulenberg, J.B.; Chester, K., Jr.; Johnson, B.; Michalsen, L.; Evatt, M.; et al. Developing and validating the Communication Function Classification System (CFCS) for individuals with cerebral palsy. Dev. Med. Child Neurol. 2011,53, 704–710. 42. Harmony, T. The functional significance of delta oscillations in cognitive processing. Front. Integr. Neurosci. 2013,7, 83. 43. Clayton, M.S.; Yeung, N.; Kadosh, R.C. The roles of cortical oscillations in sustained attention. Trends Cogn. Sci. 2015,19, 188–195. 44. Koelewijn, L.; Rich, A.N.; Muthukumaraswamy, S.D.; Singh, K.D. Spatial attention increases high-frequency gamma synchronisation in human medial visual cortex. NeuroImage 2013,79, 295–303. 45. Freek, V.E.; Szabolcs, S.; Eric, M. Attentional modulations of somatosensory alpha, beta and gamma oscillations dissociate between anticipation and stimulus processing. NeuroImage 2014,97, 134–141. 46. Nicolás, M.; Molina, J. Análisis de Curvas Roc. Principios Básicos y Aplicaciones (36); Cuadernos de Estadística, Editorial La Muralla, S.A.: Madrid, Spain, 2008. 47. Polacek, O.; Sporka, A.J.; Slavik, P. Text input for motor-impaired people. Univers. Access Inf. Soc. 2017 , 16, 51–72. 48. Liu, N.H.; Chiang, C.Y.; Chu, H.C. Recognizing the degree of human attention using eeg signals from mobile sensors. Sensors 2013,13, 10273–10286. 49. Wolpaw, J.R.; Birbaumer, N.; Heetderks, W.J.; McFarland, D.J.; Peckham, P.H.; Schalk, G.; Donchin, E.; Quatrano, L.A.; Robinson, C.J.; Vaughan, T.M.; et al. Brain-computer interface technology: A review of the first international meeting. IEEE Trans. Rehabil. Eng. 2000,8, 164–173. 50. McFarland, D.J.; Sarnacki, W.A.; Wolpaw, J.R. Brain–computer interface (BCI) operation: Optimizing information transfer rates. Biol. Psychol. 2003,63, 237–251. 51. Mugler, E.M.; Ruf, C.; Halder, S.; Bensch, M.; Kübler, A. Design and implementation of a P300-based brain-computer interface for controlling an internet browser. IEEE Trans. Neural Syst. Rehabil. Eng. 2010 , 18, 599–609. 52. Chen, X.; Chen, Z.; Gao, S.; Gao, X. A high-ITR SSVEP-based BCI speller. Brain-Comput. Interfaces 2014 , 1, 181–191. 53. Scholkmann, F.; Kleiser, S.; Metz, A.J.; Zimmermann, R.; Pavia, J.M.; Wolf, U.; Wolf, M. A review on continuous wave functional near-infrared spectroscopy and imaging instrumentation and methodology. Neuroimage 2014,85, 6–27. 54. Shin, J.; Kang, S.; Sung, M.; Kim, J.; Kim, Y.; Kim, J.; Jeong, J. A study on information transfer rate by brain-computer interface (BCI) using functional near-infrared spectroscopy (fNIRS). In Proceedings of the 2013 International Winter Workshop on Brain-Computer Interface (BCI), Gangwon Province, Korea, 18–20 February 2013; pp. 32–33. 55. Coyle, S.; Ward, T.; Markham, C.; McDarby, G. On the suitability of near-infrared (NIR) systems for next-generation brain–computer interfaces. Physiol. Meas. 2004,25, 815. 56. Shin, J.; Müller, K.R.; Hwang, H.J. Near-infrared spectroscopy (NIRS)-based eyes-closed brain-computer interface (BCI) using prefrontal cortex activation due to mental arithmetic. Sci. Rep. 2016,6, 36203. 57. Noori, F.M.; Qureshi, N.K.; Khan, R.A.; Naseer, N. Feature selection based on modified genetic algorithm for optimization of functional near-infrared spectroscopy (fNIRS) signals for BCI. In Proceedings of the 2nd International Conference on Robotics and Artificial Intelligence, Islamabad, Pakistan, 1–2 November 2016; pp. 50–53. 58. Naseer, N.; Qureshi, N.K.; Noori, F.M.; Hong, K.S. Analysis of different classification techniques for two-class functional near-infrared spectroscopy-based brain-computer interface. Comput. Intell. Neurosci. 2016 , doi:10.1155/2016/5480760.
Sensors 2017,17, 1525 23 of 23 59. Hong, K.S.; Naseer, N.; Kim, Y.H. Classification of prefrontal and motor cortex signals for three-class fNIRS–BCI. Neurosci. Lett. 2015,587, 87–92. 60. Zhang, Z.; Jiao, X.; Xu, F.; Jiang, J.; Yang, H.; Cao, Y.; Fu, J. The Investigation of Brain-computer Interface for Motor Imagery and Execution Using Functional Near-infrared Spectroscopy. In Proceedings of the International Conference on Innovative Optical Health Science, Suzhou, China, 26–28 September 2017; p. 102450I. 61. Pasqualotto, E.; Matuz, T.; Federici, S.; Ruf, C.A.; Bartl, M.; Olivetti Belardinelli, M.; Birbaumer, N.; Halder, S. Usability and workload of access technology for people with severe motor impairment: A comparison of brain-computer interfacing and eye tracking. Neurorehabil. Neural Repair 2015,29, 950–957. 62. Suefusa, K.; Tanaka, T. A comparison study of visually stimulated brain-computer and eye-tracking interfaces. J. Neural Eng. 2017,14, 036009. 63. Królak, A.; Strumiłło, P. Eye-blink detection system for human-computer interaction. Univers. Access Inf. Soc. 2012,11, 409–419. 64. Käthner, I.; Kübler, A.; Halder, S. Comparison of eye tracking, electrooculography and an auditory brain-computer interface for binary communication: A case study with a participant in the locked-in state. J. Neuroeng. Rehabil. 2015,12, 76. 65. Riccio, A.; Mattia, D.; Simione, L.; Olivetti, M.; Cincotti, F. Eye-gaze independent EEG-based brain-computer interfaces for communication. J. Neural Eng. 2012,9, 045001. 66. Pichiorri, F.; Fallani, F.D.V.; Cincotti, F.; Babiloni, F.; Molinari, M.; Kleih, S.; Neuper, C.; Kübler, A.; Mattia, D. Sensorimotor rhythm-based brain–computer interface training: The impact on motor cortical responsiveness. J. Neural Eng. 2011,8, 025020. 67. Hinterberger, T.; Kübler, A.; Kaiser, J.; Neumann, N.; Birbaumer, N. A brain-computer interface (BCI) for the locked-in: Comparison of different EEG classifications for the thought translation device. Clin. Neurophysiol. 2003,114, 416–425. 68. Kübler, A.; Birbaumer, N. Brain-computer interfaces and communication in paralysis: Extinction of goal directed thinking in completely paralysed patients? Clin. Neurophysiol. 2008,119, 2658–2666. 69. Allison, B.; Neuper, C. Could Anyone Use a BCI? In Brain-Computer Interfaces; Tan, D.S., Nijholt, A., Eds.; Human-Computer Interaction Series; Springer: London, UK, 2010; pp. 35–54. 70. Kübler A, M.K.R. An Introduction to Brain-Computer Interfacing. In Toward Brain-Computer Interfacing; Dornhege, G., Millán, J.D.R., Hinterberger, T., McFarland, D.J., Müller, K.-R., Eds.; MIT Press: Cambridge, MA, USA, 2007; pp. 1–25. 71. Guger, C.; Allison, B.Z.; Großwindhager, B.; Prückl, R.; Hintermüller, C.; Kapeller, C.; Bruckner, M.; Krausz, G.; Edlinger, G. How many people could use an SSVEP BCI? Front. Neurosci. 2012 ,6, doi:10.3389/fnins.2012.00169. 72. Hinterberger, T.; Schmidt, S.; Neumann, N.; Mellinger, J.; Blankertz, B.; Curio, G.; Birbaumer, N. Brain-computer communication and slow cortical potentials. IEEE Trans. Biomed. Eng. 2004,51, 1011–1018. c 2017 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).