You are wrong!: automatic detection of interaction errors from brain waves

ABSTRACT

Brain-computer interfaces, as any other interaction modality based on physiological signals and body channels (e.g., muscular activity, speech and gestures), are prone to errors in the recognition of subject's intent. In this paper we exploit a unique feature of the "brain channel", namely that it carries information about cognitive states that are crucial for a purposeful interaction. One of these states is the awareness of erroneous responses. Different physiological studies have shown the presence of error-related potentials (ErrP) in the EEG recorded right after people get aware they have made an error. However, for human-computer interaction, the central question is whether ErrP are also elicited when the error is made by the interface during the recognition of the subject's intent and no longer by errors of the subject himself. In this paper we report experimental results with three volunteer subjects during a simple human-robot interaction (i.e., bringing the robot to either the left or right side of a room) that seem to reveal a new kind of ErrP, which is satisfactorily recognized in single trials. These recognition rates significantly improve the performance of the brain interface.

References

1. {Birbaumer et al., 1999} N. Birbaumer, N. Ghanayim, T. Hinterberger, I. Iversen, B. Kotchoubey, A. Kubler, J. Perelmouter, E. Taub, and H. Flor. A spelling device for the paralysed. Nature, 398:297-298, 1999.
2. {Blankertz et al., 2003} B. Blankertz, G. Dornhege, C. Schäfer, R. Krepki, J. Kohlmorgen, K.-R. Müller, V. Kunzmann, F. Losch, and G. Curio. Boosting bit rates and error detection for the classification of fast-paced motor commands based on single-trial EEG analysis. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 11:127-131, 2003.
3. {Carter et al., 1998} C.S. Carter, T.S. Braver, D.M. Barch, M.M Botvinick, D. Noll, and J.D. Cohen. Anterior cingulate cortex, error detection, and the online monitoring of performance. Science, 280:747-749, 1998.
4. {Falkenstein et al., 2000} M. Falkenstein, J. Hoormann, S. Christ, and J. Hohnsbein. ERP components on reaction errors and their functional significance: A tutorial. Biological Psychology, 51:87-107, 2000.
5. {Grave et al., 2004} R. Grave de Peralta, M.M. Murray, C.M. Michel, R. Martuzzi, and S.L. Gonzalez Andino. Electrical neuroimaging based on biophysical constraints. NeuroImage, 21:527-539, 2004.
6. {Grave et al., 2005} R. Grave de Peralta, S.L. Gonzalez Andino, L. Perez, P.W. Ferrez, and J. del R. Millán. Noninvasive estimation of local field potentials for neuroprosthesis control. Cognitive Processing, 6, 2005.
7. {Holroyd and Coles, 2002} C.B. Holroyd and M.G.H. Coles. The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109:679-709, 2002.
8. {Kohonen, 1997} T. Kohonen. Self-Organizing Maps, 2nd ed. Springer-Verlag, Berlin, 1997.
9. {Millán et al., 2003} J. del R. Millán, F. Renkens, J. Mouriño, and W. Gerstner. Non-invasive brainactuated control of a mobile robot. In Proceedings of the 18th International Joint Conference on Artificial Intelligence, pages 1121-1126, Acapulco, Mexico, 2003. Morgan Kaufmann.
10. {Millán et al., 2004} J. del R. Millán, F. Renkens, J. Mouriño, and W. Gerstner. Brain-actuated interaction. Artificial Intelligence, 159:241-259, 2004.
11. {Millán, 2002} J. del R. Millán. Brain-computer interfaces. In M.A. Arbib, editor, Handbook of Brain Theory and Neural Networks, pages 178-181. The MIT Press, Cambridge, Massachusetts, 2002.
12. {Parra et al., 2003} L.C. Parra, C.D. Spence, A.D. Gerson, and P. Sajda. Response error correction--A demonstration of improved human-machine performance using real-time EEG monitoring. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 11:173-177, 2003.
13. {Schalk et al., 2000} G. Schalk, J.R. Wolpaw, D.J. McFarland, and G. Pfurtscheller. EEG-based communication: Presence of an error potential. Clinical Neurophysiology, 111:2138-2144, 2000.
14. {Wolpaw et al., 1998} J.R. Wolpaw, H. Ramoser, D.J. Mc-Farland, and G. Pfurtscheller. EEG-based communication: Improved accuracy by response verification. IEEE Transactions on Rehabilitation Engineering, 6:326-333, 1998.
15. {Wolpaw et al., 2002} J.R. Wolpaw, N. Birbaumer, D.J. Mc-Farland, G. Pfurtscheller, and T.M. Vaughan. Braincomputer interfaces for communication and control. Clinical Neurophysiology, 113:767-791, 2002.
16. {Wolpaw et al., 2003} J.R. Wolpaw, D.J. McFarland, T.M. Vaughan, and G. Schalk. The Wadsworth Center braincomputer interface (BCI) research and development program. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 11:204-207, 2003.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)