MindID: Person Identification from Brain Waves through Attention-based Recurrent Neural Network

Abstract

Person identification technology recognizes individuals by exploiting their unique, measurable physiological and behavioral characteristics. However, the state-of-the-art person identification systems have been shown to be vulnerable, e.g., anti-surveillance prosthetic masks can thwart face recognition, contact lenses can trick iris recognition, vocoder can compromise voice identification and fingerprint films can deceive fingerprint sensors. EEG (Electroencephalography)-based identification, which utilizes the user's brainwave signals for identification and offers a more resilient solution, has recently drawn a lot of attention. However, the state-of-the-art systems cannot achieve similar accuracy as the aforementioned methods. We propose MindID, an EEG-based biometric identification approach, with the aim of achieving high accuracy and robust performance. At first, the EEG data patterns are analyzed and the results show that the Delta pattern contains the most distinctive information for user identification. Next, the decomposed Delta signals are fed into an attention-based Encoder-Decoder RNNs (Recurrent Neural Networks) structure which assigns varying attention weights to different EEG channels based on their importance. The discriminative representations learned from the attention-based RNN are used to identify the user through a boosting classifier. The proposed approach is evaluated over 3 datasets (two local and one public). One local dataset (EID-M) is used for performance assessment and the results illustrate that our model achieves an accuracy of 0.982 and significantly outperforms the state-of-the-art and relevant baselines. The second local dataset (EID-S) and a public dataset (EEG-S) are utilized to demonstrate the robustness and adaptability, respectively. The results indicate that the proposed approach has the potential to be widely deployed in practical settings.

References

1. Jimmy Ba, Volodymyr Mnih, and Koray Kavukcuoglu. 2014. Multiple object recognition with visual attention. arXiv preprint arXiv:1412.7755 (2014).
2. Dzmitry Bahdanau, Jan Chorowski, Dmitriy Serdyuk, Philemon Brakel, and Yoshua Bengio. 2016. End-to-end attention-based large vocabulary speech recognition. In Acoustics, Speech and Signal Processing (ICASSP), 2016 IEEE International Conference on. IEEE, 4945--4949.
3. Erol Başar. 1980. EEG-brain dynamics: relation between EEG and brain evoked potentials. Elsevier-North-Holland Biomedical Press.
4. Md Khayrul Bashar, Ishio Chiaki, and Hiroaki Yoshida. 2016. Human identification from brain EEG signals using advanced machine learning method EEG-based biometrics. In Biomedical Engineering and Sciences (IECBES), 2016 IEEE EMBS Conference on. IEEE, 475--479.
5. William Chan, Navdeep Jaitly, Quoc V Le, Oriol Vinyals, and Noam M Shazeer. 2017. Speech recognition with attention-based recurrent neural networks. US Patent 9,799,327.
6. Kaixuan Chen, Lina Yao, Xianzhi Wang, Dalin Zhang, Tao Gu, Zhiwen Yu, and Zheng Yang. 2018. Interpretable Parallel Recurrent Neural Networks with Convolutional Attentions for MultiModality Activity Modeling. The International Joint Conference on Neural Networks (IJCNN) (2018).
7. Tianqi Chen and Carlos Guestrin. 2016. Xgboost: A scalable tree boosting system. In Proceedings of the 22Nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 785--794.
8. Thien Thanh Dang-Vu, Manuel Schabus, Martin Desseilles, Genevieve Albouy, Mélanie Boly, Annabelle Darsaud, Steffen Gais, Géraldine Rauchs, Virginie Sterpenich, Gilles Vandewalle, et al. 2008. Spontaneous neural activity during human slow wave sleep. Proceedings of the National Academy of Sciences 105, 39 (2008), 15160--15165.
9. Kim TE Olde Dubbelink, Abraham Felius, Jeroen PA Verbunt, Bob W Van Dijk, Henk W Berendse, Cornelis J Stam, and Henriette A Delemarre-van de Waal. 2008. Increased resting-state functional connectivity in obese adolescents; a magnetoencephalographic pilot study. PLoS One 3, 7 (2008), e2827.
10. Derya Durusu Emek-Savaş, Bahar Güntekin, Görsev G Yener, and Erol Başar. 2016. Decrease of delta oscillatory responses is associated with increased age in healthy elderly. International Journal of Psychophysiology 103 (2016), 103--109.
11. Geof H Givens, J Ross Beveridge, Yui Man Lui, David S Bolme, Bruce A Draper, and P Jonathon Phillips. 2013. Biometric face recognition: from classical statistics to future challenges. Wiley Interdisciplinary Reviews: Computational Statistics 5, 4 (2013), 288--308.
12. Qiong Gui, Zhanpeng Jin, and Wenyao Xu. 2014. Exploring EEG-based biometrics for user identification and authentication. In Signal Processing in Medicine and Biology Symposium (SPMB), 2014 IEEE. IEEE, 1--6.
13. D Corydon Hammond. 2003. The Effects of Caffeine on the Brain: A Review. Journal of Neurotherapy 7, 2 (2003), 79--89.
14. Thalía Harmony. 2013. The functional significance of delta oscillations in cognitive processing. Frontiers in integrative neuroscience 7 (2013), 83.
15. Isuru Jayarathne, Michael Cohen, and Senaka Amarakeerthi. 2016. BrainID: Development of an EEG-based biometric authentication system. In Information Technology, Electronics and Mobile Communication Conference (IEMCON), 2016 IEEE 7th Annual. IEEE, 1--6.
16. Dan H Kerem and Amir B Geva. 2017. Brain state identification and forecasting of acute pathology using unsupervised fuzzy clustering of EEG temporal patterns. In Fuzzy and neuro-fuzzy systems in medicine. CRC Press, 19--68.
17. Sarineh Keshishzadeh, Ali Fallah, and Saeid Rashidi. 2016. Improved EEG based human authentication system on large dataset. In Electrical Engineering (ICEE), 2016 24th Iranian Conference on. IEEE, 1165--1169.
18. Diederik Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).
19. Verner Knott, Meaghan Cosgrove, Crystal Villeneuve, Derek Fisher, Anne Millar, and Judy McIntosh. 2008. EEG correlates of imagery- induced cigarette craving in male and female smokers. Addictive behaviors 33, 4 (2008), 616--621.
20. Gennady G Knyazev. 2012. EEG delta oscillations as a correlate of basic homeostatic and motivational processes. Neuroscience 8 Biobehavioral Reviews 36, 1 (2012), 677--695.
21. Pinki Kumari and Abhishek Vaish. 2015. Brainwave based user identification system: A pilot study in robotics environment. Robotics and Autonomous Systems 65 (2015), 15--23.
22. Neal S Latman and Emily Herb. 2013. A field study of the accuracy and reliability of a biometric iris recognition system. Science 8 Justice 53, 2 (2013), 98--102.
23. Pengchao Li, Liangrui Peng, Junyang Cai, Xiaoqing Ding, and Shuangkui Ge. 2017. Attention Based RNN Model for Document Image Quality Assessment. In Document Analysis and Recognition (ICDAR), 2017 14th IAPR International Conference on, Vol. 1. IEEE, 819--825.
24. xiaoli Li. 2016. Signal Processing in Neuroscience. Springer, 8--12.
25. Minh-Thang Luong, Hieu Pham, and Christopher D Manning. 2015. Effective approaches to attention-based neural machine translation. arXiv preprint arXiv:1508.04025 (2015).
26. Dennis McGinty, Ronald Szymusiak, and Darrell Thomson. 1994. Preoptic/anterior hypothalamic warming increases EEG delta frequency activity within non-rapid eye movement sleep. Brain research 667, 2 (1994), 273--277.
27. Johannes Müller-Gerking, Gert Pfurtscheller, and Henrik Flyvbjerg. 1999. Designing optimal spatial filters for single-trial EEG classification in a movement task. Clinical neurophysiology 110, 5 (1999), 787--798.
28. David Ormerod. 2017. Sounding out expert voice identification. Expert Evidence and Scientific Proof in Criminal Trials (2017).
29. Fabio Pasqualetti, Florian Dörfler, and Francesco Bullo. 2013. Attack detection and identification in cyber-physical systems. IEEE Trans. Automat. Control 58, 11 (2013), 2715--2729.
30. Malcolm S Reid, Frank Flammino, Bryant Howard, Diana Nilsen, and Leslie S Prichep. 2006. Topographic imaging of quantitative EEG in response to smoked cocaine self-administration in humans. Neuropsychopharmacology 31, 4 (2006), 872.
31. Robert NS Sachdev, Nicolas Gaspard, Jason L Gerrard, Lawrence J Hirsch, Dennis D Spencer, and Hitten P Zaveri. 2015. Delta rhythm in wakefulness: evidence from intracranial recordings in human beings. Journal of neurophysiology 114, 2 (2015), 1248--1254.
32. Fahreddin Sadikoglu and Selin Uzelaltinbulat. 2016. Biometric Retina Identification Based on Neural Network. Procedia Computer Science 102 (2016), 26--33.
33. Araceli Sanz-Martin, Miguel Ángel Guevara, Claudia Amezcua, Gloria Santana, and Marisela Hernández-González. 2011. Effects of red wine on the electrical activity and functional coupling between prefrontal--parietal cortices in young men. Appetite 57, 1 (2011), 84--93.
34. Gerwin Schalk, Dennis J McFarland, Thilo Hinterberger, Niels Birbaumer, and Jonathan R Wolpaw. 2004. BCI2000: a general-purpose brain-computer interface (BCI) system. IEEE Transactions on biomedical engineering 51, 6 (2004), 1034--1043.
35. Javad Sohankar, Koosha Sadeghi, Ayan Banerjee, and Sandeep KS Gupta. 2015. E-bias: A pervasive eeg-based identification and authentication system. In Proceedings of the 11th ACM Symposium on QoS and Security for Wireless and Mobile Networks. ACM, 165--172.
36. Mircea Steriade. 1991. Alertness, quiet sleep, dreaming. In Normal and Altered States of Function. Springer, 279--357.
37. Kavitha P Thomas and A Prasad Vinod. 2016. Utilizing individual alpha frequency and delta band power in EEG based biometric recognition. In Systems, Man, and Cybernetics (SMC), 2016 IEEE International Conference on. IEEE, 004787--004791.
38. JA Unar, Woo Chaw Seng, and Almas Abbasi. 2014. A review of biometric technology along with trends and prospects. Pattern recognition 47, 8 (2014), 2673--2688.
39. Bingning Wang, Kang Liu, and Jun Zhao. 2016. Inner attention based recurrent neural networks for answer selection. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Vol. 1. 1288--1297.
40. Feng Wang and David MJ Tax. 2016. Survey on the attention based RNN model and its applications in computer vision. arXiv preprint arXiv:1601.06823 (2016).
41. Kyoko Yoshida, Xiaodong Li, Georgina Cano, Michael Lazarus, and Clifford B Saper. 2009. Parallel preoptic pathways for thermoregulation. Journal of Neuroscience 29, 38 (2009), 11954--11964.
42. Xiang Zhang, Lina Yao, Chaoran Huang, Sen Wang, Mingkui Tan, Guodong Long, and Can Wang. 2018. Multimodality Sensor Data Classification with Selective Attention. In The 27th International Joint Conference on Artificial Intelligence, IJCAI-18. 3111--3117.
43. Xiang Zhang, Lina Yao, Dalin Zhang, Xianzhi Wang, Quan Z Sheng, and Tao Gu. 2017. Multi-person brain activity recognition via comprehensive eeg signal analysis. In Proceedings of the 13th International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services (Mobiquitous,2017). ACM.

Index Terms

• Computing methodologies

  • Machine learning

    • Machine learning algorithms

• Security and privacy

  • Security services

    • Authentication

      • Biometrics