1. Brain-Computer Interface: Alexander Kaplan Head of Laboratory for Neurophysiology and Neuro-Computer Interfaces (NNCI Moscow) Contacts: [email_address] ; http:// brain.bio.msu.ru Lomonosov Moscow State University Faculty of Biology Dean of the Faculty: A cademician Mikhail P. Kirpichnikov Rebuilding radically new output of the Human Brain

2. Dr. Neal Miller (1909-2002 , USA ) , the psychologist and neuroscientist, was one of the first research workers to demonstrate experimentally: The rats can “voluntary” change own EEG In Dr. James Olds (1956) paradigm “ THE POWER OF MIND OVER MATTER” i.e. MIND IS REAL POWER! THE KNOWLEDGE IS POWER, OK! What about MIND per se ?

4. In the last few years, a lot of labs begin to research the DIRECT communicate interface between brain and external environment – Brain-Computer Interface (BCI). The purpose is for human to communicate with external device WITHOUT MUSCLES but DIRECTLY by using only the electrical brain activity - EEG. Peer-reviewed papers To this time we already published some basic papers on EEG computing for example: A.Ya.Kaplan et al. Nonstationary nature of the brain activity as revealed by EEG/MEG . In: Signal processing , 2005;85:2190–2212 and established new so called segmental approach in EEG analysis. BCI has seen increasing interest since 2000

5. 2005 et al. Our startup in BCI research in 2005

6. Neuroscience Letters Article in Press, Accepted Manuscript – Copyright © 2011 Published by Elsevier Ireland Lt ________________________ EVENT-RELATED POTENTIALS IN A MOVING MATRIX MODIFICATION OF THE P300 BCI PARADIGM Sergei L. Shishkin, Ilya P. Ganin, Alexander Ya. Kaplan * M.V.Lomonosov Moscow State University, Faculty of Biology, Dept. of Human and Animal Physiology, Human Brain Research Group, 1/12 Leninskie Gory, Moscow 119991, Russia Our resent BCI research

7. Our nearest patents which incorporate the BCI technology

10. Psychological Effort (Intention) Modification of EEG Brain Signals Signal Features Classification Of Intent appropriate feature extraction appropriate feedback strategy user training computer training Environment Brain Computer What is logical scheme of BCI ?

11. Only in USA, more than 200,000 patients live with the motor consequences of serious injury. Nicolelis, 2001 What is the motivation for BCI Research ? Motivation for Patients: is to give disable people to communicate, to operate prostheses, and even to operate wheelchairs using brain signals Only the INVASIVE SURGEON TECHNIQUE allows putting electrode into a very local area of a brain uniting a few neurons. These neurons could be belong to the cortex center, for example, for finger control.

12. Even if patients can not act, they also can use Brain-Computer Interface (BCI) to communicate with environment or control the devices. The EEG is the residual signal that can be used as command signal for HUNDRED THOUSANDS neurologically impaired patients with: - amyotrophic lateral sclerosis, - stroke, - old man with disabilities , - spinal injur i es with limb paralysis (tetraplegia etc.) , - Locked-in syndrome What is EEG for BCI Research ?

18. 1. Feature extraction; 2. EEG changes classification; 3. Command translation; 4. Feedback Precision microelectronics Neuro- and Psychophysiology Mathematics and Programming Signal processing 1 2 3 4 Neuro- and Psychophysiology 1 Medicine 5 Precision microelectronics 2 Automatic control theory 6 Feedback Functional scheme of “internal” type BCI

19. Neurophysiology and Psycho- Mathematics Medicine Micro- electronics Statistics Signal processing Programming EEG analysis Neuro theory Mind-body problem Rehabilitation Surgery Clinics Amplifiers Wireless tech Chip design Nanotechnology for dry EEG sensors and for money The multi-disciplinary approach is a key for new generation of BCI technology

21. Alfa Theta Gamma t S(2) S(1) S(3) S(4) S(5) S(6) S( i) Dynamics of neuronal ensembles

22. Go left Go right Go ahead Go back

23. Subject New 1 Finding repeating spatial EEG patterns New 2 On-line EEG pattern classification Selection of functional commands only A B C Electronic drivers Neurofeedback A B C External objects New 3 P > 75% Multimodality Cognitions Emotions Executive part Neurofeedback part Pattern detection part USER part Creativity Moscow Brain-Computer Interface EEG Recognizing single channel EEG patterns Setting EEG commands 1, 2, 3, 4, 5… Instrumental conditioning training

26. P300 wave “external” type BCI P300 NCI lab in Moscow P300 driven typing … ..I am Ivan Basul… High-speed Moscow P300 BCI is only first step for real BCI spelling system 16-20 chatacters per min with 97% accuracy in Moscow N NCI lab – is the world record at the moment! P300

27. Attention dissociation is big problem for “external” type BCI Hybrid Brain-Gaze-Computer Interface (BGCI) is the final decision for “Attention dissociation” problem.

28. The integration eye tracker date with ongoing EEG date will correct the “Attention dissociation” problem

29. The toy car directly controlled by Dr. Kaplan’s Brain Kaplan A.Ya., et. al. Unconscious operant conditioning in the paradigm of brain-computer interface based on color perception Intern. J. Neuroscience, 2005 115:781–802, Kaplan A.Ya., et. al. Nonstationary nature of the brain activity as revealed by EEG/MEG: methodological, practical and conceptual challenges Signal processing. Signal Processing 85 (2005) 2190–2212 Full-text papers of Dr. Kaplan are available at: http:// brain.bio.msu.ru

30. Motor execution vs. Movement imagination (lee_stbdayAY10.ppt) Execution Subject g3, 16-20 Hz Subject f7, 20-24 Hz time Imagination ERD ERS 500ms

31. Fundamental research in NNC Lab at Faculty of Biology Silicon Skolkovo supports the BCI research for aplications NPO ENERGIYA – industry for limb prosthesis and manipulators OUR key project is EEG driven limb prosthesis and manipulators

32. Dr. Emanuel Donchin He designed first BCI for mind driven speller at 1988 (University of South Florida) Dr. Christoph Guger ( Graz, Austria ) the owner of “ g.tec Medical Engineering GmbH ” Dr. Philip Kennedy First implantation for BCI (Emory University) Academician Victor A.Sadovnichiy Rector of Lomonosov MSU (Russia) Partners for collaboration