B

mation. A conceptual analysis of the existing -Machine Interfaces human-machine interfaces (HMI) reveals that the amount of useful information that can be ex- Josep Miquel Jornet1, Michal K. Stachowiak2, changed between humans and machines is not and Sasitharan Balasubramaniam3 limited by the capabilities of the 1Ultra-broadband Nano Communication and or those of the machine processor, but by the Networking Laboratory, University at Buffalo, interfaces between them. Simply stated, from an The State University of New York, Buffalo, NY, engineering perspective, the human being can be USA modeled as a macro-system with a processing 2Department of Pathology and Anatomical powerhouse, i.e., the brain, and a collection of Sciences, University at Buffalo, The State peripherals, i.e., the sense organs. All the periph- University of New York, Buffalo, NY, USA erals have their own latency limitations, which 3Telecommunication Software and Systems mainly arise from the fact that they convert a Group, Waterford Institute of Technology, collection of nano-/micro-events, i.e., neuronal Waterford, Ireland activity in the form of signals, into a macro-sized effect, e.g., moving the fingers to touch a display or type some characters in Definition order to control an external machine or, recip- rocally, convert a macro-size effects, e.g., an Brain-machine interfaces (BMIs) refer to com- auditive or visual command, into a a collection munication systems between the brain and an ex- of nano-/micro-events in the brain. ternal device. Desired properties of BMIs include In order to overcome the limitations of the bidirectionality, high spatial and temporal resolu- peripheral system, direct communication with the tion, low invasiveness, accuracy, and robustness. brain is needed. This form of interaction is known In this paper, the different types of BMIs, the state as a brain-machine interface (BMI). Over the of the art, and the future directions are discussed, years, numerous applications have resulted from in addition to highlighting their key applications. these two-way interactions, where compensations are made between the computational capabilities of both systems. Such compensations can be in Historical Background the form of either the computing system analyz- ing the brain signals and adapting the computing For many decades, the interaction between hu- environment or the computing system provid- mans and machines has been restricted to the ing added computing power to compensate for exchange of visual, auditory, and tactile infor- shortcomings of the brain. In the first case, brain © Springer Nature Switzerland AG 2018 X.(S.) Shen et al. (eds.), Encyclopedia of Wireless Networks, https://doi.org/10.1007/978-3-319-32903-1_226-1 2 Brain-Machine Interfaces signals are used to understand the user’s context rent approaches to optogenetic neural interfaces which is then used to control machines, such as include the use of optical fibers coupled to lasers controlling the vehicle. In the second case, this or light-emitting diodes (LEDs) (Zorzos et al. could come in the form of computing systems 2010) and micro-LED arrays (McGovern et al. controlling neuroprosthetic devices for disabled 2010). Moreover, optogenetics enables bidirec- patients. tional interfaces, as light can be utilized both to control and to measure neuronal activity (Kwon et al. 2014). However, the size of existing optical Electrical Brain-Machine Interfaces devices makes them invasive, difficult to contact to individual , and, ultimately, not suit- The most common to date BMIs rely on the col- able for chronic BMIs (Marblestone et al. 2013). lection and excitation of electrical signals from the brain. Electroencephalogram (EEG) signals have been successfully utilized to directly con- trol machines without the need of the sense or- Wireless Brain-Machine Interfaces gans (Millan et al. 2004). EEG signals can be collected in a noninvasive way, i.e., from outside In order to overcome the limitations of tradi- the brain, and support high-temporal resolution, tional electrical and optical BMIs, wireless BMIs i.e., down to the sub-millisecond scale, but have are being developed. In Seo et al. (2013), the limited spatial resolution, i.e., cannot be utilized concept of neural dust was introduced for the to read the action potential signal from a single first time. In the envision architecture, miniature at a time, and are vulnerable to electrical electronic devices or dust motes are implanted artifact sources. Besides EEG-based BMIs, there in the cortex. These devices, which integrate are other more invasive mechanisms that could piezoelectric energy harvesting systems powered be utilized to enable more robust electrical BMIs, by ultrasounds, record the neural activity from the such as intracranial EEG (Leuthardt et al. 2006), cortex and transmit the information to a subdural which is also known as electrocorticogram, and transceiver mounted under the skull. This device microelectrode arrays, which are placed directly is in charge of controlling the neural dust and on the exposed surface of the brain (Hochberg to communicate with the external head-mounted et al. 2006). However, besides their invasiveness, transceiver, where the data is collected. Despite they suffer from several limitations, such as com- the advantages of this wireless architecture, the plex application or unsuitability for long-term fact that it relies on the principles of electrical use. BMIs limits its applications. Recently, in Wirdatmadja et al. (2017), the first wireless BMI based on wireless optogenetic Optical Brain-Machine Interfaces nanonetworking devices (WiOptNDs) was proposed (Fig. 1). WiOptND enables accurate, In parallel to the development of the aforemen- robust, high-throughput, and minimally invasive tioned approaches, the field of optogenetics, i.e., BMIs by leveraging the state of the art in the use of light to interact with genetically modi- nanophotonics, nanoelectronics, and wireless fied neurons in the brain (Zemelman et al. 2002; communication. The fundamental idea is to Deisseroth 2011; Zhang et al. 2007), has experi- replace existing micro-LED arrays and micro- enced a major revolution in the last decade. Op- photodetector arrays used in optical BMIs by tical neural stimulation is considered to be more a network of coordinated nano-devices, which beneficial than electrical neural stimulation, be- are able both to excite individual neurons and cause it permits activation or inhibition of specific to measure their activity. In this application, a types of neurons with sub-millisecond temporal network of collaborative WiOptNDs is utilized precision and eliminates electrical artifacts. Cur- both to excite multiple neurons according to Brain-Machine Interfaces 3

B Skull

Control data

Ultrasound signals Neuronal stimulating Intermediate model and Transceiver pattern External Transceiver WiOptND

Brain-Machine Interfaces, Fig. 1 The WiOptND archi- to generate different neuron excitation patterns as well tecture consists of (i) a network of coordinated nano- as acoustically powering them; and (iii) an external devices able to optogenetically excite and measure the transceiver in charge of acoustically powering the inter- response of neurons; (ii) an intermediate transceiver in mediate transceiver and interfacing it with the actual BMI charge of both controlling the nano-devices in order user incoming commands and to collect, process, and invasiveness of this approach when compared to transmit accurate neuronal activity in real time. existing optogenetic approaches, which require Each nano-device is equipped with an optical bulky lasers or optical fibers. Moreover, by op- nano-transceiver (Feng et al. 2014) and nano- erating at optical frequencies, much higher tem- antenna (Nafari and Jornet 2017), which is able poral resolution than traditional electrical BMIs to both emit and detect optical radiation at a can be achieved. For example, while the main pre-established frequency or wavelength. As features of action potential signals are in the mil- in Seo et al. (2013), WiOptNDs are acoustically lisecond scale, the possibility to measure those powered and remotely controlled through the signals with much higher temporal resolution, subdural transceiver (Fig. 1). such as a few microseconds or even less, may Many benefits in this approach exist. First, the unveil new high-frequency time transients in the very small size of optical nano-antennas (Dorf- action potential signal propagation, which could muller et al. 2010; Nafari and Jornet 2017), below shine new light into the exploration of neuronal 1 micrometer in the largest dimension, enables pathways. This also enables potentially much the possibility to measure the neuronal activ- faster BMIs. For the time being, however, electri- ity in a single neuron, with very high accu- cal and optogenetic BMIs are at an early stage, in racy. Moreover, the total size of each individual which some of the system components have been nano-device, up to a few cubic micrometers at developed and tested, but a fully functional BMI most (Akyildiz and Jornet 2010), minimizes the has not been realized. 4 Brain-Machine Interfaces

Future Directions lection from over the skull) have been pri- marily tested in vitro cell cultures or animals. To enable practical long-term implantable wire- One of the promising approaches relies on less BMIs, there are several bottlenecks that need the use of cerebral organoids, i.e., artificially to be overcome. grown, in vitro, miniature organs resembling the brain. These organoids reproduce the ex- ¥Fromthehardware perspective,themajor act behavior of the brain and are the basis challenges are in terms of the miniaturiza- of recent breakthroughs in (Sta- tion of the neural dust motes. Nano-lasers, chowiak et al. 2017). Beyond in vitro testing, nano-antennas, and nano-photodetectors are the implantation of the devices needs to be op- needed to excite and monitor neural activity timized. Beyond surgery, the combination of through optogenetics. For the time being, the nasal injection and self-assembly techniques smallest laser, experimentally demonstrated to for nano-devices is being considered. date (Feng et al. 2014), is a micro-ring laser with 10 μm in diameter. Given the average size of a neuron cell body, tens of micrometers, current nano-lasers should be able to achieve Key Applications single neuron resolution, provided that they are near it (otherwise, light spreading would ¥ BMIs can significantly improve the quality of result into the illumination of multiple neu- life of people with disabilities, by providing rons). Optical nano-antennas can be utilized them a transformative way to interact with the to then overcome this problem. Besides the environment and restoring functional abilities , piezoelectric energy harvesting nano- and even cognition. For example, the direct systems (Wang 2008; Wang et al. 2017) and control of machines from the brain can help minimal computational and data storage capa- to overcome the limitations in the “interfaces" bilities are needed. between them, namely, the sensor organs or ¥Fromthe communications perspective, locomotion apparatus. effective communication protocols to operate ¥ BMIs can help to broaden the understanding the WiOptNDs are needed. Addressing of of the developmental- and aging-related dis- individual nano-devices, precise triggering eases, such as or Alzheimer, of the optical stimulation, and accurate whose origin lies at communication problems collection of information are crucial tasks between consecutive neurons, and, ultimately, to be performed reliably and with energy enable transformative treatments. efficiency in mind. When developing such ¥ BMIs can help to control specific types of neu- protocols, the physics of the intra-body rological disorders, which to date have been a channel, which affects the propagation of major challenge. A good example is . optical signals for optogenetic excitation and The development toward using miniaturized measurement (Wirdatmadja et al. 2018)as neural dust motes that can be implanted deep well as of the acoustic signals required to into the brain, coupled with optogenetics, can power the nano-devices (Donohoe et al. 2016), provide a mechanism of controlling neurons need to be taken into account. As important as at a single cell level. This means that by their impact on the signal power, their impact understanding the source of the epilepsy, con- on time distortion and synchronization needs trols can be developed to suppress the to be studied (Noel et al. 2018). signaling. ¥ In all cases, human factors need to be taken ¥ BMIs can help to augment people’s brain into account. For the time being, the advanced power going into the future. New concepts BMIs (i.e., anything beyond EEG signal col- such as Targeted Training can Brain-Machine Interfaces 5

emerge, whereby the computing power capa- GM, Kording KP (2013) Physical principles for scal- bilities are augmented with the brain’s training able neural recording. Front Comput Neurosci 7(137). B process. This could enhance the brain with https://doi.org/10.3389/fncom.2013.00137 McGovern B, Berlinguer Palmini R, Grossman N, new skills and also provide people the abilities Drakakis E, Poher V, Neil M, Degenaar P (2010) to acquire new skills where they previously A new individually addressable micro-led array for lacked. photogenetic neural stimulation. IEEE Trans Biomed Circuits Syst 4(6):469Ð476 Millan J, Renkens F, Mourino J, Gerstner W (2004) Noninvasive brain-actuated control of a mobile robot Cross-References by human EEG. IEEE Trans Biomed Eng 51(6): 1026Ð1033  Nanonetworks Nafari M, Jornet JM (2017) Modeling and performance analysis of metallic plasmonic nano-antennas for wire-  Nanoscale Terahertz Communications less optical communication in nanonetworks. IEEE  Terahertz-band nano-communications Access 5:6389Ð6398 Noel A, Makrakis D, Eckford AW (2018) Distortion Acknowledgements This work was supported by the distribution of neural spike train sequence matching U.S. National Science Foundation (NSF) under Grant No. with optogenetics. IEEE Trans Biomed Eng. https:// CBET-1706050. doi.org/10.1109/TBME.2018.2819200 Seo D, Carmena JM, Rabaey JM, Alon E, Maharbiz MM (2013) Neural dust: an ultrasonic, low power solution for chronic brain-machine interfaces. arXiv preprint References arXiv:13072196 Stachowiak EK, Benson CA, Narla ST, Dimitri A, Akyildiz IF, Jornet JM (2010) Electromagnetic wireless Bayona-Chuye LE, Dhiman S, Harikrishnan K, Elahi nanosensor networks. Nano Commun Netw (Elsevier) S, Freedman D, Brennand KJ, Stachowiak MK (2017) J 1(1):3Ð19 Cerebral organoids reveal early cortical maldevelop- Deisseroth K (2011) Optogenetics. Nat Methods 8(1):26Ð ment in schizophrenia? Computational anatomy and 29 genomics, role of fgfr1. Transcult Psychiatry 7(11):6 Donohoe M, Balasubramaniam S, Jennings B, Jornet Wang ZL (2008) Towards self-powered nanosystems: JM (2016) Powering in-body nanosensors with ultra- from nanogenerators to nanopiezotronics. Adv Funct sounds. IEEE Trans Nanotechnol 15(2):151Ð154 Mater 18(22):3553Ð3567 Dorfmuller J, Vogelgesang R, Khunsin W, Rockstuhl C, Wang ZL, Jiang T, Xu L (2017) Toward the blue energy Etrich C, Kern K (2010) Plasmonic nanowire anten- dream by triboelectric nanogenerator networks. Nano nas: experiment, simulation, and theory. Nano Lett Energy 39:9Ð23 10(9):3596Ð3603 Wirdatmadja SA, Barros MT, Koucheryavy Y, Jor- Feng L, Wong ZJ, Ma RM, Wang Y, Zhang X (2014) net JM, Balasubramaniam S (2017) Wireless opto- Single-mode laser by parity-time symmetry breaking. genetic nanonetworks for brain stimulation: device Science 346(6212):972Ð975 model and charging protocols. IEEE Trans NanoBiosci Hochberg LR, Serruya MD, Friehs GM, Mukand JA, 16(8):859Ð872. SalehM,CaplanAH,BrannerA,ChenD,PennRD, Wirdatmadja S, Johari P, Balasubramaniam S, Bae Y, Donoghue JP (2006) control of Stachowiak MK, Jornet JM (2018) Light propagation prosthetic devices by a human with tetraplegia. Nature analysis in nervous tissue for wireless optogenetic 442(7099):164Ð171 nanonetworks. In: Optogenetics and optical manipula- Kwon KY, Lee HM, Ghovanloo M, Weber A, Li W tion 2018, vol 10482. International Society for Optics (2014) A wireless slanted optrode array with integrated and Photonics, p 104820R. https://doi.org/10.1117/12. micro leds for optogenetics. In: 2014 IEEE 27th In- 2288786 ternational Conference on Micro Electro Mechanical Zemelman BV, Lee GA, Ng M, Miesenböck G (2002) Systems (MEMS). IEEE, pp 813Ð816 Selective of genetically charged neu- Leuthardt EC, Miller KJ, Schalk G, Rao RP, Ojemann rons. Neuron 33(1):15Ð22 JG (2006) -based brain computer Zhang F, Aravanis AM, Adamantidis A, de Lecea L, interface-the seattle experience. IEEE Trans Neural Deisseroth K (2007) Circuit-breakers: optical technolo- Syst Rehabil Eng 14(2):194Ð198 gies for probing neural signals and systems. Nat Rev Marblestone AH, Zamft BM, Maguire YG, Shapiro MG, Neurosci 8(8):577Ð581 Cybulski TR, Glaser JI, Amodei D, Stranges PB, Zorzos AN, Boyden ES, Fonstad CG (2010) Multiwaveg- Kalhor R, Dalrymple DA, Seo D, Alon E, Maharbiz uide implantable probe for light delivery to sets of MM, Carmena JM, Rabaey JM, Boyden ES, Church distributed brain targets. Opt Lett 35(24):4133Ð4135