Publications

JTD Keywords: deep generative models, eatris european infrastructure for translational medicine, integrative omics, machine learning, multi-omics, personalized medicine, Deep generative models, Eatris european infrastructure for translational medicine, Integrative omics, Machine learning, Multi-omics, Personalized medicine, Protein protein interaction (ppi) network

Microfluidics represents a very promising technological solution for conducting massive biological experiments. However, the difficulty of managing the amount of information available often precludes the wide potential offered. Using machine learning, we aim to accelerate microfluidics uptake and lead to quantitative and reliable findings. In this work, we propose complementing microfluidics with machine learning (MLM) approaches to enhance the diagnostic capability of lab-on-chip devices. The introduction of data analysis methodologies within the deep learning framework corroborates the possibility of encoding cell morphology beyond the standard cell appearance. The proposed MLM platform is used in a diagnostic test for blood diseases in murine RBC samples in a dedicated microfluidics device in flow. The lack of plasticity of RBCs in Pyruvate Kinase Disease (PKD) is measured massively by recognizing the shape deformation in RBCs walking in a forest of pillars within the chip. Very high accuracy results, far over 85 %, in recognizing PKD from control RBCs either in simulated and in real experiments demonstrate the effectiveness of the platform.

JTD Keywords: Blood disease, Deep transfer learning, Deficiency, Deformability, Machine learning microfluidics, Video analysis

Chronic use of cannabis leads to both motor deficits and the downregulation of CB1 receptors (CB1R) in the cerebellum. In turn, cerebellar damage is often related to impairments in motor learning and control. Further, a recent motor learning task that measures cerebellar-dependent adaptation has been shown to distinguish well between healthy subjects and chronic cannabis users. Thus, the deteriorating effects of chronic cannabis use in motor performance point to cerebellar adaptation as a key process to explain such deficits. We review the literature relating chronic cannabis use, the endocannabinoid system in the cerebellum, and different forms of cerebellar-dependent motor learning, to suggest that CB1R downregulation leads to a generalized underestimation and misprocessing of the sensory errors driving synaptic updates in the cerebellar cortex. Further, we test our hypothesis with a computational model performing a motor adaptation task and reproduce the behavioral effect of decreased implicit adaptation that appears to be a sign of chronic cannabis use. Finally, we discuss the potential of our hypothesis to explain similar phenomena related to motor impairments following chronic alcohol dependency. © 2022

JTD Keywords: adaptation, addiction, alcohol-abuse, cerebellum, chronic cannabis use, cognition, deficits, endocannabinoid system, error processing, explicit, modulation, motor learning, release, synaptic plasticity, Adaptation, Adaptation, physiological, Alcoholism, Article, Behavioral science, Cannabinoid 1 receptor, Cannabis, Cannabis addiction, Cerebellum, Cerebellum cortex, Cerebellum disease, Chronic cannabis use, Computer model, Down regulation, Endocannabinoid, Endocannabinoid system, Endocannabinoids, Error processing, Hallucinogens, Human, Humans, Motor dysfunction, Motor learning, Nerve cell plasticity, Nonhuman, Physiology, Psychedelic agent, Purkinje-cells, Regulatory mechanism, Sensation, Sensory dysfunction, Sensory error processing impairment, Synaptic transmission, Task performance

In cognitive science, Theory of Mind (ToM) is the mental faculty of assessing intentions and beliefs of others and requires, in part, to distinguish incoming sensorimotor (SM) signals and, accordingly, attribute these to either the self-model, the model of the other, or one pertaining to the external world, including inanimate objects. To gain an understanding of this mechanism, we perform a computational analysis of SM interactions in a dual-arm robotic setup. Our main contribution is that, under the common fate principle, a correlation analysis of the velocities of visual pivots is shown to be sufficient to characterize the self (including proximo-distal arm-joint dependencies) and to assess motor to sensory influences, and the other by computing clusters in the correlation dependency graph. A correlational analysis, however, is not sufficient to assess the non-symmetric/directed dependencies required to infer autonomy, the ability of entities to move by themselves. We subsequently validate 3 measures that can potentially quantify a metric for autonomy: Granger causality (GC), transfer entropy (TE), as well as a novel “Acceleration Transfer” (AT) measure, which is an instantaneous measure that computes the estimated instantaneous transfer of acceleration between visual features, from which one can compute a directed SM graph. Subsequently, autonomy is characterized by the sink nodes in this directed graph. This study results show that although TE can capture the directional dependencies, a rectified subtraction operation denoted, in this study, as AT is both sufficient and computationally cheaper.

JTD Keywords: agency, attention, autonomy, cognitive development, computational cognition, developmental psychology, sensorimotor learning, Agency, Attention, Autonomy, Cognitive development, Computational cognition, Developmental psychology, Model, Sensorimotor learning, Theory of mind

Biological cognition is based on the ability to autonomously acquire knowledge, or epistemic autonomy. Such self-supervision is largely absent in artificial neural networks (ANN) because they depend on externally set learning criteria. Yet training ANN using error backpropagation has created the current revolution in artificial intelligence, raising the question of whether the epistemic autonomy displayed in biological cognition can be achieved with error backpropagation-based learning. We present evidence suggesting that the entorhinal–hippocampal complex combines epistemic autonomy with error backpropagation. Specifically, we propose that the hippocampus minimizes the error between its input and output signals through a modulatory counter-current inhibitory network. We further discuss the computational emulation of this principle and analyze it in the context of autonomous cognitive systems. © 2021 Elsevier Ltd

JTD Keywords: computational model, dentate gyrus, error backpropagation, granule cells, grid cells, hippocampus, inhibition, input, neural-networks, neurons, transformation, Artificial intelligence, Artificial neural network, Back propagation, Backpropagation, Brain, Cognitive systems, Counter current, Error back-propagation, Error backpropagation, Errors, Expressing interneurons, Hippocampal complex, Hippocampus, Human experiment, Input and outputs, Learning, Mammal, Mammalian hippocampus, Mammals, Neural networks, Nonhuman, Review, Self-supervised learning

Mapping the biochemical composition of eukaryotic cells without the use of exogenous labels is a long-sought objective in cell biology. Recently, it has been shown that composition maps on dry single bacterial cells with nanoscale spatial resolution can be inferred from quantitative nanoscale dielectric constant maps obtained with the scanning dielectric microscope. Here, it is shown that this approach can also be applied to the much more challenging case of fixed and dry eukaryotic cells, which are highly heterogeneous and show micrometric topographic variations. More importantly, it is demonstrated that the main bottleneck of the technique (the long computation times required to extract the nanoscale dielectric constant maps) can be shortcut by using supervised neural networks, decreasing them from weeks to seconds in a wokstation computer. This easy-to-use data-driven approach opens the door for in situ and on-the-fly label free nanoscale composition mapping of eukaryotic cells with scanning dielectric microscopy. © 2021 The Authors. Small Methods published by Wiley-VCH GmbH

JTD Keywords: eukaryotic cells, label-free mapping, machine learning, nanoscale, scanning dielectric microscopy, Biochemical composition, Cells, Constant, Cytology, Data-driven approach, Dielectric forces, Dielectric materials, Eukaryotic cells, Label-free mapping, Machine learning, Mapping, Nanoscale, Nanoscale composition, Nanoscale spatial resolution, Nanotechnology, Scanning, Scanning dielectric microscopy, Supervised neural networks

The human olfactory system remains one of the most challenging biological systems to replicate. Humans use it without thinking, where it can equally offer protection from harm and bring enjoyment in equal measure. It is the system’s ability to detect and analyze complex odors, without the need for specialized infra-structure, that is the envy of many scientists. The field of artificial olfaction has recruited and stimulated interdisciplinary research and commercial development for several applications that include malodor measurement, medical diagnostics, food and beverage quality, environment and security. Over the last century, innovative engineers and scientists have been focused on solving a range of problems associated with measurement and control of odor. The IEEE Sensors Journal has published Special Issues on olfaction in 2002 and 2012. Here we continue that coverage. In this article, we summarize early work in the 20th Century that served as the foundation upon which we have been building our odor-monitoring instrumental and measurement systems. We then examine the current state of the art that has been achieved over the last two decades as we have transitioned into the 21st Century. Much has been accomplished, but great progress is needed in sensor technology, system design, product manufacture and performance standards. In the final section, we predict levels of performance and ubiquitous applications that will be realized during in the mid to late 21st Century.

JTD Keywords: air-quality, breath analysis, calibration transfer, chemical sensor arrays, chemosensor arrays, drift compensation, electronic nose, gas sensors, headspace sampling, machine learning, machine olfaction, odor detection, plume structure, voc analysis, Artificial olfaction, Electrodes, Electronic nose, Electronic nose technology, Headspace sampling, Instruments, Machine learning, Machine olfaction, Monitoring, Odor detection, Olfactory, Sensor phenomena and characterization, Sensors, Temperature sensors, Voc analysis

© 2021 Elsevier B.V. The blood-brain barrier (BBB) is a dynamic cellular barrier that regulates brain nutrient supply, waste efflux, and paracellular diffusion through specialized junctional complexes. Finding a system to mimic and monitor BBB integrity (i.e., to be able to assess the effect of certain compounds on opening or closing the barrier) is of vital importance in several pathologies. This work aims to overcome some limitations of current barrier integrity measuring techniques thanks to a multi-layer microfluidic platform with integrated electrodes and Multi-frequency Trans-Endothelial Electrical Resistance (MTEER) in synergy with machine learning algorithms. MTEER measurements are performed across the barrier in a range of frequencies up to 10 MHz highlighting the presence of information on different frequency ranges. Results show that the proposed platform can detect barrier formation, opening, and regeneration afterwards, correlating with the results obtained from immunostaining of junctional complexes. This model presents novel techniques for a future biological barrier in-vitro studies that could potentially help on elucidating barrier opening or sealing on treatments with different drugs.

JTD Keywords: blood-brain barrier, cellular barrier integrity monitoring, impedance sensors, machine learning, microelectrodes, mteer, rapid prototyping, Blood-brain barrier, Cellular barrier integrity monitoring, Electrical impedance spectroscopy, Impedance sensors, Machine learning, Microelectrodes, Mteer, Rapid prototyping

© The Author(s) 2021. Background: The negative discrepancy between residual functional capacity and reduced use of the contralesional hand, frequently observed after a brain lesion, has been termed Learned Non-Use (LNU) and is thought to depend on the interaction of neuronal mechanisms during recovery and learning-dependent mechanisms. Objective: Albeit the LNU phenomenon is generally accepted to exist, currently, no transdisciplinary definition exists. Furthermore, although therapeutic approaches are implemented in clinical practice targeting LNU, no standardized diagnostic routine is described in the available literature. Our objective was to reach consensus regarding a definition as well as synthesize knowledge about the current diagnostic procedures. Methods: We used a structured group communication following the Delphi method among clinical and scientific experts in the field, knowledge from both, the work with patient populations and with animal models. Results: Consensus was reached regarding a transdisciplinary definition of the LNU phenomenon. Furthermore, the mode and strategy of the diagnostic process, as well as the sources of information and outcome parameters relevant for the clinical decision making, were described with a wide range showing the current lack of a consistent universal diagnostic approach. Conclusions: The need for the development of a structured diagnostic procedure and its implementation into clinical practice is emphasized. Moreover, it exists a striking gap between the prevailing hypotheses regarding the mechanisms underlying the LNU phenomenon and the actual evidence. Therefore, basic research is needed to bridge between bedside and bench and eventually improve clinical decision making and further development of interventional strategies beyond the field of stroke rehabilitation.

JTD Keywords: diagnosis, experience-dependent non-use, perceptual disorders, rehabilitation, sensorimotor learning, Diagnosis, Experience-dependent non-use, Perceptual disorders, Rehabilitation, Sensorimotor learning

© 2021 National Academy of Sciences. All rights reserved. Electrophysiological studies in rodents show that active navigation enhances hippocampal theta oscillations (4–12 Hz), providing a temporal framework for stimulus-related neural codes. Here we show that active learning promotes a similar phase coding regime in humans, although in a lower frequency range (3–8 Hz). We analyzed intracranial electroencephalography (iEEG) from epilepsy patients who studied images under either volitional or passive learning conditions. Active learning increased memory performance and hippocampal theta oscillations and promoted a more accurate reactivation of stimulus-specific information during memory retrieval. Representational signals were clustered to opposite phases of the theta cycle during encoding and retrieval. Critically, during active but not passive learning, the temporal structure of intracycle reactivations in theta reflected the semantic similarity of stimuli, segregating conceptually similar items into more distant theta phases. Taken together, these results demonstrate a multilayered mechanism by which active learning improves memory via a phylogenetically old phase coding scheme.

JTD Keywords: active learning, dynamics, gamma-power, hippocampus, intracranial eeg, movement, navigation, neural phase coding, oscillations, representations, retrieval, rhythm, theta oscillations, toolbox, Active learning, Theta oscillations, Working-memory

The sample-inefficiency problem in Artificial Intelligence refers to the inability of current Deep Reinforcement Learning models to optimize action policies within a small number of episodes. Recent studies have tried to overcome this limitation by adding memory systems and architectural biases to improve learning speed, such as in Episodic Reinforcement Learning. However, despite achieving incremental improvements, their performance is still not comparable to how humans learn behavioral policies. In this paper, we capitalize on the design principles of the Distributed Adaptive Control (DAC) theory of mind and brain to build a novel cognitive architecture (DAC-ML) that, by incorporating a hippocampus-inspired sequential memory system, can rapidly converge to effective action policies that maximize reward acquisition in a challenging foraging task.

JTD Keywords: Cognitive architecture, Distributed adaptive control, Reinforcement learning, Sample-inefficiency problem, Sequence learning

The mechanisms of how the brain orchestrates multi-limb joint action have yet to be elucidated and few computational sensorimotor (SM) learning approaches have dealt with the problem of acquiring bimanual affordances. We propose a series of bidirectional (forward/inverse) SM maps and its associated learning processes that generalize from uni- to bimanual interaction (and affordances) naturally, reinforcing the motor equivalence property. The SM maps range from a SM nature to a solely sensory one: full body control, delta SM control (through small action changes), delta sensory co-variation (how body-related perceptual cues covariate with object-related ones). We make several contributions on how these SM maps are learned: (1) Context and Behavior-Based Babbling: generalizing goal babbling to the interleaving of absolute and local goals including guidance of reflexive behaviors; (2) Event-Based Learning: learning steps are driven by visual, haptic events; and (3) Affordance Gradients: the vectorial field gradients in which an object can be manipulated. Our modeling of bimanual affordances is in line with current robotic research in forward visuomotor mappings and visual servoing, enforces the motor equivalence property, and is also consistent with neurophysiological findings like the multiplicative encoding scheme.

JTD Keywords: Affordances, Bimanual affordances, Goal babbling, Interlimb coordination, Motor equivalence, Sensorimotor learning

This book constitutes the proceedings of the )th International Conference on Biomimetic and Biohybrid Systems, Living Machines 2020, held in Freiburg, Germany, in July 2020. Due to COVID-19 pandemic the conference was held virtually. The 32 full and 7 short papers presented in this volume were carefully reviewed and selected from 45 submissions. They deal with research on novel life-like technologies inspired by the scientific investigation of biological systems, biomimetics, and research that seeks to interface biological and artificial systems to create biohybrid systems.

JTD Keywords: Artificial intelligence, Soft robotics, Biomimetics, Insect navigation, Synthetic nervous system, Computer vision, Bio-inspired materials, Visual homing, Locomotion+, Image processing, Intelligent robots, Human-robot interaction, Machine learning, Snake robot, Mobile robots, Robotic systems, Drosophila, Robots, Sensors, Signal processing

The intermittency of the instantaneous concentration of a turbulent chemical plume is a fundamental cue for estimating the chemical source distance using chemical sensors. Such estimate is useful in applications such as environmental monitoring or localization of fugitive gas emissions by mobile robots or sensor networks. However, the inherent low-pass filtering of metal oxide (MOX) gas sensors-typically used in odor-guided robots and dense sensor networks due to their low cost, weight and size-hinders the quantification of concentration intermittency. In this paper, we design a digital differentiator to invert the low-pass dynamics of the sensor response, thus obtaining a much faster signal from which the concentration intermittency can be effectively computed. Using a fast photo-ionization detector as a reference instrument, we demonstrate that the filtered signal is a good approximation of the instantaneous concentration in a real turbulent plume. We then extract transient features from the filtered signal-the so-called “bouts”-to predict the chemical source distance, focusing on the optimization of the filter parameters and the noise threshold to make the predictions robust against changing wind conditions. This represents an advantage over previous bout-based models which require wind measurements-typically taken with expensive and bulky anemometers-to produce accurate predictions. The proposed methodology is demonstrated in a wind tunnel scenario where a MOX sensor is placed at various distances downwind of an emitting chemical source and the wind speed varies in the range 10-34 cm/s. The results demonstrate that models optimized with our methodology can provide accurate source distance predictions at different wind speeds.

JTD Keywords: Gas detectors, Chemical sensors, Signal processing, Machine learning, Time series analysis

Background—The cerebellum has been recently suggested as an important player in the addiction brain circuit. Cannabis is one of the most used drugs worldwide, and its long-term effects on the central nervous system are not fully understood. No valid clinical evaluations of cannabis impact on the brain are available today. The cerebellum is expected to be one of the brain structures that are highly affected by prolonged exposure to cannabis, due to its high density in endocannabinoid receptors. We aim to use a motor adaptation paradigm to indirectly assess cerebellar function in chronic cannabis users (CCUs). Methods—We used a visuomotor rotation (VMR) task that probes a putatively-cerebellar implicit motor adaptation process together with the learning and execution of an explicit aiming rule. We conducted a case-control study, recruiting 18 CCUs and 18 age-matched healthy controls. Our main measure was the angular aiming error. Results—Our results show that CCUs have impaired implicit motor adaptation, as they showed a smaller rate of adaptation compared with healthy controls (drift rate: 19.3 +/− 6.8° vs. 27.4 +/− 11.6°; t(26) = −2.1, p = 0.048, Cohen’s d = −0.8, 95% CI = (−1.7, −0.15)). Conclusions—We suggest that a visuomotor rotation task might be the first step towards developing a useful tool for the detection of alterations in implicit learning among cannabis users.

JTD Keywords: Cerebellum, Cannabis, Implicit motor learning, Motor adaptation, Visuomotor rotation

What are the principles underlying effective neurorehabilitation? The aim of neurorehabilitation is to exploit interventions based on human and animal studies about learning and adaptation, as well as to show that the activation of experience-dependent neuronal plasticity augments functional recovery after stroke. Instead of teaching compensatory strategies that do not reduce impairment but allow the patient to return home as soon as possible, functional recovery might be more sustainable as it ensures a long-term reduction in impairment and an improvement in quality of life. At the same time, neurorehabilitation permits the scientific community to collect valuable data, which allows inferring about the principles of brain organization. Hence neuroscience sheds light on the mechanisms of learning new functions or relearning lost ones. However, current rehabilitation methods lack the exact operationalization of evidence gained from skill learning literature, leading to an urgent need to bridge motor learning theory and present clinical work in order to identify a set of ingredients and practical applications that could guide future interventions. This work aims to unify the neuroscientific literature relevant to the recovery process and rehabilitation practice in order to provide a synthesis of the principles that constitute an effective neurorehabilitation approach. Previous attempts to achieve this goal either focused on a subset of principles or did not link clinical application to the principles of motor learning and recovery. We identified 15 principles of motor learning based on existing literature: massed practice, spaced practice, dosage, task-specific practice, goal-oriented practice, variable practice, increasing difficulty, multisensory stimulation, rhythmic cueing, explicit feedback/knowledge of results, implicit feedback/knowledge of performance, modulate effector selection, action observation/embodied practice, motor imagery, and social interaction. We comment on trials that successfully implemented these principles and report evidence from experiments with healthy individuals as well as clinical work.

JTD Keywords: Neurorehabilitation, Motor learning, Plasticity, Stroke, Principles

This book constitutes the proceedings of the 8th International Conference on Biomimetic and Biohybrid Systems, Living Machines 2019, held in Nara, Japan, in July 2019. The 26 full and 16 short papers presented in this volume were carefully reviewed and selected from 45 submissions. They deal with research on novel life-like technologies inspired by the scientific investigation of biological systems, biomimetics, and research that seeks to interface biological and artificial systems to create biohybrid systems.

JTD Keywords: Artificial intelligence, Biomimetics, Computer architecture, Human robot interaction, Human-Computer Interaction (HCI), Humanoid robot, Image processing, Learning algorithms, Mobile robots, Multipurpose robots, Neural networks, Quadruped robots, Reinforcement learning, Robot learning, Robotics, Robots, Sensor, Sensors, Swarm robotics, User interfaces

Indoor fire detection using gas chemical sensing has been a subject of investigation since the early nineties. This approach leverages the fact that, for certain types of fire, chemical volatiles appear before smoke particles do. Hence, systems based on chemical sensing can provide faster fire alarm responses than conventional smoke-based fire detectors. Moreover, since it is known that most casualties in fires are produced from toxic emissions rather than actual burns, gas-based fire detection could provide an additional level of safety to building occupants. In this line, since the 2000s, electrochemical cells for carbon monoxide sensing have been incorporated into fire detectors. Even systems relying exclusively on gas sensors have been explored as fire detectors. However, gas sensors respond to a large variety of volatiles beyond combustion products. As a result, chemical-based fire detectors require multivariate data processing techniques to ensure high sensitivity to fires and false alarm immunity. In this paper, we the survey toxic emissions produced in fires and defined standards for fire detection systems. We also review the state of the art of chemical sensor systems for fire detection and the associated signal and data processing algorithms. We also examine the experimental protocols used for the validation of the different approaches, as the complexity of the test measurements also impacts on reported sensitivity and specificity measures. All in all, further research and extensive test under different fire and nuisance scenarios are still required before gas-based fire detectors penetrate largely into the market. Nevertheless, the use of dynamic features and multivariate models that exploit sensor correlations seems imperative

JTD Keywords: Fire detection, Gas sensor, Pattern recognition, Sensor fusion, Machine learning, Toxicants, Carbon monoxide, Hydrogen cyanide, Standard test fires, Transducers, Smoke

Machine Learning algorithms (and in particular Reinforcement Learning (RL)) have proved very successful in recent years. These have managed to achieve super-human performance in many different tasks, from video-games to board-games and complex cognitive tasks such as path-planning or Theory of Mind (ToM) on artificial agents. Nonetheless, this super-human performance is also super-artificial. Despite some metrics are better than what a human can achieve (i.e. cumulative reward), in less common metrics (i.e. time to learning asymptote) the performance is significantly worse. Moreover, the means by which those are achieved fail to extend our understanding of the human or mammal brain. Moreover, most approaches used are based on black-box optimization, making any comparison beyond performance (e.g. at the architectural level) difficult. In this position paper, we review the origins of reinforcement learning and propose its extension with models of learning derived from fear and avoidance behaviors. We argue that avoidance-based mechanisms are required when training on embodied, situated systems to ensure fast and safe convergence and potentially overcome some of the current limitations of the RL paradigm.

JTD Keywords: Avoidance, Neural networks, Reinforcement learning

This chapter discusses basic concepts from control theory and machine learning to facilitate a formal understanding of animal learning and motor control. It first distinguishes between feedback and feed-forward control strategies, and later introduces the classification of machine learning applications into supervised, unsupervised, and reinforcement learning problems. Next, it links these concepts with their counterparts in the domain of the psychology of animal learning, highlighting the analogies between supervised learning and classical conditioning, reinforcement learning and operant conditioning, and between unsupervised and perceptual learning. Additionally, it interprets innate and acquired actions from the standpoint of feedback vs anticipatory and adaptive control. Finally, it argues how this framework of translating knowledge between formal and biological disciplines can serve us to not only structure and advance our understanding of brain function but also enrich engineering solutions at the level of robot learning and control with insights coming from biology.

JTD Keywords: Feedback control, Feed-forward control, Supervised learning, Unsupervised learning, Reinforcement, Learning, Classical conditioning, Operant conditioning, Reflex, Anticipatory reflex

A major challenge in cognitive science and AI is to understand how intelligent agents might be able to predict mental states of other agents during complex social interactions. What are the computational principles of such a Theory of Mind (ToM)? In previous work, we have investigated hypotheses of how the human brain might realize a ToM of other agents in a multi-agent social scenario. In particular, we have proposed control-based cognitive architectures to predict the model of other agents in a game-theoretic task (Battle of the Exes). Our multi-layer architecture implements top-down predictions from adaptive to reactive layers of control and bottom-up error feedback from reactive to adaptive layers. We tested cooperative and competitive strategies among different multi-agent models, demonstrating that while pure RL leads to reasonable efficiency and fairness in social interactions, there are other architectures that can perform better in specific circumstances. However, we found that even the best predictive models fall short of human data in terms of stability of social convention formation. In order to explain this gap between humans and predictive AI agents, in this work we propose introducing the notion of trust in the form of mutual agreements between agents that might enhance stability in the formation of conventions such as turn-taking.

JTD Keywords: Cognitive Architectures, Game Theory, Multi-Agent Models, Reinforcement Learning, Theory of Mind

This book constitutes the proceedings of the 7th International Conference on Biomimetic and Biohybrid Systems, Living Machines 2018, held in Paris, France, in July 2018. The 40 full and 18 short papers presented in this volume were carefully reviewed and selected from 60 submissions. The theme of the conference targeted at the intersection of research on novel life-like technologies inspired by the scientific investigation of biological systems, biomimetics, and research that seeks to interface biological and artificial systems to create biohybrid systems.

JTD Keywords: Artificial neural network, Bio-actuators, Bio-robotics, Biohybrid systems, Biomimetics, Bipedal robots, Earthoworm-like robots, Robotics, Decision-making, Tactile sensing, Soft robots, Locomotion, Insects, Sensors, Actuators, Robots, Artificial intelligence, Neural networks, Motion planning, Learning algorithms

Humans display anticipatory motor responses to minimize the adverse effects of predictable perturbations. A widely accepted explanation for this behavior relies on the notion of an inverse model that, learning from motor errors, anticipates corrective responses. Here, we propose and validate the alternative hypothesis that anticipatory control can be realized through a cascade of purely sensory predictions that drive the motor system, reflecting the causal sequence of the perceptual events preceding the error. We compare both hypotheses in a simulated anticipatory postural adjustment task. We observe that adaptation in the sensory domain, but not in the motor one, supports the robust and generalizable anticipatory control characteristic of biological systems. Our proposal unites the neurobiology of the cerebellum with the theory of active inference and provides a concrete implementation of its core tenets with great relevance both to our understanding of biological control systems and, possibly, to their emulation in complex artefacts.

JTD Keywords: Active inference, Cerebellum, Computational model, Motor control, Perceptual learning

Fuzzy theory was motivated by the need to create human-like solutions that allow representing vagueness and uncertainty that exist in the real-world. These capabilities have been recently further enhanced by deep learning since it allows converting complex relation between data into knowledge. In this paper, we present a novel Deep-Neuro-Fuzzy strategy for unsupervised estimation of the interaction forces in Robotic Assisted Minimally Invasive scenarios. In our approach, the capability of Neuro-Fuzzy systems for handling visual uncertainty, as well as the inherent imprecision of real physical problems, is reinforced by the advantages provided by Deep Learning methods. Experiments conducted in a realistic setting have demonstrated the superior performance of the proposed approach over existing alternatives. More precisely, our method increased the accuracy of the force estimation and compared favorably to existing state of the art approaches, offering a percentage of improvement that ranges from about 35% to 85%.

JTD Keywords: Estimation, Force, Machine learning, Robots, Three-dimensional displays, Uncertainty, Visualization

Endowing current surgical robotic systems with haptic feedback to perform minimally invasive surgery (MIS), such as laparoscopy, is still a challenge. Haptic is a feature lost in surgical teleoperated systems limiting surgeons capabilities and ability. The availability of haptics would provide important advantages to the surgeon: Improved tissue manipulation, reducing the breaking of sutures and increase the feeling of telepresence, among others. To design and develop a haptic system, the measurement of forces can be implemented based on two approaches: Direct and indirect force sensing. MIS performed with surgical robots, imposes many technical constraints to measure forces, such as: Miniaturization, need of sterilization or materials compatibility, making it necessary to rely on indirect force sensing. Based on mathematical models of the components involved in an intervention and indirect force sensing techniques, a global perspective on how to address the problem of measurement of tool-tissue interaction forces is presented.

JTD Keywords: Surgical robotics, Haptic feedback, Indirect force sensing, Machine learning, Data fusion, Mathematical models

Robot-assisted rehabilitation therapies usually focus on physical aspects rather than on cognitive factors. However, cognitive aspects such as attention, motivation, and engagement play a critical role in motor learning and thus influence the long-term success of rehabilitation programs. This paper studies motor-related EEG activity during the execution of robot-assisted passive movements of the upper limb, while participants either: i) focused attention exclusively on the task; or ii) simultaneously performed another task. Six healthy subjects participated in the study and results showed lower desynchronization during passive movements with another task simultaneously being carried out (compared to passive movements with exclusive attention on the task). In addition, it was proved the feasibility to distinguish between the two conditions.

JTD Keywords: Electrodes, Electroencephalography, Induction motors, Medical treatment, Robot sensing systems, Time frequency analysis, Biomechanics, Cognition, Electroencephalography, Medical robotics, Medical signal detection, Medical signal processing, Patient rehabilitation, Attention, Cognitive aspects, Desynchronization, Engagement, Motivation, Motor learning, Motor task, Motor-related EEG activity, Physical aspects, Robot-assisted passive movement detection, Robot-assisted rehabilitation therapies, Upper limb