Publications

JTD Keywords: biochemical engineering, neurotrauma and neurodegenerative disease, optogenetics and dreadds, spinal cord injury (sci), Biochemical engineering, Neurotrauma and neurodegenerative disease, Optogenetics and dreadds, Sensorimotor, Spinal cord injury (sci)

JTD Keywords: coordination, embodied cognition, human-robot interaction, sensorimotor coupling, Coordination, Embodied cognition, Human-robot interaction, Sensorimotor coupling, Social cognition

Large doses of movement practice have been shown to restore upper extremities' motor function in a significant subset of individuals post-stroke. However, such large doses are both difficult to implement in the clinic and highly inefficient. In addition, an important reduction in upper extremity function and use is commonly seen following rehabilitation-induced gains, resulting in “rehabilitation in vain”. For those with mild to moderate sensorimotor impairment, the limited spontaneous use of the more affected limb during activities of daily living has been previously proposed to cause a decline of motor function, initiating a vicious cycle of recovery, in which non-use and poor performance reinforce each other. Here, we review computational, experimental, and clinical studies that support the view that if arm use is raised above an effective threshold, one enters a virtuous cycle in which arm use and function can reinforce each other via self-practice in the wild. If not, one enters a vicious cycle of declining arm use and function. In turn, and in line with best practice therapy recommendations, this virtuous/vicious cycle model advocates for a paradigm shift in neurorehabilitation whereby rehabilitation be embedded in activities of daily living such that self-practice with the aid of wearable technology that reminds and motivates can enhance paretic limb use of those who possess adequate residual sensorimotor capacity. Altogether, this model points to a user-centered approach to recovery post-stroke that is tailored to the participant's level of arm use and designed to motivate and engage in self-practice through progressive success in accomplishing meaningful activities in the wild. Copyright © 2022 Ballester, Winstein and Schweighofer.

JTD Keywords: compensatory movement, computational neurorehabilitation, decision-making, individuals, learned non-use, learned nonuse, monkeys, neurorehabilitation, recovery, rehabilitation, stroke, stroke patients, wearable sensors, wrist, Arm movement, Article, Cerebrovascular accident, Clinical decision making, Clinical practice, Clinical study, Compensatory movement, Computational neurorehabilitation, Computer model, Daily life activity, Decision-making, Experimental study, Human, Induced movement therapy, Learned non-use, Musculoskeletal function, Neurorehabilitation, Paresis, Sensorimotor function, Stroke, Stroke rehabilitation, User-centered design, Vicious cycle, Virtuous cycle, Wearable sensors

In cognitive science, Theory of Mind (ToM) is the mental faculty of assessing intentions and beliefs of others and requires, in part, to distinguish incoming sensorimotor (SM) signals and, accordingly, attribute these to either the self-model, the model of the other, or one pertaining to the external world, including inanimate objects. To gain an understanding of this mechanism, we perform a computational analysis of SM interactions in a dual-arm robotic setup. Our main contribution is that, under the common fate principle, a correlation analysis of the velocities of visual pivots is shown to be sufficient to characterize the self (including proximo-distal arm-joint dependencies) and to assess motor to sensory influences, and the other by computing clusters in the correlation dependency graph. A correlational analysis, however, is not sufficient to assess the non-symmetric/directed dependencies required to infer autonomy, the ability of entities to move by themselves. We subsequently validate 3 measures that can potentially quantify a metric for autonomy: Granger causality (GC), transfer entropy (TE), as well as a novel “Acceleration Transfer” (AT) measure, which is an instantaneous measure that computes the estimated instantaneous transfer of acceleration between visual features, from which one can compute a directed SM graph. Subsequently, autonomy is characterized by the sink nodes in this directed graph. This study results show that although TE can capture the directional dependencies, a rectified subtraction operation denoted, in this study, as AT is both sufficient and computationally cheaper.

JTD Keywords: agency, attention, autonomy, cognitive development, computational cognition, developmental psychology, sensorimotor learning, Agency, Attention, Autonomy, Cognitive development, Computational cognition, Developmental psychology, Model, Sensorimotor learning, Theory of mind

© The Author(s) 2021. Background: The negative discrepancy between residual functional capacity and reduced use of the contralesional hand, frequently observed after a brain lesion, has been termed Learned Non-Use (LNU) and is thought to depend on the interaction of neuronal mechanisms during recovery and learning-dependent mechanisms. Objective: Albeit the LNU phenomenon is generally accepted to exist, currently, no transdisciplinary definition exists. Furthermore, although therapeutic approaches are implemented in clinical practice targeting LNU, no standardized diagnostic routine is described in the available literature. Our objective was to reach consensus regarding a definition as well as synthesize knowledge about the current diagnostic procedures. Methods: We used a structured group communication following the Delphi method among clinical and scientific experts in the field, knowledge from both, the work with patient populations and with animal models. Results: Consensus was reached regarding a transdisciplinary definition of the LNU phenomenon. Furthermore, the mode and strategy of the diagnostic process, as well as the sources of information and outcome parameters relevant for the clinical decision making, were described with a wide range showing the current lack of a consistent universal diagnostic approach. Conclusions: The need for the development of a structured diagnostic procedure and its implementation into clinical practice is emphasized. Moreover, it exists a striking gap between the prevailing hypotheses regarding the mechanisms underlying the LNU phenomenon and the actual evidence. Therefore, basic research is needed to bridge between bedside and bench and eventually improve clinical decision making and further development of interventional strategies beyond the field of stroke rehabilitation.

JTD Keywords: diagnosis, experience-dependent non-use, perceptual disorders, rehabilitation, sensorimotor learning, Diagnosis, Experience-dependent non-use, Perceptual disorders, Rehabilitation, Sensorimotor learning

This paper addresses how impairments in prediction in young adults with autism spectrum disorder (ASD) relate to their behavior during collaboration. To assess it, we developed a task where participants play in collaboration with a synthetic agent to maximize their score. The agent’s behavior changes during the different phases of the game, requiring participants to model the agent’s sensorimotor contingencies to play collaboratively. Our results (n = 30, 15 per group) show differences between autistic and neurotypical individuals in their behavioral adaptation to the other partner. Contrarily, there are no differences in the self-reports of that collaboration.

JTD Keywords: Autism, Prediction, Collaboration, Sensorimotor contingencies, Neurodiversity

The mechanisms of how the brain orchestrates multi-limb joint action have yet to be elucidated and few computational sensorimotor (SM) learning approaches have dealt with the problem of acquiring bimanual affordances. We propose a series of bidirectional (forward/inverse) SM maps and its associated learning processes that generalize from uni- to bimanual interaction (and affordances) naturally, reinforcing the motor equivalence property. The SM maps range from a SM nature to a solely sensory one: full body control, delta SM control (through small action changes), delta sensory co-variation (how body-related perceptual cues covariate with object-related ones). We make several contributions on how these SM maps are learned: (1) Context and Behavior-Based Babbling: generalizing goal babbling to the interleaving of absolute and local goals including guidance of reflexive behaviors; (2) Event-Based Learning: learning steps are driven by visual, haptic events; and (3) Affordance Gradients: the vectorial field gradients in which an object can be manipulated. Our modeling of bimanual affordances is in line with current robotic research in forward visuomotor mappings and visual servoing, enforces the motor equivalence property, and is also consistent with neurophysiological findings like the multiplicative encoding scheme.

JTD Keywords: Affordances, Bimanual affordances, Goal babbling, Interlimb coordination, Motor equivalence, Sensorimotor learning

This pilot study investigates the role of social sensorimotor contingencies as exhibited from a humanoid robot to allow mutual understanding and social entrainment in a group social activity. The goal is to evaluate whether sensorimotor contingencies can lead to transparent and understandable interactions while we explore the dimension of personality. We propose the task of taking a selfie with a robot and a group of humans as the benchmark to evaluate the social sensorimotor contingencies displayed. We have constructed two models of interaction with an introverted and extroverted robot. We also seek to address the gap in research in context and personality of social sensorimotor contingencies in HRI and contribute to the field of personality in social robotics by determining what type of behaviour of the robot attracts certain personalities in humans in group settings. Although the sample size was small, and there were no significant differences between conditions, results suggest that the expression of sensorimotor contingencies can lead to successful coupling and interactions.

JTD Keywords: Human-robot interaction, Personality, Social robots, Social sensorimotor contingencies