Publications

In cognitive science, Theory of Mind (ToM) is the mental faculty of assessing intentions and beliefs of others and requires, in part, to distinguish incoming sensorimotor (SM) signals and, accordingly, attribute these to either the self-model, the model of the other, or one pertaining to the external world, including inanimate objects. To gain an understanding of this mechanism, we perform a computational analysis of SM interactions in a dual-arm robotic setup. Our main contribution is that, under the common fate principle, a correlation analysis of the velocities of visual pivots is shown to be sufficient to characterize the self (including proximo-distal arm-joint dependencies) and to assess motor to sensory influences, and the other by computing clusters in the correlation dependency graph. A correlational analysis, however, is not sufficient to assess the non-symmetric/directed dependencies required to infer autonomy, the ability of entities to move by themselves. We subsequently validate 3 measures that can potentially quantify a metric for autonomy: Granger causality (GC), transfer entropy (TE), as well as a novel “Acceleration Transfer” (AT) measure, which is an instantaneous measure that computes the estimated instantaneous transfer of acceleration between visual features, from which one can compute a directed SM graph. Subsequently, autonomy is characterized by the sink nodes in this directed graph. This study results show that although TE can capture the directional dependencies, a rectified subtraction operation denoted, in this study, as AT is both sufficient and computationally cheaper.

JTD Keywords: agency, attention, autonomy, cognitive development, computational cognition, developmental psychology, sensorimotor learning, Agency, Attention, Autonomy, Cognitive development, Computational cognition, Developmental psychology, Model, Sensorimotor learning, Theory of mind

© The Author(s) 2021. Background: The negative discrepancy between residual functional capacity and reduced use of the contralesional hand, frequently observed after a brain lesion, has been termed Learned Non-Use (LNU) and is thought to depend on the interaction of neuronal mechanisms during recovery and learning-dependent mechanisms. Objective: Albeit the LNU phenomenon is generally accepted to exist, currently, no transdisciplinary definition exists. Furthermore, although therapeutic approaches are implemented in clinical practice targeting LNU, no standardized diagnostic routine is described in the available literature. Our objective was to reach consensus regarding a definition as well as synthesize knowledge about the current diagnostic procedures. Methods: We used a structured group communication following the Delphi method among clinical and scientific experts in the field, knowledge from both, the work with patient populations and with animal models. Results: Consensus was reached regarding a transdisciplinary definition of the LNU phenomenon. Furthermore, the mode and strategy of the diagnostic process, as well as the sources of information and outcome parameters relevant for the clinical decision making, were described with a wide range showing the current lack of a consistent universal diagnostic approach. Conclusions: The need for the development of a structured diagnostic procedure and its implementation into clinical practice is emphasized. Moreover, it exists a striking gap between the prevailing hypotheses regarding the mechanisms underlying the LNU phenomenon and the actual evidence. Therefore, basic research is needed to bridge between bedside and bench and eventually improve clinical decision making and further development of interventional strategies beyond the field of stroke rehabilitation.

JTD Keywords: diagnosis, experience-dependent non-use, perceptual disorders, rehabilitation, sensorimotor learning, Diagnosis, Experience-dependent non-use, Perceptual disorders, Rehabilitation, Sensorimotor learning

The mechanisms of how the brain orchestrates multi-limb joint action have yet to be elucidated and few computational sensorimotor (SM) learning approaches have dealt with the problem of acquiring bimanual affordances. We propose a series of bidirectional (forward/inverse) SM maps and its associated learning processes that generalize from uni- to bimanual interaction (and affordances) naturally, reinforcing the motor equivalence property. The SM maps range from a SM nature to a solely sensory one: full body control, delta SM control (through small action changes), delta sensory co-variation (how body-related perceptual cues covariate with object-related ones). We make several contributions on how these SM maps are learned: (1) Context and Behavior-Based Babbling: generalizing goal babbling to the interleaving of absolute and local goals including guidance of reflexive behaviors; (2) Event-Based Learning: learning steps are driven by visual, haptic events; and (3) Affordance Gradients: the vectorial field gradients in which an object can be manipulated. Our modeling of bimanual affordances is in line with current robotic research in forward visuomotor mappings and visual servoing, enforces the motor equivalence property, and is also consistent with neurophysiological findings like the multiplicative encoding scheme.

JTD Keywords: Affordances, Bimanual affordances, Goal babbling, Interlimb coordination, Motor equivalence, Sensorimotor learning