Continent upon the quality of subjectivity is placed on the human partner side, synthetic agents have served methodological purposes for varied ends, such as diagnosing, assisting, and learning. Hence, by providing assistance therapy, robots can help humans recover from sensory-motor deficits in some neuro-psychological conditions (Gassert & Dietz ( ) ). Interaction has also served to study neural development in autistic spectrum disorder (ASD, Robins et al. ( ) , Scassellati et al. ( ) , Ismail et al. ( ) ). Furthermore, robotics has contributed to the acquisition of computational thinking skills (Atmatzidou & Demetriadis ( ) ), improving executive functions of planning and control (Di Lieto et al. ( ) ), sensory-motor gaming (Kose-Bagci ( ) ), and metacognitive and problem solving (Atmatzidou el al. ( ) ).

An important aspect to point out is that diverse approaches can be adopted for providing the robot with control and interaction capabilities. Since the focus is placed on the human subject, the internal structure of the artificial partner is considered of secondary importance to the analysis of experimental protocols, which include mostly observations on the human side. Frequently, the robot is included as a black-box system, providing some degree of standardization to ground conclusions. Although this sort of studies is relevant for advancing several fields in human science, we are interested in considering artificial subjectivity in the research hypotheses design, which is described next.

Focusing on the robot as a subject originates from the interest in studying human cognition. Initiatives under this perspective share the expectation that plausible theories in cognitive science can be constructed through modeling and implementing cognitive control schemes in robots. Here, the human partner acts by stimulating the robot during interaction. Thus, observations on the human side are considered in terms of evaluating experimental hypotheses on the synthetic prototype.

In order to extend the result of robotics research to human science, some authors have followed, from an interdisciplinary perspective, a behavior-centered approach, so focusing on robotics research results that could be directly mapped to analogous studies and tasks with human infants and children (Cangelosi & Schlesinger ( ) ). According to Asada et al. ( ) , since the knowledge available in developmental cognitive robotics is insufficient, several implementations are proposed to investigate cognitive functions from the designers’ limited understanding of them (e.g. to study foundations of communication, Kuniyoshi et al. ( ) ).

The research conducted in our lab has focused on composable continuous state space neuro-dynamic structures for the study of cognition (Tani ( ) ). Taking inspiration from brain sciences, several recurrent neural network architectures (e.g. Tani ( ) and Murata et al. ( ) ) have been proposed for learning spatial-temporal relations in behavior sequences. These models have been used to investigate diverse skills, such as goal-directed planning (Jung et al. ( ) ) and imitation (Hwang et al. ( ) , Ohata & Tani ( ) ). Within the neural robotics conception adopted in our lab, cognition is studied as an emergent phenomenon that results from the interaction between a top-down process, that characterizes subjective deliberation and agency, and a bottom-up information process, that accounts for the perceptual reality. Next, we argue neural robots are valuable means to study human-robot non-verbal communication, where both partners are included as subjects in the research hypotheses design.

Intersubjectivity is a concept that carries deep philosophical roots. It is fundamental to Hursserl’s foundations on phenomenology ( ) , and received important contributions from Heidegger (with the notion of being-in-the-world ( ) ), Merleau-Ponty (through the study of perception and embodiment ( ) ), and Habermas (in the theory of communicative action ( ) ), among several other sources. Dealing with the philosophical complexities of the concept would certainly surpass our current scope. Thus, our focus is rather placed on the much more circumscribed sphere of social psychology.

A conceptual distinction in social cognition research has been established to define the sort of access a person uses in understanding another person. According to Fuchs ( ) , from an experiential level of analysis, the access possibilities to oneself and others conform the triad: first (1PP), second (2PP), and third (3PP) person perspective. Hence, subjective experiences are accessible from 1PP, co-experiences or intersubjective experiences (reciprocal interaction, forms of mutual relatedness) are accessible from 2PP, and one-way, vicarious, or remote observations are accessible from 3PP. An intense debate has been established among theorists concerning the experiential level of analysis from which studying intersubjectivity. This is reviewed next in order to delimit the theoretical scope of this work.

Several authors (e.g. Gallagher ( ) , Fuchs ( ) , Newen ( ) ) have pointed out that studies in social cognition have traditionally explained how individuals understand and interrelate with each other from the perspective of theory of mind. Notably, under the approaches of theory theory (TT) and simulation theory (ST). In essence, from a 3PP experiential level of analysis, TT theorists investigate intersubjective relations as specialized cognitive abilities for explaining and predicting behavior, based on the employment of folk psychological theories about how behavior is informed by mental states (e.g. Premack & Woodruff ( ) , Welman ( ) , Gopnik & Schulz ( ) , Leslie ( ) ). ST theorists study intersubjectivity from a 1PP experiential level of analysis, as how mental experience becomes an internal model for understating the other’s mind, so thoughts or feelings of the other person are simulated as the subject would be in the other’s situation (e.g. Gallese & Goldman ( ) , Rizzolatti & Fogassi ( ) , Davies & Stone ( ) , Goldman ( ) ).

Developmental psychology research has challenged theory of mind accounts of social cognition, and described primary and secondary intersubjectivity stages of development (Gallagher ( ) , Spaulding ( ) ). Thus, primary intersubjectivity, originally described by Trevarthen ( ) , consists in a voluntary interpersonal communication process characterized by intentionality and adaptation, which is founded in innate, embodied, pre-theoretical, non-conceptual fundamental capacities for self-expression and understanding others (e.g. facial gesticulation; proprioceptive sensation, automatic attunement, detection of intentional behavior, eyes motion tracking, noticing emotions in gestural intonation and expression, among others). Secondary intersubjectivity is theorized to be constituted later, transcending the face-to-face sort of interactions to a context of shared attention, mediated by communication about objects and events in the environment. Conforming to Rochat & Passos-Ferreira ( ) , the stage of tertiary intersubjectivity is characterized by processes of negotiation with others about the values of objects, from shared and self representations. Our work is interested in studying social interaction, as characterised by primary intersubjectivity.

Interdisciplinary efforts from developmental psychology, phenomenology, and philosophy of mind, have constituted, in the last decades, a diverse field of research that investigate four central features of cognition. Thus, according to Newen et al. ( ) , 4E cognition is considered to be embodied, embedded, extended, and enactive. Theorist in 4E cognition research cognitive phenomena as dependent on the body characteristics (on its physiology, biology, and morphology), on the particular structure of the environment (e.g. natural, technological, social), and on the active embodied interaction of the agent with the environment.

When considering the study of 4E properties of social cognition, the critical movement against theory of mind approaches was very much influenced by the proposal of interaction theory (IT, Gallagher ( ) , also named embodied social cognition Gallagher ( ) ). For IT, experiencing the feelings and intentions of another person is mostly accounted for by a 2PP access to immediate perception of embodied interaction with others, which constitutes a simpler, non-mentalistic, on-line capacity. Hence, mind-reading skills (as studied in TT and ST) consists in specialized forms of intellectual activity less regularly used when basic embodied processes fail to account for a given situation. Although IT is not an uniform theoretical field, according to Newel ( ) theorist share the two following ideas: a) understanding others does not involve observing others on the regular basis, but interacting with them, and b) the experiential access in understanding through interaction is immediate or direct perception. We study primary intersubjectivity in the context of IT.

When analysing differences between IT theorists, it is fundamental to observe the peculiarities or sort of interaction that constitute a particular research scope. For enactivist theorists (e.g. De Jaegher & Di Paolo ( ) ), social interaction is characterized by coupling, which maintains an identity in the relational domain, and by individual autonomy. An example would be walking in the opposite direction in a narrow corridor, where individuals are attempting to stop interacting but the interaction self-sustains notwithstanding their will. Conforming to Reddy ( ) , it is not the structure of the situation that determines a 2PP level access experience in the interaction, but the fact of mutual acknowledgment, emotional involvement, or engagement (e.g. sharing a smile, attraction, interest, surprise).

Our research scope is concerned with engaged interactions as described by Reddy. A distinguishable aspect of our work is the interest in direct interaction experiences characterized by intention and purpose. That is, along with possessing means for adaptation or fitness to other’s actions, individuals are also capable of employing volitional resources to express their intention. Consequently, dynamic control is shared within the dyad. We believe that this sort of exchange is possible when both agents are capable of, among several skills, processing feedback and formulating proactive expectations on how the situation would look like while enacting in the dyad (Tani ( ) ).

In the study of intersubjectivity, IT theorists have disagreed on the importance of knowledge representation and prediction. Conforming to Schlicht ( ) , some theorists have radically departed in a non-representational approach and studied emergent interaction from dynamic system theory, whereas moderate theorists have retained mental representation in theorizing social cognition. Examples of the former are studies of minimalistic interaction (Auvray et al. ( ) , Froese & Ziemke ( ) , Lenay & Stewart ( ) , Froese et al. ( ) ). Concerning moderate views, according to Gallagher & Allen ( ) , some interpretations of the general framework of the predictive model are consistent with methodological individualism (e.g. Hohwy ( ) ), whereas others are consistent with autopoietic enactivist theories (e.g. Kirchhoff ( ) ( ) ). Notably, free energy principle (FEP) theory (Friston ( ) ).

This work investigates primary intersubjectivity from the perspective of FEP theory, within the scope of 4E social cognition. In agreement with Allen & Friston ( ) , we study FEP theory as a synthetic account to explain the constitutive coupling of the brain to the body and the environment. Thus, internal representation and prediction, in the generative sense, are considered to emerge from the organismic autopoietic 1 1 footnote 1 Understood as the persistence of self-organization of an organism given its characteristic dynamical structure, while interacting with the environment. self-organization. Given the assumption of ergodic 2 2 footnote 2 Ergodicity implies that the average probability of a system being in a given state is equivalent to the probability of being in such state when observed randomly. dynamical interchange between the agent and the environment, we investigate perception, cognition, and action as explained by an enactive hermeneutic circle taking place in dyadic encounters (Gallagher & Allen ( ) ). For this, we study interaction as a process where deliberative control and automatic adjustment coexist.

A final aspect to discuss, when deconstructing the title semantics, is the meaning of the term hybrid. It accounts for the study of social interaction between two partners distinct in nature. In this sense, an important issue investigated in human-robot interaction has been human engagement, where the uncanny valley effect (i.e. emotional response in subjects from perceived human resemblance of synthetic objects, Mathur & Reichling ( ) ) has been reported. Differently from this line of research, we focus on the inclusion of robots as they are to study interaction, and not on how the robot could substitute the human partner. As elaborated in the next sections, we propose a methodology to model artificial agents for social interaction. Through the presentation of a case study experiment, we discuss some perspectives for the research in human science.

Free energy principle theory was initially proposed as a unifying framework in brain science (Friston ( ) ). More recently, the theory has been extended and related to the fields of theoretical biology, statistical thermodynamics, and information theory (Friston. ( ) ). A core assumption in FEP theory is that living organisms are driven by the tendency to resist the second law of thermodynamics, so to maintain their internal structure or dynamics in a constantly changing environment.

Conforming to Allen & Friston ( ) , from this fundamental drive for existence, biological system are characterized by the following properties: ergodicity (an organism occupies or revisits some characteristic states more than others over time in order to live), Markov blanket (a mathematical description of the boundaries between the organism and the environment, such description is undertaken at multiple levels of analysis), active inference (perception and action are locked in a circular causality relation), and autopoiesis (emergent and self-organized maintenance of organismic dynamic structure while interacting with the environment).

FEP theory consists in a predictive account of the mind. It considers that an agent proactively anticipates sensation from empirical priors (in a generative sense), and minimizes free energy as a measure (an upper bound) of surprise. As a consequence, the internal state of the agent is maintained within characteristic or habituated regions. Thus, less/more sensory surprise means lower/higher free energy, with more/less likelihood of internal dynamics unfolding in a given region.

Generally, free energy is considered to be minimized in two fundamental ways: through predictive coding, for vicarious perception, and through active inference, for goal directed action (Friston et al. ( ) ). In predictive coding, surprise is minimized in a bottom-up pathway, so the internal state is modified to generate more consistent predictions with respect to sensory evidence. This principle has been explored in theory of mind studies of social cognition (e.g. Van de Cruys et al. ( ) , Kilner et al. ( ) , Koster-Hale & Saxe ( ) ). Differently, in active inference sensory predictions are attempted to be fulfilled in a top-down pathway, by taking purposeful actions in the environment (Friston et al. ( ) ).

Regardless of the way surprise is minimized, in FEP theory it is assumed that sensation prediction is accompanied with an estimate of precision. Hence, surprise is considered to be minimized in relation to (divided by) precision, which means that free energy is minimized more when associated with a high precision estimate (i.e. a strong belief). A practical implication of the previous statement is that an agent with strong belief tends to act egocentrically to the environment without changing its internal state or intention, whereas an agent with weak belief tends to act adaptively to the environment, by easily changing its internal state or intention.

This work focuses on the study of enactivist social cognition based on active inference. As pointed out by Friston et al. ( ) , in active inference no distinction is established in terms of sensory or motor representations, since motor control signals are considered to be directly generated by proprioceptive predictions, so the individual perceives relevant action affordances in the interaction context. This is going to be discussed in more details when considering the matter of perception as a direct experience. In the appendix sections, active inference is described within the scope of our case study, which includes the PV-RNN framework. The minimization of free energy is equivalent to the maximization of the sensory evidence lower bound (ELBO), which is discussed in the next question.

The ELBO is a quantity introduced in the variational Bayesian (VB) optimization literature. In FEP theory, this quantity corresponds to the summation of two terms, namely the accuracy term, representing the prediction error, or surprise; and the complexity term, representing the complexity of the internal representation. Mathematically, accuracy is the expected logarithm likelihood of the model with respect to the approximated posterior distributions, and complexity is the Kullback-Leibler divergence (KL divergence) between the approximated posterior and the prior hidden distributions. Therefore, by definition $\le ELBO0$ is an upper limit for the logarithm of the marginal likelihood in the anticipation of the sensory state by the generative process (see the mathematical details in the Appendix section). For human-robot interaction experiments it is perhaps more intuitive to relate surprise to the negative evidence lower bound (N-ELBO), since increases in N-ELBO correlate with situations where mismatch increases between the anticipation and actual sensation.

In the study of perception-action, two schools have contrasted, namely, the contructivist and the ecological theory of perception. These theories have developed over several years. Here, only their basic characterization is presented. Thus, constructivist theorists are very much influenced by Helmholtz’s notion of unconscious conclusion (Helmholtz ( ) ). It is generally assumed that stimulation reaching the sensory apparatus is not sufficient for perception, so intermediate processes (e.g. memory, perceptive schemes, previous experience) intervene between sensation and perception, which characterizes an inferential and indirect process. Contrarily, the ecological school, under the influence of Gibson’s studies of visual perception (Gibson ( ) ), consider that information available in the ambient suffices, since what is perceived are changes over time and space (an information flow). Accordingly, individuals perceive affordances (i.e. functional utilities with respect to themselves and their action capabilities) of objects or the environment. Consequently, perception is studied under the ecological school as a direct or immediate process.

Constructivist theories of perception have been associated with cognitivism, when attributing a predominant role to the brain in the top-down information processing of sensory data (e.g. Gregory ( ) ), which largely neglects the richness of information available at the sensory level. However, although neurophysiological, neuropsychological, and psychophysical scientific evidence has supported the coexistence of constructivist and ecological perceptive processes in the brain (Norman ( ) ), according to De Wit & Withagen ( ) , ecological psychologists have been criticized for ignoring the brain in their theoretical formulations.

More recently, Linson et al. ( ) have argued that when replacing traditional inferential explanations, based on the notion of passive input, with the notion of active input, ecological theorists still maintain an input-output account of perception. According to the authors, active inference is characterized in FEP theory as direct engagement (in the thermodynamic sense) between the agent’s sensory system and the environment. Thus, sensation is considered to be anticipated from a generative process, which does not constitute an inferential process in the input-output sense. As pointed out by Bruineberg & Rietveld ( ) , perception and action from anticipatory dynamics and free-energy minimization ensure the agent with the capability of maintaining adaptive sensibility to relevant affordances in a given context. This would not be about reconstructing the structural hidden causes of the environment.

This debate has been certainly inspiring for artificial intelligence and robotics research. It could be relevant bringing up to discussion influential works by Brooks in behavioral robotics (e.g. Brooks ( ) ( ) ). The field was also influenced by Braitenberg ( ) . In behavior robotic agents, sensory input has been directly mapped to motor output. This idea would arguably conform to principles of the ecological theory of perception (Tani ( ) ). Although interesting behavior can result from minimal control schemes, this sort of robots are only capable of reacting to the environment. Lacking of intention, they behave in stereotyped ways and exhibit low capacity of generalization, even to slightly different situations.

In the approach adopted in our research, robots are capable of active inference, so they perceive action affordances directly as a vector flow in the perceptual space (i.e. no distinction is established in terms of sensory or motor representations). Hence, such neural robots try to fulfill their intention in the interaction by directly performing afforded actions making sense in a given context. Next, we propose a methodological resource for designing these sort of neural agents for conducting human-robot interaction experiments.

Agent modeling starts by the selection of the network features. The PV-RNN parameters shape important qualities such as compliance in the deliberation style of the agent. Unfortunately, the selection of parameters cannot be done analytically, so the method of trial-and-error should be employed. Table provides a qualitative description of the role of the parameters and some hints on their selection. An important aspect to consider is that computational complexity is conditioned to the number of intermediate layers and the amount of neurons within layers. Therefore, it is recommended to start by profiling a reduced structure and gradually increasing its complexity until it is able to handle the task. This iterative process is represented in Fig. as the cyclic flow labeled improvements. For reference, the models included for demonstration in VCBot comprise two layers: the Low layer is composed of 40 d units, 4 z units, and the time constant set to 2; whereas the High layer is composed of 10 d units, 1 z unit, and the time constant set to 10.

The objective of constituting training sets is to capture fundamental behavior on the robot side for studying during interaction. Thus, depending on the theoretical aspect under consideration, such basic skills could be assumed to be either innate to the agent, or acquired through developmental sensory-motor processes (e.g. through motor babbling, imitation).

A convenient method used for registering behavior primitives is kinesthetic demonstration, where the human directly moves the robot body to show the behaviors. For the case study, a two-dimension motion primitive set was constituted, inspired by the body shape of a macaw cub (perhaps on the species ara ararauna). A total number of seven primitives were included, registered at 100 millisecond sampling period, during 72 time steps, conforming limit cycles in a clockwise sense. These trajectories represented distinct anatomic regions of the bird (i.e. the left eye, the head, the beak, the neck, the right wing, the belly, and the left wing). Only individual primitives were included in the dataset, so the robot did not learn how to relate one primitive to another. Hence, an important aspect to observe is whether possible relations between previous knowledge emerge during interaction.

The model was trained during 50,000 epochs (see Fig. ), following the Adam method for stochastic optimization (Kingma & Ba ( ) ). As noticed on the top row, the network optimized faster the reconstruction error (the accuracy component of the ELBO) related to the posterior distribution, and gradually improved the results for the prior distribution, which can be noticed in the way the signal corresponding to the regulation error (at the bottom-left) decreases. This means a gradual increase of complexity in the model, since the prior and the posterior distributions are becoming more similar. Thus, as seen in the plot on the bottom-right, the negative ELBO is minimized over the training epochs.

After training, the primitives were generated from the prior distribution to evaluate the quality of behavior achieved. As seen at the top of Fig. , the generation process could reproduce in overall the body shape of the macaw cub, as compared with the training set trajectory shown in watermark color in Fig. . For observing the internal representation self-organized by the network, two principal component analysis (PCA) from the activity of d units at the High layer (slowest dynamics) were plotted at the bottom of the figure. An important aspect to be noticed is the connectivity between regions in the internal representation. Hence, some primitives are represented inter-connected whereas others are not. The absence of connectivity should imply higher difficulty in switching between those attractor regions, this is going to be discussed in more details when analyzing the interaction results. It is also important noticing that although there may be overlap in the regions, the flow of activity could be in the opposite sense. Since all the primitives were captured clockwise, their internal representation also preserved those spatial-temporal relations.

The goal of the human-robot interaction experiment was to observe mutual interaction and influence between the partners. For this, the human was instructed to reproduce with the robot the body part of the macaw cub. In the experiment it is not important that all primitives are covered, but how mutual interaction in both directions could develop. Thus, the robot was set to start generating one of the primitives, and the human was instructed to try for each primitive by turn to cover the behavior repertory as much as possible, within a given time. The human was also instructed to proceed at will, so no predetermined order was recommended in trying to accomplish the primitives. After the experiment, the human was requested to verbally report on the primitives attempted with the robot.

A simple proportional controller was designed to endorse the robot with the capacity of enacting deliberation and adjustment (motor compliance) in relation to the human’s actions (see Fig. ). Thus, the position of the robot’s end-effector emerging from the interaction was determined from the linear interpolation of the human and the robot desired actions, such that $=position-\gamma human(-1\gamma )robot$. For the study case $=\gamma 0.9$, which means the human exerted much more influence over the position of the end-effector than the robot did. In order to avoid brusque changes in the motion trajectory, the position rate of change was saturated by a constant factor.

In the experiment, the human interacted with VCBot during approximately 6 minutes and 20 seconds. Data was captured during 2,000 time steps, at every 100 milliseconds. The human desired actions were registered as the coordinates of the mouse cursor. In VCBot the human chooses when to enable interaction by pressing and holding the control key from the computer keyboard while moving the mouse. Therefore, both the position of the mouse cursor and the key press event were recorded. The robot desired actions were generated by the neural network. The negative ELBO was also recorded as a measure for real-time minimization of free energy. Several repetitions of the experiment were performed, Fig. shows the time evolution of data captured for the most interesting trial. A total of eight human intervention events were produced during the experiment. Table presents the human self-reported intention on the events. These results are analyzed next.

A quantitative measure of intentionality congruence is proposed based on an automatic regression observer. The objective is classifying the robot and the human intention from the observer’s evaluation, which receives as input the intended behavior signal, buffered in a limited temporal window, and outputs the attribution of the signal to a behavior category (i.e. a represented body part of the macaw cub). This problem is analogous to some extent to the comparison of time series for speech recognition (e.g. Sakoe & Chiba ( ) ). Thus, two conditions are assumed in the comparison: a) patterns are time-sampled with a common and constant sampling period, and b) there is no a priori knowledge about which parts of the patterns contain important information.

The automatic regression observer designed corresponded to a feed-forward model with the following layered structure: 10 input units (2 degrees of freedom x 5 time steps buffer window), 150 units in the first hidden layer, 100 units in the second hidden layer, 7 output units (representing the macaw cub body parts categories). The hyperbolic tangent activation function was selected for the hidden layers, and the sigmoid activation was selected for the output layer.

For constituting the training set, the PV-RNN model generated during 200 time steps each behavior primitive from the prior distribution. Since the initial position was the same for all generations (the center of the workspace), the first 20 generation steps were discarded, in order to ensure the effector position entered the limit cycle attractor of each primitive, consequently, the training sequences had 180 time steps.

The test set was constituted with data captured from the human. The subject was instructed to manipulate the mouse to generate in VCBot the primitives, provided a visual guide on the dataset (data was plotted in watermark color in the workspace). The confusion matrix is presented in Table . As noticed, classifications were reasonably accurate for the test set.

Figure presents the automatic regression observer’s performance for the experimental data. A first aspect to be noticed is that classification for the human intention is available only during the events illustrated in Fig. and self-reported in Table , whereas data is available from the robot throughout the whole experiment (except for the first 5 time steps, given the size of the temporal buffer window). Although the interaction was subject to stochasticity from the human motions and possible incongruence between the human and the robot intentions, temporally correlated classifications for the human actions are observed around a main category and adjacent neighbors, which suggests the human likely focused on particular parts of the bird’s body during the interaction events.

In order to estimate the probability of intention congruence for an interaction episode $i$, the binomial variable $\in ct[0,1]$ is defined from the human $\psi human$ and the robot $\psi robot$ intended actions in the time interval $[-sti,ti]$, so that

The probability of intentional congruence for the event $i$ at time $t$ is defined such that

Figure presents the time evolution of the probability of intention congruence, grouped by interaction events. As noticed, for some events congruence was observed earlier in the interaction (e.g. the events 1,3,6,7), so the human was perhaps not too sensitive to feedback from the robot and persisted longer than required to induce intention switching. On the other hand, in the $5th$ event, although the probability of intention congruence was not very high by end of the event (it was estimated to be 0.5), once the human ceased to intervene around the time step 1200 (see Fig ), it is clear that the robot switched to the human-self reported intention (see Table ), so the human was perhaps more sensitive to feedback from the robot in this event. Finally, the events 4 and 8 were mostly characterized by intention incongruence.

The introduction section has contextualized our research interests in the domain of enactivist social cognition. Notably, in the study of primary intersubjectivity. Thus, we have been inspired by Trevarthen’s influential work where maternal-infant interactions were recorded and analyzed (Trevarthen ( ) ). The work constituted a fundamental criticism to theory of a mind accounts of social cognition. It described intuitive communication in dyadic interactions as a shared control situation, where individuals reciprocally influence each other.

Although interaction theories of social cognition are not consensual, there is a shared interest in studying dyadic interaction as a second person perspective level of experience, which corresponds to forms of mutual relatedness, co-experiencing or intersubjective experiencing through reciprocal interaction. Our research is consistent with such agenda. Hence, as shown in the case study experiment, the considered scenario is characterized by direct interaction, where the human modified the body posture of the virtual robot and received visual feedback on the robot’s motion. Hence, the human tried to communicate with the robot through corporal patterns or gestures. We have shown in related studies with real robots (Chame & Tani ( ) ) that this relation can be studied both ways in the physical dimension, so the human and the robot are able to modify each other’s body posture.

We have described interaction enactment as the agent’s capability of taking deliberative action while conforming or adjusting to the actions induced by the partner. Consequently, behavior emerges only partly under the volitional control of the agent. We have proposed to study such dynamics from an interpretation of FEP theory which is consistent with autopoietic enactivist social cognition. Consequently, we investigate perception, cognition, and action as explained by an hermeneutic circle in dyadic encounters.

Given the context where IT emerged (i.e. opposing a cognitivist view of social cognition), assumptions based on knowledge representation and inference have been criticized when studying primary intersubjectivity. This is pointed out by Reddy ( ) when analyzing assumptions about the nature and availability of mind that views early human communication as a process where the infant infers other’s hidden mental states. Grounded in FEP theory, our work does not study primary intersubjectivity as a theory of mind skill. We have argued that internal representation and prediction are considered in the generative sense, from the organismic autopoietic self-organization. As pointed out by Bruineberg & Rietveld ( ) , perception and action from anticipatory dynamics and free-energy minimization ensure the agent with the capability of maintaining adaptive sensibility to relevant affordances in a given context, which would not be about reconstructing the structural hidden causes of the other’s mind. Hence, the agent perceives action affordances characterized by intention, and tries to fulfill them to make sense in the interaction by taking motor action.

When analysing Fig. , it is possible to notice that occasionally the human and the robot intentions were easily synchronized (e.g. in the events 1, 6, and 7 their intentions became similar early in the interaction interval). Other times, the human persisted for a while before human-to-robot alternations could take place (e.g. in the events 2, 3 and 5 the robot changed its intention according to the human’s intentions). Finally, at times the human had to adapt to the robot’s intentions, so robot-to-human alternations were produced (e.g. the events 4 and 8). These results present some similarities with respect to situations described in mother-infant interactions (Trevarthen ( ) ). We believe that, through the design of human robot experiments of this sort, it is possible to study diverse aspects of social cognition, such as the emergence of consensus in intuitive non-verbal communication. As it was explained in the methodological description, the robot was not trained to learn how to shift from the generation of one behavior to another. Such changes resulted from the human actions on its body, and from its capacity of perceiving action affordances that make sense in the context of interaction.

Perhaps an interesting direction of research would also be studying the developmental aspect of human primary intersubjectivity skills in human-robot interaction with subjective robots. As pointed out by Torres et al. ( ) , studying interaction is certainly subject to considerable methodological difficulties, so behavior measures of physical movements are rarely included. We believe that behavior measures could be complemented with the inclusion of the subjective dimension of the robot partner, so building more informed psychometric observations on real-time interaction skills. This can be a relevant perspective for developmental psychology, since most psychometric instruments evaluate interaction with static objects.

Through the proposal of NRL, our work with neural agents has described in detail the dynamics of action deliberation. It could be argued that our proposal could have invested some efforts in detailing the dynamics of action compliance. This aspect was left out of scope mainly due to the fact that robotic platforms are diverse. Furthermore, commonly affordable robots are designed under classical engineering modeling approach, including conventional control schemes and architectures. Since real-time responsiveness is a fundamental aspect, it is somehow problematic proposing a control model that would run over a virtual abstraction of the host native platform. Hopefully, in the near future more bio-inspired robotic structures, capable of evolving in the phylogenetic sense, would be available for most research labs.

A final aspect to be discussed is that developmental psychology studies in mother-infant interaction have reported early behavior patterns as rudimentary, much distinct from the stylized motions proposed in the case study outlining the body shape of a macaw cub, which the artificial neural model learned. Although it is possible to model rudimentary behavior in neural agents, the inclusion of an artistic scenario is perhaps more related to research perspectives on other fields in human science, which is discussed below.

According to Ackermann ( ) , societal convictions on the meanings of being knowledgeable or intelligent, and what it takes to become so, drive attitudes and practices in education. Hence, several theories of learning (e.g. behaviorism, cognitivism, constructivism, connectivism, constructionism) have reflected those convictions, and have been central to the contributions of theorists in education (e.g. Bloom ( ) , Freire ( ) , Siemens ( ) ).

In education theory, we contextualize our work within the view of constructionism, which consists in a philosophy of learning through building artifacts in the world that reflect one’s ideas. Undoubtedly, a key influential initiative in approaching technology to education took place in the late sixties, and consisted in the invention of the LOGO programming language in the Massachusetts Institute of Technology (Papert ( ) ). The idea was to include computers in education processes, so that children learn to communicate with computers through a mathematical-logical language, in order to build their own tools and mediations to support their interest within a given context.

Constructionism has transcended the virtual world to ground the prototyping of physical agents through the Lego Mindstorm technology (Martin et al. ( ) ). This platform has been extensively used in the international educational robotics competition RoboCup, notably, in the Junior league 5 5 footnote 5 https://www.robocup.org, which is dedicated to young scientists mostly enrolled in secondary high-school. The Mindstorm technology has stimulated an explosion of other proposals in assemblage robotics kits.

Interesting questions are raised once new technologies are incorporated into education, in particular, inquiring the actual benefits those technologies provide to distinct academic outcomes. Thus, the aspect of how educational robotics generalizes to areas which are not closely related to the field of robotics itself has been reviewed by Benitti ( ) . The review found that most of the studies (around 80%) explored physics, logic, and mathematics related topics, which may suggest a low capacity of absorption to other fields. Moreover, in the light of the increasing availability of machine learning technology (e.g. software libraries, and computational gadgets), one might question the extent to which the complexity of such technology is actually realized by the children. So in practice sophisticated automation prototypes are not simply the result of putting together a set of components which are not really understood by the student (i.e. at the modest cognitive cost of connecting black-box modules).

Our research tries to face the above criticism inspired by efforts in describing the development of cognition and action from a dynamic system theory perspective (e.g. in Thelen & Smith ( ) ). Hence, by focusing not only in observing how a given behavior is manifested, but on describing it as a pattern of change over time, and how such change can result from the interaction of multiple subsystems within the individual, the task, and the environment; we hope to be contributing to a reflection on phenomenon which transcends a linear logical causality understanding, to an hermeneutical description of causality that takes place with the self immersion in a feedback loop, so bringing to the foreground the notions of time, intention, stochasticity, and interaction, to a regularly perceived static world.

Perhaps the view of a non-interactive world is still deeply rooted in our society. Arts has provided us with a criticism on the static world view, though forms of expressions such as the abstract expressionist movement. Hence, the painting technique known as action painting (Rosenberg ( ) ) reflects the physical act of painting itself, so the work is more the unfolding of an event that a picture. Here, artists employ the forces and momentum generated by their body to paint (an influential exponent in this current is Jackson Pollock, some of his works are Mural and Lucifer).

Returning to constructionism, we believe the modeling of subjective robots, with which communication takes place through negotiation in shared behavior control, would enrich and extend the interaction scenario envisaged by Papert’s seminal ideas. Hence, by keeping in mind the principles of roboethics (Tzafestas ( ) ), robots could be conceived as systems capable of intention. We hope this sort of synthetic agent would become relevant to other fields of knowledge, beyond educational technology, an example is rehabilitation learning which is discussed next.

According to Sohlberg & Mateer ( ) , the term cognitive rehabilitation follows short when focusing on the aspect of remediation or compensation for decreased cognitive abilities, so the term rehabilitation of individuals with cognitive impairment would emphasize more precisely injured individuals (i.e. acquired brain injury, and traumatic brain injury) that are and will continue to be the target of cognitive rehabilitation. In this sense, although a fundamental goal for treatment is improving and compensating cognitive abilities, a larger scope including consequences for the personal, emotional, motivational, and social dimensions of the brain injury, has been incorporated into treatment plans.

Several evidence-based reviews have been conducted with post-stroke cognitive rehabilitation treatment for specific cognitive impairments, and concluded that although there are some evidence in support, the effectiveness of treatments has yet to be established (e.g. memory deficits in das Nair ( ) , executive dysfunction in Chung et al. ( ) , and attention deficits in Loetscher et al. ( ) ). Recently, a work by Maier et al. ( ) has proposed virtual reality as a methodology for designing a rehabilitation program in several cognitive domains conjointly, as an alternative to treating cognitive domains in isolation. Along this line, we believe an interesting perspective to follow consists in exploring rehabilitation tasks based on shared control. Our results with VCBot have illustrated the methodological possibility of such integration.

Regarding real robots, the study of Gassert & Dietz ( ) , proposes a classification for robotic rehabilitation platforms into: grounded exoskeletons, grounded end-effector devices, and wearable exoskeletons. These devices are torque-controlled which allows designing diverse interaction tasks involving passive, active-assisted, and active-resisted movements, depending on the treatment goals and the patient’s level of impairment. As discussed in Chame & Tani ( ) , when considering simultaneous deliberation and adjustment, it is also possible to profile interaction styles from the robot’s capacity of taking purposeful actions, while accommodating to the human’s intentions. These characteristics could enrich the availability of task repertories. In this way, neural cognitive control could become an interesting resource for rehabilitation treatments.

A study by Goršič et al. ( ) has explored the benefits of treatments based on interaction, and suggested that playing competitive games with a non-impaired partner has the potential of leading to functional improvement, when compared to conventional exercising, through an increase in motivation and exercising intensity. The study found a less pronounced effect in cooperative games but a positive effect on motivation. Although it is likely that the presence of a human partner plays a role in motivation, in the study it is reported that some subjects preferred to exercise alone. Perhaps a promising line of research would be exploring whether the fact of intersubjective interaction with a robotic partner would lead to higher life quality of subjects, notably, for participants that opted for not interacting with human partners.

Diverse additional studies could be discussed for analysing possible ways neural robotics, capable of active inference, could play a role in rehabilitation. By linking this section with the previous one, we would like to argue the relevance of constructionism as potentially contributing to intrinsically motivated engagement of patients in planning, designing tools, and selecting goals. The treatment could also benefit from observing patient’s motivation dynamics (e.g. Chame et al. ( ) ), so a conjoint planning of the treatment between the patient and the therapist is done.