We present a computational model of the mechanisms that may determine infants’ behavior in the ”mobile paradigm”. This paradigm has been used in developmental psychology to explore how infants learn the sensory effects of their actions. In this paradigm, a mobile (an articulated and movable object hanging above an infant’s crib) is connected to one of the infant’s limbs, prompting the infant to preferentially move that ”connected” limb. This ability to detect a ”sensorimotor contingency” is considered to be a foundational cognitive ability in development. To understand how infants learn sensorimotor contingencies, we built a model that attempts to replicate infant behavior. Our model incorporates a neural network, action-outcome prediction, exploration, motor noise, preferred activity level, and biologically-inspired motor control. We find that simulations with our model replicate the classic findings in the literature showing preferential movement of the connected limb. An interesting observation is that the model sometimes exhibits a burst of movement after the mobile is disconnected, casting light on a similar occasional finding in infants. In addition to these general findings, the simulations also replicate data from two recent more detailed studies using a connection with the mobile that was either gradual or all-or-none. A series of ablation studies further shows that the inclusion of mechanisms of action-outcome prediction, exploration, motor noise, and biologically-inspired motor control was essential for the model to correctly replicate infant behavior. This suggests that these components are also involved in infants’ sensorimotor learning.
For a developing infant, detecting the effect of its own actions on its sensory input (i.e. detecting “sensorimotor contingencies”) is presumably a core mechanism by which the infant first learns how to distinguish its body from its environment, and then learns how to control the body and use it to grasp and manipulate external objects (for reviews, see [
In the literature on infant development, a variety of paradigms have been used to study detection of sensorimotor contingencies, using different types of actions on the part of the infant (limb movements, head movements, facial expressions, vocalizations) and different types of sensory consequences (sounds, voices, visual stimulation, including human or schematic faces).
In what follows, we present the key findings from mobile paradigm studies focused on sensorimotor contingency detection and learning. We then provide a brief overview of previous models that address target infant behavior and highlight the main advances and novel aspects of our model.
One of the most frequently used methods to study the detection of sensorimotor contingencies has been the “mobile paradigm” introduced in the late 1960’s by Rovee & Rovee [
Early studies demonstrated that infants from at least 2 months onward can rapidly detect the contingency between their actions and the mobile (e.g. [
Recently several studies have gone back to more carefully reviewing the literature and re-investigating the basic contingency detection phenomenon itself to confirm the exact conditions and time-course of the infant’s reaction to the establishment of a contingency [
In addition to these two main empirical results, there are two interesting but less reliable findings, which we will consider in this paper.
Surprisingly, despite the substantial literature and the importance of contingency detection as a mechanism underlying infant development, there have been few attempts to model the findings observed in the mobile paradigm, either mathematically or by computer simulation.
An exception was the work of John S. Watson and his collaborators Butko & Movellan [
Two other attempts to explicitly model behavior in the mobile paradigm have also appeared recently.
Zaadnoordijk et al.’s [
Kelso & Fuchs [
The purpose of the present paper is to propose a first attempt at a detailed computational model, shown in Fig. , of the mobile paradigm that addresses the main two empirical findings observed in infants at age 6 months: the increase in activity specific to the ”connected” limb, and a significant effect for a contingent group but not for a control group with random stimulation. Additionally, we examine how the model might simulate the controversial phenomenon of the extinction burst and the difference between binary (non-conjugate) and non-binary (conjugate) stimulation.
In our model, there were two important constraints that we wanted to adhere to. The first constraint was the fact that contrary to Zaadnordijk et al. [
The second constraint on our model was to include a motor system that was biologically more realistic than that used by Zaadnordijk et al. [
To train the neural net, our model optimizes its functioning by minimizing three differences (referred to as
We shall see below that our model broadly reproduces infants’ behavior. It quickly learns to differentiate and selectively increase the activity in the connected limb as compared to the unconnected limbs. The model also reproduces the control experiments showing that mere activity of the mobile does not suffice to produce increased limb activity: a proper contingency must exist between the infant’s movements and the activation of the mobile. Our simulations also predict better contingency detection in the binary versus the conjugate condition, and provide insights into the controversial extinction burst.
In addition to these main results, we perform several “ablation” studies, where we observe how the model performs when its main components are selectively removed. These studies demonstrate that most of the components of the model are necessary ingredients: numerous muscles, motor noise, and the exploration mechanism attempting to minimize prediction error.
In this section, we describe how, in our model, we simulate the infant body, the environment, and the learning mechanisms. For this purpose, we start by introducing background information about the infant body and motor control. Then we describe the simulated mobile paradigm. Finally, we detail how we modeled infant learning and how our simulations match the number of participants and durations in infant studies [
Human motor control is highly complex and involves the interplay of a hierarchy of neural connections—cortical, subcortical and spinal—and a complex structure involving approximately 600 skeletal muscles [
Copying the entirety of the human motor control would have increased the complexity of our model beyond our current scope. Instead, we simplify the elements used in human motor control and abstract the entire chain by using 600 ”muscle commands”. In the model these 600 muscle commands are transmitted via 600 output neurons of the neural network. The muscle commands are mapped by a function M to the four limbs of our simulated agent. This mapping works in an overlapping fashion across the limbs—a single command can have an effect on several limbs and limbs are controlled by multiple muscle commands.
Also in order to simplify, we used a single scalar value between 0 and 1 as a proxy for each limb’s activity. This general definition of ’limb activity’ allows us to make the link with data in the experimental literature where various measures of limb activity were used, for example, the frequency of kicks in Rovee & Rovee [
In a typical mobile paradigm experiment with infants, a limb movement may produce a sound or a visual change from the mobile. To model this, we represent the sensory feedback received by the model as a single value: either 0 or 1 in the binary condition, and a number between 0 and 1 in the non-binary (conjugate) condition (see next paragraph). For simplicity in our simulation, we excluded all sources of sensory input to the agent except the mobile.
As in the mobile paradigm, we assumed that only one of the four limbs of the agent was ”connected” to the mobile. For comparison with the empirical work of Popescu et al.[
For the binary relation, when the activity of the connected limb exceeded a threshold, the mobile was activated for two iterations of the simulation. For compatibility with Popescu et al. [
For the conjugate (or non-binary) relation, the intensity of the sensory feedback emitted by the mobile was directly proportional to the value of the connected limb activity.
After the contingent phase of the experiment where the mobile response was present, we simulated the extinction phase included in some empirical work (e.g. [
As shown in Fig. , our learning mechanism consists of four modules: the neural network, a sensory prediction module, an exploration module, and a deviation from baseline module. Its purpose is to control the system’s behavior over successive time steps in order to take actions and make predictions about the sensory effect that it expects from those actions. On the one hand, the mechanism tries to continuously improve the predictions of the sensory feedback, therefore reducing the amount of surprise it experiences. On the other hand, it intentionally chooses actions that are likely to result in novel experiences, in this way making surprises more likely. The result of these two opposing forces is to make the model undertake a continuous non-random exploratory activity, seeking out the most surprising actions it can perform.
At each step of a simulation, the neural network takes the previous state of the system as its input and generates both new limb activities and a prediction for the sensory input that the network expects to receive. The previous state is represented by four neurons with activations between 0 and 1 corresponding to the activity of each of the four limbs and a fifth neuron with activation between 0 and 1 corresponding to the sensory feedback received from the environment. The five input neurons are fully connected via learnable weights to 8 hidden neurons, which are in turn fully connected via learnable weights to 601 output neurons (or fewer in the ablation studies). 600 of these correspond to 600 muscle commands (see Section ), and one corresponds to the predicted sensory effect.
The 600 muscle commands simulate the human motor control of limbs. We attribute four weights to each of the 600 muscle commands, each weight determining the degree to which that muscle command influences each of the four limbs. We sample the four weights from a distribution between zero and one, such that on average about 550 out of 600 samples would be near 0, 25 out of 600 samples would be near one and 25 would be between zero and one. The beta function (shown in Figure ):
with and has this property.
Fig. A shows an example of an attribution of muscle command weights to the four limbs following this scheme. Fig. B reorders the muscle commands in order of increasing activation for the right arm only, to show that we have obtained the desired connectivity. Muscle commands 1 to 550 have a weight of zero, meaning they do not influence the right arm. Muscle commands 550 to 575 have intermediate weights and muscle commands 575 to 600 have weights of 1, meaning they strongly activate the right arm. Similar findings would apply to the other limbs but for different muscle commands. Note that during each run of the model corresponding to an experiment with one infant, the weights linking muscle commands to limbs stayed the same. To simulate different infants from infant experiments [
After the 600 muscle commands have been mapped to their respective limbs, the resultant total limb activation is calculated for each limb and motor noise is added. We chose a wide range of motor noise, specifically a random value between -0.3 and 0.3, in order to increase the difficulty of the task and enforce some amount of exploration through variability. Finally, after the generation of muscle commands activations, their mapping to the limbs, and the addition of the motor noise, the network has produced the new limb activity.
All layers in the network are fully connected linear layers, meaning that each neuron in one layer is connected via a particular weight to each neuron in the previous and succeeding layers. Linear layers apply a linear transformation to incoming data: , where y is a vector of output values for the next layer, x the vector of input values for the layer, is a matrix of weights and b is a vector of the biases of each neuron in the layer. The weights and biases in each layer are learnable parameters of the model. The weights and biases are constantly adjusted in order to optimize a defined loss. This adjustment is done through the so-called backpropagation, which means that the loss is propagated through each connection and neuron of the model and adjusts weights and biases in a way that will reduce future losses. This means that if the model receives the same input as before, it will compute an output that is slightly different from the previous one and that would be closer to the output expected by the loss function.
The loss function of our model consists of three terms, each specifying a distance using the mean square error (MSE). The first of these terms evaluates the accuracy of the predicted sensory feedback. The second term encourages exploration within the model. The third term ensures that the activities of the limbs remain close to a preferred baseline level. The three terms are combined as shown in the following equation:
To simulate that there were different infants in the behavioral experiments, the weights and biases are initialized randomly for each simulation. Each simulation begins with an initialization period of 1000 steps without any contingency in order to force the model’s baseline activity to approximate real infants’ starting activity. Based on infant data of previous studies [
The learning rate of our model is another important parameter determining the results and perhaps the parameter hardest to translate to the experiments in the real world. For infants, a higher learning rate could mean that they are able to learn more quickly. In neural networks, the learning rate is generally defined as the amount by which the network’s weights are changed at each learning step. A higher learning rate means that each learning step has a higher impact. However, a compromise in learning rate must be reached because a learning rate which is too high often gives rise to oscillatory behavior instead of converging to a dynamic equilibrium, while a very low learning rate would mean that the model would take a long time to find the equilibrium. We used a constant learning rate of 0.00075 for all simulations. We chose this value after empirical testing and found that it gave results that best matched those of infant studies [
The sensory feedback module has two purposes: (1) the simulation of the mobile and (2) the calculation of the prediction error. The simulated sensory feedback produced by the mobile is based on the activity of the connected limb. The sensory feedback is a single scalar value that might represent any sort of sensory feedback used in experimental work, be it auditory or visual.
In our model, out of the four limbs, only one limb is connected to the mobile. In the binary condition, when the activity of the connected limb exceeds a threshold, the mobile is activated for two steps. In the non-binary (conjugate) condition, the intensity of the sensory feedback emitted by the mobile is directly proportional to the value of the connected limb activity. After the contingent phase of the experiment comes the extinction phase. In this phase, the connected limb was disconnected from the mobile (in practice, we removed the sensory feedback from the mobile). The extinction phase lasts for the last 240 steps of each run.
In addition to activating the mobile as a function of limb movements, the sensory feedback module must calculate the error that the neural network has made in predicting the sensory feedback produced by the mobile. This error is defined as the mean squared error between the predicted sensory feedback and the actual sensory feedback. This value is then fed back into the neural network, where it acts as another loss used to adjust the network’s weights to improve its predictions.
The exploration module uses the sensory prediction error calculated by the sensory feedback module and the new limb activities from the neural network to update the
The activity interest map keeps track of two elements: 1) which limb actions ranges the model has explored before and 2) the extent to which it can predict the resulting sensory feedback for those ranges. When the model successfully predicts the sensory feedback resulting from an action, it should become less interested in the corresponding action range. However, when the sensory feedback is unexpected, we want the model to become highly interested in that action range. To accomplish this, we use an Activity Interest Map array to record whether the agent is ”surprised” (see following paragraph) by the sensory result of its previous limb action. We discretize the continuous values for each limb activity into 10 action ranges of equal size, the first one for action values between 0 and 0.1 and so on, resulting in an overall array of dimensions (4,10) (four limbs and 10 ranges for each). At each simulation step, if a limb action generates surprise, the value in the table for the corresponding action range is directly set to 1, indicating high interest. However, if the limb action generates no surprise, the value in the array for the corresponding action range is decreased by 0.1, implementing a gradually decreasing interest. An example of the progress in the Activity Interest Map is shown in Fig. . The array is initialized with values of 0.1 for each range. This can be interpreted as having a baseline level of interest in all possible actions.
As the model’s prediction is not binary, we introduce a ”Novelty Threshold” that is set to 0.1. The model becomes ”surprised” by the result of its action when the sensory prediction error generated by its limb action exceeds this novelty threshold. The novelty threshold determines the agent’s sensitivity to discrepancies between actual and predicted sensory feedback.
In the exploration module, once the activity interest map has been updated as a function of whether surprise has occurred, the model must modify the neural net so that in the future the agent will tend to make actions within ranges of high interest. For this, the model calculates the mean square error (MSE) as the distance between the current action and the range of activity with the highest interest (should there be more than one range of equal interest, one of them is randomly chosen). This distance is used as a loss to adjust the weights of the neural network so that future muscle commands lead to an activity closer to the area of highest interest.
We incorporated a ”deviation from baseline” module to emulate the fact that, on the one hand, infants presumably act to keep their activity in a restricted range around a certain baseline, but, on the other hand, they also tend to get globally more agitated, with that baseline increasing as the experiment proceeds. Deviation from this baseline is used as another loss that modifies the functioning of the neural network.
The baseline is defined as four random values between 0 and a maximum value (set at 0.3 at the start), one for each limb, chosen at each simulation step. These emulate how each of the infant’s four limbs would tend to move naturally in the absence of any sensory stimulation. To emulate that infants tend to grow fussier over time, the maximum value is increased by 0.0001 at every simulation step up to 0.454 at the end. The deviation from baseline is measured using the mean squared error between the current four baseline values and the current four limb activity values. Note that we assume that infants are not only fatigued by moving above their baseline activity but also that they are fatigued by trying to keep still.
To parallel the number of infants in the two empirical studies, 20 in the binary condition in [
When comparing the model outputs with real infant experiments, we must decide how to link the time steps of the simulation (i.e. each pass through the loop of the simulation) with time in a real experiment. In our simulation of the binary condition, the mobile activation lasts for 2 simulation steps. In the original study [
We start this section by checking whether our model replicates the two main empirical results,
Fig. , shows the graphs of the moment-to-moment activity of the four limbs in the simulations and a comparison with the corresponding infant data of the two arms. The most important fact is that the model does what it was expected to do: like infants, it
An obvious difference between the model and the infants is that the overall variability of activity is much greater for the infants than for the model. Compared to the model, between-participant variability may be greater in infants because they vary more in intrinsic parameters like body morphology, degree of maturation, and learning rate. Within-participant variability in infants may also be greater because they suffer moment-to-moment variations in attention, changes in interest and distractions that we have not modeled in our simulation.
To provide a deeper look into the mechanics of the model and how it can identify the connected limb, let us zoom in on the Exploration module (see Fig. ), specifically on the Activity Interest Map. The main goal of this sub-module is to guide exploration in our model. It does so by calculating how interested the model is in each limb activity. Fig. shows how the values of ”interest” in the Activity Interest Map change over time for each limb. The difference between the connected (lower right panel) and the unconnected limbs is evident. This shows how the model identifies which limb is connected and explores its activity distinctively.
In Fig. , the colors from blue to yellow represent rising values of ”interest”, with blue corresponding to lowest interest, green shades to intermediate, and yellow to highest interest. For the connected limb, there is a clear separation between blue and yellow areas: blue areas (little interest) are found near where most of the limb’s activity is occurring, namely near values of about 0.5 (see Fig. ). For activity ranges for which the model has learned to predict the sensory feedback, the model is no longer ”surprised” and will explore them less than the very high and very low activity ranges. For the unconnected limbs, there is no statistically reliable link between the limb’s activity and the sensory feedback, and so no reliable predictions can be made for any activity range; we see fairly high interest (yellow shades) for all activity ranges. The region in the heatmaps after minute 5 corresponds to the time when the contingency has been removed. The model always receives the same sensory feedback set at 0, and so becomes able to predict the results of all of its actions. There is no interest in any activity region.
We not only want to verify that the model correctly simulates what infants do in the presence of contingent sensory feedback (Figures A and C), but also what they do when the sensory feedback is not contingent on their actions, that is, when the stimuli are triggered independently of limb movements. Experimental data obtained for infants in this case is presented in Fig. B and D. For the non-contingent condition, the stimuli from the contingent group were ”replayed”. In this way, the frequency and intensity of stimuli in the contingent and non-contingent groups were equated. We did the same in our model. The most important finding is that our model correctly simulates the higher activity in the contingent group compared to the non-contingent (control) group, as shown in Fig. . It indicates that,
The difference between the contingent and non-contingent groups are somewhat smaller in the model than in infants. Also, for the model, the shape of the curves for contingent and non-contingent conditions is fairly similar, starting with a rising slope and then flattening off. On the other hand, for infants, the curves are overall flatter and may (in the case of the non-contingent condition) not have a rising part at all. This could suggest that in the non-contingent condition, infants realize from the beginning that they have no impact on the stimuli and so move less than in the contingent condition. The model, in contrast, ”believes” for longer that it affects the stimuli and searches longer for a way to use its limbs to manipulate the sensory feedback. Another difference between the model and the infants is that the variability is much more significant in the infant data, similar to what we saw in the previous subsection.
Interestingly, there is a peculiar aspect of the curves for the binary condition, where at the beginning of the experiment the non-contingent group actually shows greater activity than the contingent condition, but at around 2 minutes into the experiment it falls below the curves for the contingent group. This behavior is unexpected, as there should be no reason for a higher activity in the non-contingent group at the start of the simulation.
In the literature on the mobile paradigm, an extinction burst is sometimes observed when, after the infant has learned to activate the mobile with the connected limb, this limb is disconnected from the mobile causing a sudden and transient burst of activity [
Figure shows the average results of our simulations along with two examples of individual runs. The vertical line in the graphs shows the moment of extinction of the contingency, marked as time 5 minutes. Whereas in the binary condition there seems to be no evidence for an extinction burst, there seems to be a clear one in the non-binary condition. The data for individual simulated infants are quite variable (see Fig. and in the Appendix, Section ), with two examples shown in Fig. B-C and E-F, one with a possible extinction burst, and one without an extinction burst. In the individual data there does not seem to be clear evidence for a sudden increase in activity after the extinction of the contingency. Our findings are consistent with the fact that the existence of an extinction burst is debated in the literature, since different infants may have different learning rates, and depending on the sample, extinction bursts may be more or less evident.
Our prediction for our model was that a binary contingency would be more easily learned and more effective in increasing the model’s activity than a non-binary (conjugate) contingency. Indeed, this is what we find when comparing connected and unconnected limbs (Fig. A and C) and contingent and non-contingent conditions (Fig. A and C).
To explain these effects, we suggest that in the binary condition, a small change in activity can cause a large change in the sensory feedback, while in the non-binary condition, the changes in activity and sensory feedback are proportional. In the binary condition, a small limb activity that crosses the stimulus triggering threshold creates a strong change in the sensory feedback. Therefore, in the binary condition, it is easier to detect which is the connected limb, even when limb activity only varies slightly compared to other limbs. While in the non-binary condition, it is harder to detect the limb that is responsible for a small change in sensory feedback. Analogous differences between the two conditions are also observed in the ablation studies of the number of muscles commands and motor noise.
To see how the model works in the absence of the prediction error, we disconnect the prediction loss from the network, not allowing it to modify any of the weights. Therefore, this ablation shows how the model works when it cannot predict the effects of its actions. Fig. shows the results of this ablation study. The effect of this ablation is to completely prevent the model from distinguishing connected and unconnected limbs, therefore, the model cannot learn to activate the mobile. Without the prediction loss, the model’s behavior becomes mainly determined by which activity levels are labeled as causing surprise. Note that the model continues to compute ”surprise” and modify the Activity Interest Map as a function of the prediction error. Therefore, in this case, once the model by chance finds a surprising activity, it continues to explore that activity range, with variations caused only by random motor noise.
Figure shows the ablation run where the novelty-based reinforcement calculator is not used to modify the weights of the neural network. This ablation not only prevents the model from being able to distinguish between the connected and unconnected limbs but also lowers the overall limb activity. This effect is expected since the model has no incentive to explore, therefore it optimizes its prediction ability and reduces the deviation from baseline limb activity.
In this ablation study, we changed the output layer from 600 muscle commands to 50, 100 or 300. The main finding is that, to consistently simulate infant behavior, the model needs a large number of muscle commands, as shown in Fig. . The number of required muscle commands is larger in the non-binary condition (more than 300) compared to the binary condition ().
The effect of this ablation is seen mainly in the variability across individual simulations. For small numbers of muscle commands, there are more individual runs in which the distinction between connected and unconnected is not learned by the model (e.g. Fig. B and F). In the binary condition, fewer muscle commands (100, Fig. C and G) are needed to reliably elicit a difference in activity between connected and unconnected limbs. In the non-binary condition, even with 300 muscle commands individual runs that do not learn to differentiate the limbs remain.
In this ablation study, shown in Fig. , we explored the effect of changing the amount of motor noise from the value of 0.3 used in the complete model to very low values of 0.01 and 0.1 and a very high value of 0.9. We observe that the model’s learning process is highly sensitive to motor noise. To achieve optimal learning, motor noise is essential; however, both insufficient and excessive levels of motor noise are detrimental.
As shown in Fig. B and F, the ablation with a motor noise of 0.001 stops the model from learning limb differentiation, with the connected and unconnected limbs behaving very similarly, with a lot of individual variation. There are additionally some individual cases with almost no exploration. As an explanation of this effect, we suggest that having a motor noise of 0.001 provides no opportunity for the model to notice differences between the limbs. There will be little difference in prediction loss between the limbs, so the model will have difficulty knowing which limb causes the effect on the mobile. Said in another way, since the correlation between the different limbs and the sensory effect is so similar for all limbs, the model cannot discern the causal relationship triggering the sensory effect and is therefore unable to distinguish between the four limbs and find which limb is the connected one.
In the ablation in which the motor noise was lowered to 0.1 (Figure C and G), we observe a stark difference between the binary condition and the non-binary condition. In the binary condition, the model quickly learns to identify the connected limb and significantly increases the activity in that limb compared to the unconnected limbs. In contrast, in the non-binary condition, the model seems to have more problems identifying the connected limb. For the first 2.5 pseudo-minutes of the non-binary condition, the connected and unconnected limbs have very similar activity levels. After that, surprisingly, the connected limb has lower activity than the unconnected limbs. The overall activity of the unconnected limbs is also higher than without ablation, and the overall variability in activity of all limbs is increased.
Finally, in the ablation in which the motor noise was raised to 0.9 (Figure D and H), learning is hindered even more. The network has very little control over its actions because they become essentially random. This lack of control prevents learning: the average activity of the connected limb and the unconnected limbs progresses similarly, although there is some differentiation of the connected limb in the binary condition. A point worth noting is that when the motor noise is as high as 0.9, the model activity starts lower than 0.2. We assume this occurs because, with such high motor noise, the model will not have attained the correct baseline of about 0.2, even after the initialization period of 1000 steps.
In this ablation study we increased the novelty threshold (from 0.1 to 0.3). The novelty threshold determines whether the model interprets a sensory feedback as surprising or not. The main results of this ablation study is that a higher novelty thresholds leads to a higher variability and an earlier differentiation of the connected and unconnected limbs, as shown in Figure . In the non-binary condition the final difference in activity of the limbs also seems somewhat higher. Presumably, these effects arise because increasing the novelty threshold decreases the effect of motor noise and makes learning easier. It may be possible that carefully adjusting the novelty threshold could at least partially allow us to match the increased variability observed overall in infants, including in the binary condition and from the very beginning of the experiment.
In this ablation study (Fig. ), we remove the deviation from baseline activity loss. This has a very small effect. The reason for introducing the deviation from baseline activity loss in our model was twofold: to limit the overall activity to some activity range around the baseline level and to account for the gradual increase in fussiness observed in infants as the experiments progressed. Presumably, the reason for the small effect of this ablation is that the urge to explore different activity ranges is the main driver of limb activity, and adding a factor that was supposed to simulate ”fussiness” over time was superfluous.
This paper introduced a computational model that simulates key mechanisms of contingency learning in the “mobile paradigm”. In this paradigm, an infant observes movements or listens to sounds produced by a ’mobile’ connected to one of its limbs. It has been observed that infants soon move the
Our model of the mobile paradigm incorporates components that we believe are important in real infants: an action-outcome prediction mechanism and an exploration mechanism, as well as motor noise and motor control involving multiple muscle commands. However, our current model excludes attentional, social, and environmental factors.
The results of our simulations show that for the most part our model exhibits behavior similar to that of infants. In the contingent group, the model rapidly differentiates between the connected and unconnected limbs and increases the activity of its connected limb relative to the unconnected limbs. The model also correctly simulates the higher activity observed for infants in a contingent group compared to a non-contingent control group. Our model also simulates the non-systematic emergence of an extinction burst following the disconnection of contingency. Without any modification, the model also correctly simulates the slightly more robust differentiation of the connected versus unconnected limb in the binary variant of the paradigm compared to the non-binary conjugate variant.
Of course, there are differences between the behavior of the model and infants (see below subsection ). Nonetheless, we hypothesize that our model and ablation studies demonstrate that certain mechanisms in our model appear to be essential to simulate infant behavior correctly. This suggests that similar developmental mechanisms could be necessary in infants.
Internal
To correctly simulate infant behavior, the model also appears to need a large number of
An aspect of infant behavior that our simulations did not replicate well is the variability between individual infants as well as within a single infant. Observing less variability across different simulations is expected because our model is designed to imitate an individual infant, whereas behavioral data is obtained from many different infants. However, the lower variability within individual simulation runs seems to be a limitation of our model. As observed in our ablation studies, tripling the value of the novelty threshold increased the variability of individual runs. Thus, adjusting the novelty threshold of the model would be one way to make the model behave more similarly to infants.
Our lower observed variability must also be understood from the fact that our model is explicitly designed to be focused solely on the task at hand, whereas real infants are subject to multiple distractions during the course of an experiment and are presumably switching their cognitive resources from one task to another. Future work on our model could implement such concurrent learning opportunities and a mechanism that allows task switching. Similar ideas have been advanced, for example, in [
One other limitation of our model is that we only tested one type of sensorimotor contingency. To determine how general our model is and whether it could learn a wider variety of sensorimotor contingencies encountered in early infancy, it should simulate the transfer of learning to new contingencies or with different environmental variables. For example, future experiments could test the introduction of a time delay between the motor action and its sensory consequences, changing which limbs are connected, a change in the specificity of motor actions required (e.g., specific angle of knee flexion as in [
In conclusion, our model has established that motor noise, exploration, and motor control involving multiple degrees of freedom are important for sensorimotor learning. The model could be extended to include the role of habituation, boredom and attentional fluctuations so as to replicate observed infant variability. By replicating the main findings of the mobile paradigm, our model provides a strong starting point for further exploration of the mechanisms of sensorimotor learning in infants and applications to robotics.