The Emergence of Action-grounded Compositional Communication
- Michał Niklewski, Human Interactivity and Language Lab, Faculty of Psychology, University of Warsaw, Warsaw, Poland
- Krzysztof Główka, Human Interactivity and Language Lab, Faculty of Psychology, University of Warsaw, Warsaw, Poland
- Joanna Wiszowata, Human Interactivity and Language Lab, Faculty of Psychology, University of Warsaw, Warsaw, Poland
- Vibhesh Kaul, Human Interactivity and Language Lab, Faculty of Psychology, University of Warsaw, Warsaw, Poland
- Tomasz Korbak, Human Interactivity and Language Lab, Faculty of Psychology, University of Warsaw, Warsaw, Poland
- Joanna Rączaszek-Leonardi, Human Interactivity and Language Lab, Faculty of Psychology, University of Warsaw, Warsaw, Poland
- Julian Zubek, Human Interactivity and Language Lab, Faculty of Psychology, University of Warsaw, Warsaw, Poland
AbstractClassical models of the emergence of compositionality in communication focused on the compositional nature of the environment (Cangelosi, 2001; Cornish et al., 2008). Here we advance a model in which compositional structure emerges from integrating environment’s properties with agents’ actions. We take as a starting point Cangelosi’s (2001) model, where a population of agents searched for edible mushrooms. Given opportunity to communicate, they evolved a system in which combinations of signs were sensorily grounded in combinations of mushroom properties. We modify this model by grounding the communication also in agents' actions. With this, we are able to evolve communication systems containing meaningful compositions of mushroom properties and agent actions. We investigate how such compositions can facilitate a) learning the communication protocol, b) learning the adequate behavior policy. This kind of “sensory-motor” compositionality seems better suited for coordinating navigation in dynamic environments.