Disentanglement in conceptual space during sensorimotor interaction

Zhong, J ORCID: https://orcid.org/0000-0001-7642-2961, Ogata, T, Cangelosi, A and Yang, C, 2019. Disentanglement in conceptual space during sensorimotor interaction. Cognitive Computation and Systems, 1 (4), pp. 103-112. ISSN 2517-7567

Preview

Text 1245251_a_Zhong.pdf - Published version Download (1MB) | Preview

Abstract

The disentanglement of different objective properties from the external world is the foundation of language development for agents. The basic target of this process is to summarise the common natural properties and then to name it todescribe those properties in the future. To realise this purpose, a new learning model is introduced for the disentanglement of several sensorimotor concepts (e.g. sizes, colours and shapes of objects) while the causal relationship is being learnt during interaction without much a priori experience and external instructions. This learning model links predictive deep neural models and the variational auto-encoder (VAE) and provides the possibility that the independent concepts can be extracted and disentangled from both perception and action. Moreover, such extraction is further learnt by VAE to memorise their common statistical features. The authors examine this model in the affordance learning setting, where the robot is trying to learn to disentangle about shapes of the tools and objects. The results show that such a process can be found in the neural activities of the β-VAE unit, which indicate that using similar VAE models is a promising way to learn the concepts, and thereby to learn the causal relationship of the sensorimotor interaction.

Item Type:	Journal article
Publication Title:	Cognitive Computation and Systems
Creators:	Zhong, J., Ogata, T., Cangelosi, A. and Yang, C.
Publisher:	Institution of Engineering and Technology (IET)
Date:	2019
Volume:	1
Number:	4
ISSN:	2517-7567
Identifiers:	Number Type 10.1049/ccs.2019.0007 DOI 1245251 Other
Rights:	This is an open access article published by the IET in partnership with Shenzhen University under the Creative Commons AttributionNonCommercial-NoDerivs License (http://creativecommons.org/licenses/by-nc-nd/3.0/).
Divisions:	Schools > School of Science and Technology
Record created by:	Jonathan Gallacher
Date Added:	05 Dec 2019 16:02
Last Modified:	14 Jan 2020 14:35
URI:	https://irep.ntu.ac.uk/id/eprint/38784

Actions (login required)

Edit View

Statistics

Views

Downloads