Procedural generation of synthetic forest environments to train machine learning algorithms

Nunes, R, Ferreira, J ORCID: https://orcid.org/0000-0002-2510-2412 and Peixoto, P, 2022. Procedural generation of synthetic forest environments to train machine learning algorithms. In: Innovation in Forestry Robotics: Research and Industry Adoption Workshop - IEEE Conference on Robotics and Automation (ICRA 2022), Philadelphia (PA), USA, 23-27 May 2022.

Preview

Text 1551529_Ferreira.pdf - Post-print Download (23MB) | Preview

Abstract

The demand for the development of forestry robotics has been increasing. As with most robotics applications, Machine Learning is the engine driving innovation in this field. However, Machine Learning development for robotic perception tasks is highly dependent on the availability of annotated datasets. Contrasting with urban environments, public datasets for forest applications are rare, hard to collect and currently not enough to train models capable of operating autonomously. This paper proposes a solution to mitigate the data shortage problem: a system that uses procedural generation to create virtual forests and collects synthetic data from these environments using virtual sensors. More specifically, the system generates RGB images and point clouds with pixel-wise and point-wise annotations, respectively, as well as depth maps, substantially reducing the time and effort invested in dataset construction. The system proved capable of generating 1000 frames with all the above-mentioned data types in 3 hours of autonomous operation. The generated data is ready to be used in Machine Learning model training. Finally, qualitative preliminary results obtained by a semantic segmentation model trained on the generated dataset, which has been made publicly available in a community-wide repository, are presented.

Item Type:	Conference contribution
Creators:	Nunes, R., Ferreira, J. and Peixoto, P.
Date:	May 2022
Identifiers:	Number Type 1551529 Other
Divisions:	Schools > School of Science and Technology
Record created by:	Laura Ward
Date Added:	07 Jun 2022 15:32
Last Modified:	07 Jun 2022 15:32
Related URLs:	Publisher
URI:	https://irep.ntu.ac.uk/id/eprint/46417

Actions (login required)

Edit View

Statistics

Views

Downloads