Planet Four: Craters - Optimizing task workflow to improve volunteer engagement and crater counting performance

Sprinks, J ORCID: https://orcid.org/0000-0003-3781-5484, Houghton, R, Bamford, S and Morley, JG, 2019. Planet Four: Craters - Optimizing task workflow to improve volunteer engagement and crater counting performance. Meteoritics & Planetary Science, 54 (6), pp. 1325-1346. ISSN 1086-9379

Preview

Text 14039_Sprinks.pdf - Published version Download (2MB) | Preview

Abstract

Virtual citizen science platforms allow nonscientists to take part in scientific research across a range of disciplines, including planetary science. What is required of the volunteer can vary considerably in terms of task type, variety, judgment required, and autonomy—even when the overall goal is unchanged. Through analysis of our live Zooniverse Planet Four: Craters citizen science platform, the effects of task workflow design factors including volunteer autonomy, task variety, task type, and judgment required on volunteer engagement and crater marking performance were investigated. Website analytics showed volunteers using the Full interface (most autonomy and variety) were more likely to return to the platform, although the amount of time spent per visit was unaffected by the interface used. However, analysis of performance suggested that how this time was used did differ. The interface involving the least complex task resulted in the greatest amount of data and rate of collection, although this also coincided with a greater number of false positives when compared with the expert. Performance in terms of agreement, both between participants and with the expert judgment, was significantly improved when using the Stepped interface for crater position and the Ramped (Mark) when measuring diameter—interfaces that both directly measured the metric with a specific, delineated task. The implications for planetary scientists considering the citizen science route is that there is a balancing act to perform, weighing the importance of volunteer engagement with scientists' data needs and the resources that can be committed to data validation.

Item Type:	Journal article
Publication Title:	Meteoritics & Planetary Science
Creators:	Sprinks, J., Houghton, R., Bamford, S. and Morley, J.G.
Publisher:	John Wiley
Date:	3 June 2019
Volume:	54
Number:	6
ISSN:	1086-9379
Identifiers:	Number Type 10.1111/maps.13277 DOI
Divisions:	Schools > School of Architecture, Design and the Built Environment
Record created by:	Jonathan Gallacher
Date Added:	10 Jun 2019 14:41
Last Modified:	10 Jun 2019 14:41
URI:	https://irep.ntu.ac.uk/id/eprint/36725

Actions (login required)

Edit View

Statistics

Views

Downloads