Hybrid expert ensembles for identifying unreliable data in citizen science
Author(s): Wessels, P., Moran, N., Johnston, A. & Wang, W.
Published: March 2019 Pages: 13pp
Journal: Engineering Applications of Artificial Intelligence Volume: 81
Digital Identifier No. (DOI): 10.1016/j.engappai.2019.01.004
Citizen science utilises public resources for scientific research. BirdTrack is such a project established in 2004 by the British Trust for Ornithology (BTO) for the public to log their bird observations through its web or mobile applications. It has accumulated over 40 million observations. However, the veracity of these observations needs to be checked and the current process involves time-consuming interventions by human experts. This research therefore aims to develop a more efficient system to automatically identify unreliable observations from large volume of records.
This paper presents a novel approach — a Hybrid Expert Ensemble System (HEES) that combines an Expert System (ES) and machine induced models to perform the intended task. The ES is built based on human expertise and used as a base member of the ensemble. Other members are decision trees induced from county-based data. The HEES uses accuracy and diversity as criteria to select its members with an aim of improving its accuracy and reliability.
The experiments were carried out using the county-based data and the results indicate that (1) the performance of the expert system is reasonable for some counties but varied considerably on others. (2) An HEES is more accurate and reliable than the Expert System and also other individual models, with Sensitivity of 85% for correctly identifying unreliable observations and Specificity of 99% for reliable observations. These results demonstrated that the proposed approach has the ability to be an alternative or additional means to validate the observations in a timely and cost-effective manner and also has a potential to be applied in other citizen science projects where the huge amount of data needs to be checked effectively and efficiently.
Unlocking the science to reveal the state of nature
David Noble takes a sober look at the latest State of Nature Report.
Assessing BTO impact
BTO has a strong reputation for delivering quality science, but does it have an impact? An independent expert panel decides.
BTO research harnesses citizen science to make breakthroughs in bat monitoring
Bat monitoring has traditionally been challenging, because most species are nocturnal, wide-ranging and difficult to identify. Whilst the National Bat Monitoring Programme run by the Bat Conservation Trust (BCT)...