Dataset Information

Deep learning increases the availability of organism photographs taken by citizens in citizen science programs.

ABSTRACT: Citizen science programs using organism photographs have become popular, but there are two problems related to photographs. One problem is the low quality of photographs. It is laborious to identify species in photographs taken outdoors because they are out of focus, partially invisible, or under different lighting conditions. The other is difficulty for non-experts to identify species. Organisms usually have interspecific similarity and intraspecific variation, which hinder species identification by non-experts. Deep learning solves these problems and increases the availability of organism photographs. We trained a deep convolutional neural network, Xception, to identify bee species using various quality of bee photographs that were taken by citizens. These bees belonged to two honey bee species and 10 bumble bee species with interspecific similarity and intraspecific variation. We investigated the accuracy of species identification by biologists and deep learning. The accuracy of species identification by Xception (83.4%) was much higher than that of biologists (53.7%). When we grouped bee photographs by different colors resulting from intraspecific variation in addition to species, the accuracy of species identification by Xception increased to 84.7%. The collaboration with deep learning and experts will increase the reliability of species identification and their use for scientific researches.

SUBMITTER: Suzuki-Ohno Y

PROVIDER: S-EPMC8786926 | biostudies-literature | 2022 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Deep learning increases the availability of organism photographs taken by citizens in citizen science programs.

Suzuki-Ohno Yukari Y Westfechtel Thomas T Yokoyama Jun J Ohno Kazunori K Nakashizuka Tohru T Kawata Masakado M Okatani Takayuki T

Scientific reports 20220124 1

Citizen science programs using organism photographs have become popular, but there are two problems related to photographs. One problem is the low quality of photographs. It is laborious to identify species in photographs taken outdoors because they are out of focus, partially invisible, or under different lighting conditions. The other is difficulty for non-experts to identify species. Organisms usually have interspecific similarity and intraspecific variation, which hinder species identificati ...[more]

PMID: 35075168

Similar Datasets

Project description:Color research continuously demands better methods and larger sample sizes. Citizen science (CS) projects are producing an ever-growing geo- and time-referenced set of photographs of organisms. These datasets have the potential to make a huge contribution to color research, but the reliability of these data need to be tested before widespread implementation.We compared the difference between color extracted from CS photographs with that of color extracted from controlled lighting conditions (i.e., the current gold standard in spectrometry) for both birds and plants. First, we tested the ability of CS photographs to quantify interspecific variability by assessing > 9,000 CS photographs of 537 Australian bird species with controlled museum spectrometry data. Second, we tested the ability of CS photographs to quantify intraspecific variability by measuring petal color data for two plant species using seven methods/sources with varying levels of control.For interspecific questions, we found that by averaging out variability through a large sample size, CS photographs capture a large proportion of across species variation in plumage color within the visual part of the spectrum (R2 = 0.68-0.71 for RGB space and 0.72-0.77 for CIE-LAB space). Between 12 and 14 photographs per species are necessary to achieve this averaging effect for interspecific studies. Unsurprisingly, the CS photographs taken with commercial cameras failed to capture information in the UV part of the spectrum. For intraspecific questions, decreasing levels of control increase the color variation but averaging larger sample sizes can partially mitigate this, aside from particular issues related to saturation and irregularities in light capture.CS photographs offer a very large sample size across space and time which offers statistical power for many color research questions. This study shows that CS photographs contain data that lines up closely with controlled measurements within the visual spectrum if the sample size is large enough, highlighting the potential of CS photographs for both interspecific and intraspecific ecological or biological questions. With regard to analyzing color in CS photographs, we suggest, as a starting point, to measure multiple random points within the ROI of each photograph for both patterned and unpatterned patches and approach the recommended sample size of 12-14 photographs per species for interspecific studies. Overall, this study provides groundwork in analyzing the reliability of a novel method, which can propel the field of studying color forward.

Project description:Global monitoring of disease vectors is undoubtedly becoming an urgent need as the human population rises and becomes increasingly mobile, international commercial exchanges increase, and climate change expands the habitats of many vector species. Traditional surveillance of mosquitoes, vectors of many diseases, relies on catches, which requires regular manual inspection and reporting, and dedicated personnel, making large-scale monitoring difficult and expensive. New approaches are solving the problem of scalability by relying on smartphones and the Internet to enable novel community-based and digital observatories, where people can upload pictures of mosquitoes whenever they encounter them. An example is the Mosquito Alert citizen science system, which includes a dedicated mobile phone app through which geotagged images are collected. This system provides a viable option for monitoring the spread of various mosquito species across the globe, although it is partly limited by the quality of the citizen scientists' photos. To make the system useful for public health agencies, and to give feedback to the volunteering citizens, the submitted images are inspected and labeled by entomology experts. Although citizen-based data collection can greatly broaden disease-vector monitoring scales, manual inspection of each image is not an easily scalable option in the long run, and the system could be improved through automation. Based on Mosquito Alert's curated database of expert-validated mosquito photos, we trained a deep learning model to find tiger mosquitoes (Aedes albopictus), a species that is responsible for spreading chikungunya, dengue, and Zika among other diseases. The highly accurate 0.96 area under the receiver operating characteristic curve score promises not only a helpful pre-selector for the expert validation process but also an automated classifier giving quick feedback to the app participants, which may help to keep them motivated. In the paper, we also explored the possibilities of using the model to improve future data collection quality as a feedback loop.

Dataset Information

Deep learning increases the availability of organism photographs taken by citizens in citizen science programs.

Publications

Deep learning increases the availability of organism photographs taken by citizens in citizen science programs.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets