Using a cognitive model to understand crowdsourced data from citizen scientists.

Threatened species monitoring can produce enormous quantities of acoustic and visual recordings which must be searched for animal detections. Data coding is extremely time-consuming for humans and even though machine algorithms are emerging as useful tools to tackle this task, they too require large amounts of known detections for training. Citizen scientists are often recruited via crowd-sourcing to assist. However, the results of their coding can be difficult to interpret because citizen scientists lack comprehensive training and typically each codes only a small fraction of the full dataset. Competence may vary between citizen scientists, but without knowing the ground truth of the dataset, it is difficult to identify which citizen scientists are most competent. We used a quantitative cognitive model, cultural consensus theory, to analyze both empirical and simulated data from a crowdsourced analysis of audio recordings of Australian frogs. Several hundred citizen scientists were asked whether the calls of nine frog species were present on 1260 brief audio recordings, though most only coded a fraction of these recordings. Through modeling, characteristics of both the citizen scientist cohort and the recordings were estimated. We then compared the model's output to expert coding of the recordings and found agreement between the cohort's consensus and the expert evaluation. This finding adds to the evidence that crowdsourced analyses can be utilized to understand large-scale datasets, even when the ground truth of the dataset is unknown. The model-based analysis provides a promising tool to screen large datasets prior to investing expert time and resources.

Linking Altered Flow Regimes to Biological Condition: an Example Using Benthic Macroinvertebrates in Small Streams of the Chesapeake Bay Watershed.

Regionally scaled assessments of hydrologic alteration for small streams and its effects on freshwater taxa are often inhibited by a low number of stream gages. To overcome this limitation, we paired modeled estimates of hydrologic alteration to a benthic macroinvertebrate index of biotic integrity data for 4522 stream reaches across the Chesapeake Bay watershed. Using separate random-forest models, we predicted flow status (inflated, diminished, or indeterminant) for 12 published hydrologic metrics (HMs) that characterize the main components of flow regimes. We used these models to predict each HM status for each stream reach in the watershed, and linked predictions to macroinvertebrate condition samples collected from streams with drainage areas less than 200 km2. Flow alteration was calculated as the number of HMs with inflated or diminished status and ranged from 0 (no HM inflated or diminished) to 12 (all 12 HMs inflated or diminished). When focused solely on the stream condition and flow-alteration relationship, degraded macroinvertebrate condition was, depending on the number of HMs used, 3.8-4.7 times more likely in a flow-altered site; this likelihood was over twofold higher in the urban-focused dataset (8.7-10.8), and was never significant in the agriculture-focused dataset. Logistic regression analysis using the entire dataset showed for every unit increase in flow-alteration intensity, the odds of a degraded condition increased 3.7%. Our results provide an indication of whether altered streamflow is a possible driver of degraded biological conditions, information that could help managers prioritize management actions and lead to more effective restoration efforts.