Mary K. Donovan | Search USGS

USGS2020

Quantifying and addressing the prevalence and bias of study designs in the environmental and social sciences

Building trust in science and evidence-based decision-making depends heavily on the credibility of studies and their findings. Researchers employ many different study designs that vary in their risk of bias to evaluate the true effect of interventions or impacts. Here, we empirically quantify, on a large scale, the prevalence of different study designs and the magnitude of bias in their estimates. Randomised designs and controlled observational designs with pre-intervention sampling were used by just 23% of intervention studies in biodiversity conservation, and 36% of intervention studies in social science. We demonstrate, through pairwise within-study comparisons across 49 environmental datasets, that these types of designs usually give less biased estimates than simpler observational designs. We propose a model-based approach to combine study estimates that may suffer from different levels of study design bias, discuss the implications for evidence synthesis, and how to facilitate the use of more credible study designs.

Nature Communications↗

USGS2012

Demographic patterns in the peacock grouper ( Cephalopholis argus ), an introduced Hawaiian reef fish

This study took advantage of a unique opportunity to collect large sample sizes of a coral reef fish species across a range of physical and biological features of the Hawaiian Archipelago to investigate variability in the demography of an invasive predatory coral reef fish, Cephalopholis argus (Family: Epinephelidae). Age-based demographic analyses were conducted at 10 locations in the main Hawaiian Islands and estimates of weight-at-length, size-at-age, and longevity were compared among locations. Each metric differed among locations, although patterns were not consistent across metrics. Length-weight relationships for C. argus differed among locations and individuals weighed less at a given length at Hilo, the southernmost location studied. Longevity differed among and within islands and was greater at locations on Maui and Hawaii compared to the more northern locations on Oahu and Kauai. Within-island growth patterns differed at Kauai, Oahu, and Hawaii. This work provides a case study of fundamental life history information from distant and/or spatially limited locations that are critical for developing robust fishery models. The differences observed both among and within islands indicate that variability may be driven by cross-scale mechanisms that need to be considered in fisheries stock assessments and ecosystem-based management.

Hawai'i↗