Object detection-assisted workflow facilitates cryptic snake monitoring

Abstract

Camera traps are an important tool used to study rare and cryptic animals, including snakes. Time-lapse photography can be particularly useful for studying snakes that often fail to trigger a camera's infrared motion sensor due to their ectothermic nature. However, the large datasets produced by time-lapse photography require labor-intensive classification, limiting their use in large-scale studies. While many artificial intelligence-based object detection models are effective at identifying mammals in images, their ability to detect snakes is unproven. Here, we used camera data to evaluate the efficacy of an object detection model to rapidly and accurately detect snakes. We classified images manually to the species level and compared this with a hybrid review workflow where the model removed blank images followed by a manual review. Using a ≥0.05 model confidence threshold, our hybrid review workflow correctly identified 94.5% of blank images, completed image classification 6× faster, and detected large (>66 cm) snakes as well as manual review. Conversely, the hybrid review method often failed to detect all instances of a snake in a string of images and detected fewer small (<66 cm) snakes than manual review. However, most relevant ecological information requires only a single detection in a sequence of images, and study design changes could likely improve the detection of smaller snakes. Our findings suggest that an object detection-assisted hybrid workflow can greatly reduce time spent manually classifying data-heavy time-lapse snake studies and facilitate ecological monitoring for large snakes.