Deep learning enables satellite-based monitoring of large populations of terrestrial mammals across heterogeneous landscape

Journal article

Deep learning is an effective machine learning method that in recent years has been successfully applied to detect and monitor species population in remotely sensed data. This study aims to provide a systematic literature review of current applications of deep learning methods for animal detection in aerial and satellite images. We categorized methods in collated publications into image level, point level, bounding-box level, instance segmentation level, and specific information level. The statistical results show that YOLO, Faster R-CNN, U-Net and ResNet are the most used neural network structures. The main challenges associated with the use of these deep learning methods are imbalanced datasets, small samples, small objects, image annotation methods, image background, animal counting, model accuracy assessment, and uncertainty estimation. We explored possible solutions include the selection of sample annotation methods, optimizing positive or negative samples, using weakly and self- supervised learning methods, selecting or developing more suitable network structures. Future research trends we identified are video-based detection, very high-resolution satellite image-based detection, multiple species detection, new annotation methods, and the development of specialized network structures and large foundation models. We discussed existing research attempts as well as personal perspectives on these possible solutions and future trends

Authors: Wu, Z; Zhang, C; Gu, X; Duporge, I; Hughey, LF

• Publication status: Published
• Peer review status: Peer reviewed
• Publisher: Nature Research
• Journal: Nature Communications
• Volume: 14
• Issue: 1
• Pages: 3072-3072
• Article number: 3072
• Publication date: 2023-05-27
• DOI: 10.1038/s41467-023-38901-y
• EISSN: 2041-1723
• ISSN: 2041-1723
• Language: English
• Keywords: Terrain; Deep learning; Pipeline (software); Ecosystem; Habitat; Biodiversity; Remote sensing; Satellite imagery; Satellite; Terrestrial ecosystem; Machine learning; Wildebeest; Geography; Computer science; Biology; Ecology