Journal article icon

Journal article

Through hawks’ eyes: synthetically reconstructing the visual field of a bird in flight

Abstract:
Birds of prey rely on vision to execute flight manoeuvres that are key to their survival, such as intercepting fast-moving targets or navigating through clutter. A better understanding of the role played by vision during these manoeuvres is not only relevant within the field of animal behaviour, but could also have applications for autonomous drones. In this paper, we present a novel method that uses computer vision tools to analyse the role of active vision in bird flight, and demonstrate its use to answer behavioural questions. Combining motion capture data from Harris’ hawks with a hybrid 3D model of the environment, we render RGB images, semantic maps, depth information and optic flow outputs that characterise the visual experience of the bird in flight. In contrast with previous approaches, our method allows us to consider different camera models and alternative gaze strategies for the purposes of hypothesis testing, allows us to consider visual input over the complete visual field of the bird, and is not limited by the technical specifications and performance of a head-mounted camera light enough to attach to a bird’s head in flight. We present pilot data from three sample flights: a pursuit flight, in which a hawk intercepts a moving target, and two obstacle avoidance flights. With this approach, we provide a reproducible method that facilitates the collection of large volumes of data across many individuals, opening up new avenues for data-driven models of animal behaviour.
Publication status:
Published
Peer review status:
Peer reviewed

Actions


Access Document


Files:
Publisher copy:
10.1007/s11263-022-01733-2

Authors


More by this author
Institution:
University of Oxford
Division:
MPLS
Department:
Biology
Oxford college:
Jesus College
Role:
Author


Publisher:
Springer
Journal:
International Journal of Computer Vision More from this journal
Volume:
131
Pages:
1497-1531
Publication date:
2023-03-02
Acceptance date:
2022-12-05
DOI:
EISSN:
1573-1405
ISSN:
0920-5691


Language:
English
Keywords:
Pubs id:
1315382
Local pid:
pubs:1315382
Deposit date:
2022-12-16

Terms of use



Views and Downloads






If you are the owner of this record, you can report an update to it here: Report update to this record

TO TOP