Background invariance testing according to semantic proximity

Conference item

In many applications, machine-learned (ML) models are required to hold some invariance qualities, such as rotation, size, and intensity invariance. Among these, testing for background invariance presents a significant challenge due to the vast and complex data space it encompasses. To evaluate invariance qualities, we first use a visualization-based testing framework which allows human analysts to assess and make informed decisions about the invariance properties of ML models. We show that such informative testing framework is preferred as ML models with the same global statistics (e.g., accuracy scores) can behave differently and have different visualized testing patterns. However, such human analysts might not lead to consistent decisions without a systematic sampling approach to select representative testing suites. In this work, we present a technical solution for selecting background scenes according to their semantic proximity to a target image that contains a foreground object being tested. We construct an ontology for storing knowledge about relationships among different objects using association analysis. This ontology enables an efficient and meaningful search for background scenes of different semantic distances to a target image, enabling the selection of a test suite that is both diverse and reasonable. Compared with other testing techniques, e.g., random sampling, nearest neighbors, or other sampled test suites by visuallanguage models (VLMs), our method achieved a superior balance between diversity and consistency of human annotations, thereby enhancing the reliability and comprehensiveness of background invariance testing.

Authors: Liao, Z; Chen, M

• Publication status: Published
• Peer review status: Peer reviewed
• Publisher: IEEE
• Host title: 2025 IEEE/CVF International Conference on Computer Vision (ICCV)
• Journal: 2025 IEEE/CVF International Conference on Computer Vision (ICCV)
• Pages: 8056-8065
• Publication date: 2025-10-19
• Acceptance date: 2025-06-26
• Event title: IEEE/CVF International Conference on Computer Vision (ICCV 2025)
• Event location: Honolulu, HI, USA
• Event website: https://iccv.thecvf.com/Conferences/2025
• Event start date: 2025-10-19
• Event end date: 2025-10-23
• DOI: 10.1109/ICCV51701.2025.00755
• EISSN: 2380-7504
• ISSN: 1550-5499
• EISBN: 9798331587758
• ISBN: 9798331587765
• Language: English
• Keywords: feeds; filtering; filters; radio access networks; regional area networks; protocols; communication systems; communications technology; pixel; HTTP