Faithful approaches to rule learning

Conference item

Rule learning involves developing machine learning models that can be applied to a set of logical facts to predict additional facts, as well as providing methods for extracting from the learned model a set of logical rules that explain symbolically the model’s predictions. Existing such approaches, however, do not describe formally the relationship between the model’s predictions and the derivations of the extracted rules; rather, it is often claimed without justification that the extracted rules ‘approximate’ or ‘explain’ the model, and rule quality is evaluated by manual inspection. In this paper, we study the formal properties of Neural-LP—a prominent rule learning approach. We show that the rules extracted from Neural-LP models can be both unsound and incomplete: on the same input dataset, the extracted rules can derive facts not predicted by the model, and the model can make predictions not derived by the extracted rules. We also propose a modification to the Neural-LP model that ensures that the extracted rules are always sound and complete. Finally, we show that, on several prominent benchmarks, the classification performance of our modified model is comparable to that of the standard NeuralLP model. Thus, faithful learning of rules is feasible from both a theoretical and practical point of view.

Authors: Tena Cucala, DJ; Cuenca Grau, B; Motik, B

• Publication status: Published
• Peer review status: Peer reviewed
• Publisher: IJCAI Organization
• Host title: Proceedings of the 19th International Conference on Principles of Knowledge Representation and Reasoning (KR 2022)
• Pages: 484–493
• Publication date: 2022-07-27
• Acceptance date: 2022-05-17
• Event title: 19th International Conference on Principles of Knowledge Representation and Reasoning (KR 2022)
• Event location: Haifa, Israel
• Event website: https://kr2022.cs.tu-dortmund.de/venue.php
• Event start date: 2022-07-31
• Event end date: 2022-08-05
• DOI: 10.24963/kr.2022/50
• Language: English
• Keywords: FFR