Causal analysis of intellectual complexity in software engineering

Conference item

In modern software engineering, Research and Development (R&D) Efficiency is pivotal for project success and competitive advantage. Intellectual Complexity, encompassing problem complexity and cognitive load, significantly impacts R&D Efficiency. However, the causal relationships between cognitive load factors and duration of development remain inadequately explored. This study addresses this gap by applying advanced causal discovery and inference techniques to elucidate these relationships within the software development process. Utilizing a comprehensive dataset from the company’s internal development systems, we employ Graphical Lasso (Glasso) and Feature Selection using MMD and Generative Neural Networks (FSGNN) to construct an initial causal skeleton, which is further refined using ARACNE and expert domain knowledge. Causal Graph Neural Networks (CGNNs) are then leveraged to orient the edges, resulting in a coherent Directed Acyclic Graph (DAG). Through causal inference, we quantify the Average Treatment Effects (ATE) of key cognitive load factors, including story points, repository count, and cyclomatic complexity, on development duration. Our findings reveal that reducing task complexity and code complexity can significantly decrease development time, by up to one day per unit change, providing actionable insights for optimizing R&D processes. This study advances the application of causal models in software engineering and provides practical strategies to enhance R&D Efficiency by mitigating intellectual complexity.

Authors: Li, C; Zhang, M; Meng, S; Gao, X; Yu, J

• Publication status: Published
• Peer review status: Peer reviewed
• Publisher: IEEE
• Host title: 2025 International Joint Conference on Neural Networks (IJCNN)
• Pages: 1-8
• Publication date: 2025-06-30
• Acceptance date: 2025-03-31
• Event title: 2025 International Joint Conference on Neural Networks (IJCNN)
• Event location: Rome, Italy
• Event website: https://2025.ijcnn.org/
• Event start date: 2025-06-30
• Event end date: 2025-07-05
• DOI: 10.1109/ijcnn64981.2025.11228843
• EISSN: 2161-4407
• ISSN: 2161-4393
• EISBN: 9798331510428
• ISBN: 9798331510435
• Language: English
• Keywords: knowledge engineering; cognitive load; feature extraction; skeleton; graph neural networks; complexity theory; research and development; software engineering; software development management; load modeling