Journal article
Algorithmic opacity as a principal-agent problem
- Abstract:
-
Principal-agent problems are central to debates over algorithmic transparency, but have been underexplored. Concerns about gaming and trade secrecy, frequently invoked to justify opacity, can also mask self-serving strategic behavior by decision-makers, who may prioritize private benefits over social welfare. This article develops a principal-agent test for determining when algorithmic decision-making should trigger disclosure obligations even when concerns about gaming or trade secrecy exist. It proposes that disclosure requirements should be anchored in decision quality.
The article introduces structured patterns of error types and the distribution of decision outcomes across groups as diagnostic tools for detecting principal-agent misalignment—extending their role beyond fairness metrics. These make visible whether decision-makers align algorithmic design and implementation with the public interest or instead use opacity to obscure bias, inefficiency, or strategic shirking. Strong disparities across social groups, and asymmetries in the distribution of decision errors across outcome types, should trigger rebuttable presumptions favoring further disclosure obligations.
This principal-agent framework reorients regulatory attention toward institutional design questions that transparency debates have not focused on so far. This framework informs the adoption of differentiated disclosure regimes: staged, partial, mediated, or audience-segmented. By reframing opacity debates through the lens of principal-agent theory, this article challenges long-standing assumptions about algorithmic secrecy: it shows the domain of justifiable algorithmic opacity is significantly narrower than commonly assumed once differentiated disclosure regimes are considered. When gaming or trade secrecy risks are legitimate, actionable disclosures (such as training data characteristics and key system design parameters) ordinarily can be mandated without compromising innovation or enabling gaming. This approach offers an implementable regulatory pathway for AI transparency in both public and private sectors.
By developing burden-shifting presumptions about what type of opacity is impermissible, what minimum disclosures are required, and how to weigh trade-secrecy and gaming claims, the article provides policymakers and courts with a framework for structuring tailored disclosure orders, evaluating secrecy claims, and allocating burden of proof in transparency disputes. The analysis also shows that meaningful disclosures are possible even for technically inscrutable algorithms.
- Publication status:
- Published
- Peer review status:
- Peer reviewed
Actions
Access Document
- Files:
-
-
(Preview, Accepted manuscript, pdf, 727.5KB, Terms of use)
-
- Publication website:
- https://jipel.law.nyu.edu/algorithmic-opacity-as-a-principal-agent-problem/
Authors
- Funder identifier:
- https://ror.org/0302b4677
- Grant:
- SRG2425\252012
- Publisher:
- New York University School of Law
- Journal:
- NYU Journal of Intellectual Property and Entertainment Law More from this journal
- Volume:
- 15
- Issue:
- 2
- Pages:
- 1-76
- Publication date:
- 2026-04-28
- Acceptance date:
- 2026-02-01
- ISSN:
-
2324-6286
- Language:
-
English
- Pubs id:
-
2423173
- Local pid:
-
pubs:2423173
- Deposit date:
-
2026-05-24
- ARK identifier:
Terms of use
- Copyright holder:
- Cofone and Strandburg
- Copyright date:
- 2026
- Rights statement:
- © 2026 by the authors
- Notes:
- The author accepted manuscript (AAM) of this paper has been made available under the University of Oxford's Open Access Publications Policy, and a CC BY public copyright licence has been applied.
- Licence:
- CC Attribution (CC BY)
If you are the owner of this record, you can report an update to it here: Report update to this record