Journal article icon

Journal article

Validation of clinical prediction models: what does the "calibration slope" really measure?

Abstract:
Background and Objectives

Definitions of calibration, an aspect of model validation, have evolved over time. We examine use and interpretation of the statistic currently referred to as the calibration slope.

Methods

The history of the term “calibration slope”, and usage in papers published in 2016 and 2017, were reviewed. The behaviour of the slope in illustrative hypothetical examples and in two examples in the clinical literature was demonstrated.

Results

The paper in which the statistic was proposed described it as a measure of “spread” and did not use the term “calibration”. In illustrative examples, slope of 1 can be associated with good or bad calibration, and this holds true across different definitions of calibration. In data extracted from a previous study, the slope was correlated with discrimination, not overall calibration. Many authors of recent papers interpret the slope as a measure of calibration; a minority interpret it as a measure of discrimination or do not explicitly categorise it as either. Seventeen of thirty-three papers used the slope as the sole measure of calibration.

Conclusion

Misunderstanding about this statistic has led to many papers in which it is the sole measure of calibration, which should be discouraged.

Publication status:
Published
Peer review status:
Peer reviewed

Actions

Access Document

Publisher copy:
10.1016/j.jclinepi.2019.09.016

Authors

More by this author
Institution:
University of Oxford
Division:
MSD
Department:
Primary Care Health Sciences
Oxford college:
Kellogg College
Role:
Author
ORCID:
0000-0002-9258-4060


Publisher:
Elsevier
Journal:
Journal of Clinical Epidemiology More from this journal
Volume:
118
Pages:
93-99
Publication date:
2019-10-09
Acceptance date:
2019-09-19
DOI:
EISSN:
1878-5921
ISSN:
0895-4356


Language:
English
Keywords:
Pubs id:
pubs:1061265
UUID:
uuid:b02dd492-c8ac-4301-b7a0-f2b3fa208430
Local pid:
pubs:1061265
Source identifiers:
1061265
Deposit date:
2019-10-15
ARK identifier:

Terms of use


Views and Downloads

Views and downloads will return soon






If you are the owner of this record, you can report an update to it here: Report update to this record

TO TOP