Journal article icon

Journal article

Effects of round-to-nearest and stochastic rounding in the numerical solution of the heat equation in low precision

Abstract:
Motivated by the advent of machine learning, the last few years have seen the return of hardware-supported low-precision computing. Computations with fewer digits are faster and more memory and energy efficient but can be extremely susceptible to rounding errors. As shown by recent studies into reduced-precision climate simulations, an application that can largely benefit from the advantages of low-precision computing is the numerical solution of partial differential equations (PDEs). However, a careful implementation and rounding error analysis are required to ensure that sensible results can still be obtained. In this paper we study the accumulation of rounding errors in the solution of the heat equation, a proxy for parabolic PDEs, via Runge–Kutta finite difference methods using round-to-nearest (RtN) and stochastic rounding (SR). We demonstrate how to implement the scheme to reduce rounding errors and we derive a priori estimates for local and global rounding errors. Let u be the unit roundoff. While the worst-case local errors are O(u) with respect to the discretization parameters (mesh size and timestep), the RtN and SR error behaviour is substantially different. In fact, the RtN solution always stagnates for small enough Δt⁠, and until stagnation the global error grows like O(uΔt−1)⁠. In contrast, we show that the leading-order errors introduced by SR are zero-mean, independent in space and mean-independent in time, making SR resilient to stagnation and rounding error accumulation. In fact, we prove that for SR the global rounding errors are only O(uΔt−1/4) in one dimension and are essentially bounded (up to logarithmic factors) in higher dimensions.
Publication status:
Published
Peer review status:
Peer reviewed

Actions

Access Document

Files:
Publisher copy:
10.1093/imanum/drac012

Authors

More by this author
Institution:
University of Oxford
Division:
MPLS
Department:
Mathematical Institute
Oxford college:
St Hugh's College
Role:
Author
ORCID:
0000-0002-5445-3721


Engineering and Physical Sciences Research Council More from this funder
Grant:
EP/P020720/1
Grant:
MA/3630057


Publisher:
Oxford University Press
Journal:
IMA Journal of Numerical Analysis More from this journal
Volume:
43
Issue:
3
Pages:
1358-1390
Publication date:
2022-04-22
Acceptance date:
2022-03-06
DOI:
EISSN:
1464-3642
ISSN:
0272-4979


Language:
English
Keywords:
Pubs id:
1242715
Local pid:
pubs:1242715
Deposit date:
2022-03-08
ARK identifier:

Terms of use


Views and Downloads

Views and downloads will return soon






If you are the owner of this record, you can report an update to it here: Report update to this record

TO TOP