Journal article
Effects of round-to-nearest and stochastic rounding in the numerical solution of the heat equation in low precision
- Abstract:
- Motivated by the advent of machine learning, the last few years have seen the return of hardware-supported low-precision computing. Computations with fewer digits are faster and more memory and energy efficient but can be extremely susceptible to rounding errors. As shown by recent studies into reduced-precision climate simulations, an application that can largely benefit from the advantages of low-precision computing is the numerical solution of partial differential equations (PDEs). However, a careful implementation and rounding error analysis are required to ensure that sensible results can still be obtained. In this paper we study the accumulation of rounding errors in the solution of the heat equation, a proxy for parabolic PDEs, via Runge–Kutta finite difference methods using round-to-nearest (RtN) and stochastic rounding (SR). We demonstrate how to implement the scheme to reduce rounding errors and we derive a priori estimates for local and global rounding errors. Let u be the unit roundoff. While the worst-case local errors are O(u) with respect to the discretization parameters (mesh size and timestep), the RtN and SR error behaviour is substantially different. In fact, the RtN solution always stagnates for small enough Δt, and until stagnation the global error grows like O(uΔt−1). In contrast, we show that the leading-order errors introduced by SR are zero-mean, independent in space and mean-independent in time, making SR resilient to stagnation and rounding error accumulation. In fact, we prove that for SR the global rounding errors are only O(uΔt−1/4) in one dimension and are essentially bounded (up to logarithmic factors) in higher dimensions.
- Publication status:
- Published
- Peer review status:
- Peer reviewed
Actions
Access Document
- Files:
-
-
(Preview, Accepted manuscript, pdf, 486.8KB, Terms of use)
-
- Publisher copy:
- 10.1093/imanum/drac012
Authors
+
Engineering and Physical Sciences Research Council
More from this funder
- Grant:
- EP/P020720/1
- Grant:
- MA/3630057
- Publisher:
- Oxford University Press
- Journal:
- IMA Journal of Numerical Analysis More from this journal
- Volume:
- 43
- Issue:
- 3
- Pages:
- 1358-1390
- Publication date:
- 2022-04-22
- Acceptance date:
- 2022-03-06
- DOI:
- EISSN:
-
1464-3642
- ISSN:
-
0272-4979
- Language:
-
English
- Keywords:
- Pubs id:
-
1242715
- Local pid:
-
pubs:1242715
- Deposit date:
-
2022-03-08
- ARK identifier:
Terms of use
- Copyright holder:
- Croci and Giles
- Copyright date:
- 2022
- Rights statement:
- © The Author(s) 2022. Published by Oxford University Press on behalf of the Institute of Mathematics and its Applications. All rights reserved.
- Notes:
-
This is the accepted manuscript version of the article. The final version is available from Oxford University Press at https://doi.org/10.1093/imanum/drac012
If you are the owner of this record, you can report an update to it here: Report update to this record