arrow
返回

Newton's Method in Mixed Precision

delete2022-02-03
delete8
PRE
AI
C
C. T. Kelley *
DOI:10.1137/20M1342902delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We investigate the use of reduced precision arithmetic to solve the linear equation for the Newton step. If one neglects the backward error in the linear solve, then well-known convergence theory implies that using single precision in the linear solve has very little negative effect on the nonlinear convergence rate. However, if one considers the effects of backward error, then the usual textbook estimates are very pessimistic and even the state-of-the-art estimates using probabilistic rounding analysis do not fully conform to experiments. We report on experiments with a specific example. We store and factor Jacobians in double, single, and half precision. In the single precision case we observe that the convergence rates for the nonlinear iteration do not degrade as the dimension increases and that the nonlinear iteration statistics are essentially identical to the double precision computation. In half precision we see that the nonlinear convergence rates, while poor, do not degrade as the dimension increases. Audience. This paper is intended for students who have completed or are taking an entry-level graduate course in numerical analysis and for faculty who teach numerical analysis. The important ideas in the paper are O notation, floating point precision, backward error in linear solvers, and Newton's method.
Keyword:
Newton's method
mixed precision arithmetic
backward error
probabilistic rounding analysis

期刊

SIAM Review 封面图
SIAM Review
IF:
6.1
论文数:
888
被引数:
1.2W

机构

N
North Carolina State University
学者数:
2.6W
论文数: 2.3W
被引数: 3.7W
引用论文

引用论文

err分享
err收藏
Management
err
IF0
err2000-01-01
err0
PREAI
errHorst Steinmann; Georg Schreyögg
err分享
err收藏
Acquiring a Family Firm: A Case Study
err2003-12-01
err0
PREAI
errRachel E. Mickelson; Christopher Worley
err分享
err收藏
err分享
err收藏
Feasibility of an Ag-alloy film as a thin-film transistor liquid-crystal display source/drain material
err2002-06-01
err0
PREAI
errC. O. Jeong; N. S. Roh; S. G. Kim; H. S. Park; C. W. Kim; D. S. Sakong; J. H. Seok; K. H. Chung; W. H. Lee; Dongwen Gan; Paul S. Ho; B. S. Cho; B. J. Kang; H. J. Yang; Y. K. Ko; J. G. Lee
err分享
err收藏
Numerical methods for nonlinear equations
err2018-05-04
err58
PREAI
errKelley, C. T.
err分享
err收藏
学者 查看更多内容