arrow
Return

PyTracer: Automatically Profiling Numerical Instabilities in Python

delete2023-06-01
delete1
delete
OA
AI
Y
Yohan Chatelain *
N
Nigel Yong Sao Young
K
Kiar, Gregory
T
Tristan Glatard
DOI:10.1109/TC.2022.3224377delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Numerical stability is a crucial requirement of reliable scientific computing. However, despite the pervasiveness of Python in data science, analyzing large Python programs remains challenging due to the lack of scalable numerical analysis tools available for this language. To fill this gap, we developed PyTracer, a profiler to quantify numerical instability in Python applications. PyTracertransparently instruments Python code to produce numerical traces and visualize them interactively in a Plotly dashboard. We designed PyTracerto be agnostic to numerical noise model, allowing for numerical profiling through Monte-Carlo Arithmetic, random rounding, random data perturbation, or structured noise for a particular application. We illustrate PyTracer's capabilities by testing the numerical stability of key functions in both SciPy and Scikit-learn, two dominant Python libraries for mathematical modeling. Through these evaluations, we demonstrate PyTraceras a scalable, automated, and generic framework for numerical profiling in Python.
Keywords:
Instruments
Python
Arithmetic
Numerical stability
Numerical models
Libraries
Codes
Computer arithmetic
quality analysis and evaluation
stochastic analysis
tracing
visualization techniques and methodologies

Journal

IEEE Transactions on Computers cover
IEEE Transactions on Computers
IF:
3.8
Papers:
5.4K
Citations:
9.8K

Organization

C
concordia university - canada
Scholars:
8.0K
Papers: 8.9K
Citations: 4
Cited Papers

Cited Papers

pointcloudset: Efficient Analysis of Large Datasets of Point Clouds Recorded Over Time
err2021-09-28
err0
errOAAI
errThomas Goelles; Birgit Schlager; Stefan Muckenhuber; Sarah Haas; Tobias Hammer
errShare
errSave
Automotive components composed of polyolefins
err2017-01-01
err0
PREAI
errRotimi Sadiku; David Ibrahim; Oluranti Agboola; Shesan J. Owonubi; Victoria O. Fasiku; Williams K. Kupolati; Tamba Jamiru; Azunna A. Eze; Oludaisi S. Adekomaya; Kokkarachedu Varaprasad; Stephen C. Agwuncha; Abbavaram B. Reddy; Bandla Manjula; Bilainu Oboirien; Clara Nkuna; Mbuso Dludlu; Adetona Adeyeye; Tobi S. Osholana; Goitse Phiri; Olayinka Durowoju; Peter A. Olubambi; Frank Biotidara; Mercy Ramakokovhu; Brendon Shongwe; Vincent Ojijo
errShare
errSave
A nomogram for retinene2-based visual pigments
err1967-03-01
err0
PREAI
errF.W. Munz; S.A. Schwanzara
errShare
errSave
CADNA:: a library for estimating round-off error propagation
err2008-06-01
err59
PREAI
errJezequel, Fabienne; Chesneaux, Jean-Marie
errShare
errSave
errShare
errSave
The morphology and distribution of peptide-containing neurons in the adult and developing visual cortex of the rat. I. Somatostatin
err1982-10-01
err0
PREAI
errJohn K. McDonald; John G. Parnavelas; Azarias N. Karamanlidis; Nicholas Brecha; James I. Koenig
errShare
errSave
SciPy 1.0: fundamental algorithms for scientific computing in Python
err2020-02-03
err2.1W
errOAAI
errVirtanen, Pauli; Gommers, Ralf; Oliphant, Travis E.; Haberland, Matt; Reddy, Tyler; Cournapeau, David; Burovski, Evgeni; Peterson, Pearu; Weckesser, Warren; Bright, Jonathan; van der Walt, Stefan J.; Brett, Matthew; Wilson, Joshua; Millman, K. Jarrod; Mayorov, Nikolay; Nelson, Andrew R. J.; Jones, Eric; Kern, Robert; Larson, Eric; Carey, C. J.; Polat, Ilhan; Feng, Yu; Moore, Eric W.; VanderPlas, Jake; Laxalde, Denis; Perktold, Josef; Cimrman, Robert; Henriksen, Ian; Quintero, E. A.; Harris, Charles R.; Archibald, Anne M.; Ribeiro, Antonio H.; Pedregosa, Fabian; van Mulbregt, Paul
errShare
errSave
researcher View more