Re: Decimal Precision Determination
- From: Duane Bozarth <dpbozarth@xxxxxxxxxxxx>
- Date: Sun, 30 Oct 2005 09:24:42 -0600
Jason Vanderplas wrote:
>
> How does Matlab determine the precision of a output value. ...
As others have noted, the displayed precision of Matlab (and virtually
all other programming languages as well, in fact) is not directly
related to the internal representation of the value but is an artifact
of the i/o formatting used.
Most languages have something similat ro what is known in Fortran as
"list-directed" formatting if a specific format is not provided. This
output format is designed to be a compromise between accuracy and ease
of presentation/comprehension for the user. If you need a specific
precision of output results for display, look into fprintf or other
formatting options in Matlab.
As a companion work, I suggest the following link to understand the
basics behind the scenes in dealing w/ floating point representation in
Matlab and any other programming language.
http://docs.sun.com/source/806-3568/ncg_goldberg.html
.
- Prev by Date: Re: How to create M-File Mask in Simulink?
- Next by Date: WAVELET/BTC/EBCOT
- Previous by thread: corner detection in matlab
- Next by thread: WAVELET/BTC/EBCOT
- Index(es):
Relevant Pages
|
