[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: Roundoff error in SMOOTH
- Subject: Re: Roundoff error in SMOOTH
- From: landsman(at)stars.gsfc.nasa.gov (Wayne Landsman)
- Date: 26 May 1999 16:25 EST
- Distribution: world
- News-Software: VAX/VMS VNEWS 1.50AXP
- Newsgroups: comp.lang.idl-pvwave
- Organization: NASA Goddard Space Flight Center -- Greenbelt, Maryland USA
- References: <26MAY199915495025@stars.gsfc.nasa.gov>
- Xref: news.doit.wisc.edu comp.lang.idl-pvwave:14922
In article <26MAY199915495025@stars.gsfc.nasa.gov>, landsman@stars.gsfc.nasa.gov (Wayne Landsman) writes...
>I was recently surprised to discover that applying the SMOOTH function to a
>non-negative array could yield an array with negative numbers. I give an
>example below.
I forgot to include the IDL !VERSION used in my example:
{ sparc sunos unix 5.2 Oct 30 1998}
Testing the same example on VMS IDL V4.0.1, I still get negative numbers
although not as many!
--Wayne Landsman landsman@mpb.gsfc.nasa.gov