IT Community - Software Programming, Web Development and Technical Support

erroneous results for certain mathematical calculations

This is a discussion on erroneous results for certain mathematical calculations within the Flash Actionscript Programming forums, part of the Web Development category; Hi, Flash returns erroneous results for certain mathematical calculations. For example, the action script Trace (1.01 - 1) will output ...


Go Back   IT Community - Software Programming, Web Development and Technical Support > Web Development > Flash Actionscript Programming

Register FAQ Members List Calendar Mark Forums Read
  #1 (permalink)  
Old 03-19-2008, 06:50 AM
aramesh aramesh is offline
D-Web Programmer
 
Join Date: Mar 2007
Posts: 71
aramesh is on a distinguished road
Default erroneous results for certain mathematical calculations

Hi,
Flash returns erroneous results for certain mathematical calculations. For example, the action script Trace (1.01 - 1) will output the value 0.0100000000000002.
This will arise some problems in further processing. Help please

Regards,
A.Ramesh
__________________
A.Ramesh
Failure is not the End…it is your stepping stone to success!
Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Sponsored Links
  #2 (permalink)  
Old 04-03-2008, 02:00 AM
seesamjagan seesamjagan is offline
D-Web Programmer
 
Join Date: Aug 2007
Location: Chennai
Posts: 66
seesamjagan is on a distinguished road
Send a message via AIM to seesamjagan Send a message via Yahoo to seesamjagan
Default Re: erroneous results for certain mathematical calculations

hi,

use a some function to sound off the value to few decimals, to avoid such problems
__________________
SeeSamJagan
- Sky is not the "LIMIT", Death is not the END, There is still something beyond....
Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Calculations and other Operations on Field Values Pvinothkumar HTML, CSS and Javascript Coding Techniques 28 10-19-2007 04:36 AM
How do you return the top-N results of a query in Oracle? vadivelanvaidyanathan Database Support 2 08-07-2007 06:56 AM
Yahoo Answers With Results Joe Yahoo 4 03-20-2007 11:48 PM
Supplemental Results Joe Google 0 02-23-2007 05:45 AM
Supplemental Results Joe Google 1 02-21-2007 12:20 AM


All times are GMT -7. The time now is 12:14 PM.


Copyright ©2004 - 2007, DiscussWeb. All Rights Reserved.

SEO by vBSEO 3.0.0