![]() |
On your OS X calculator app... - Printable Version +- MacResource (https://forums.macresource.com) +-- Forum: My Category (https://forums.macresource.com/forumdisplay.php?fid=1) +--- Forum: Tips and Deals (https://forums.macresource.com/forumdisplay.php?fid=3) +--- Thread: On your OS X calculator app... (/showthread.php?tid=32580) Pages:
1
2
|
On your OS X calculator app... - Greg the dogsitter - 05-03-2007 View >> Scientific Click or type "7" then "%." What do you see? GtDS Re: On your OS X calculator app... - M A V I C - 05-03-2007 0.07 woah, that's not what I see, but that's what copy & pastes... I actually see 0.07000000000000001 Re: On your OS X calculator app... - Greg the dogsitter - 05-03-2007 Okay; so it's not just me. Good! Re: On your OS X calculator app... - LaserKun - 05-03-2007 Huh? Re: On your OS X calculator app... - Greg the dogsitter - 05-03-2007 What MAVIC said! Re: On your OS X calculator app... - MacMagus - 05-03-2007 http://docs.sun.com/source/806-3568/ncg_goldberg.html Re: On your OS X calculator app... - morlock - 05-03-2007 Reminds me about the story behind the naming of the pentium chip. They had to change the format, because it was 286, 386, 486, but when they did the math, it came to 585.999999999971. ![]() ![]() Re: On your OS X calculator app... - M A V I C - 05-03-2007 [quote MacMagus]http://docs.sun.com/source/806-3568/ncg_goldberg.html *displays geek badge That's pretty cool. I knew that, but didn't know it, if you know what I mean. Re: On your OS X calculator app... - mikebw - 05-03-2007 ![]() "k and Ck, expand the definitions of sk and ck, ignoring all terms involving xi with i > 1 to get sk = (sk - 1 + yk)(1 + k) = [sk - 1 + (xk - ck - 1) (1 + k)](1 + k) = [(sk - 1 - ck - 1) - kck - 1](1+k) ck = [{sk - sk - 1}(1 + k) - yk](1 + k) = [{((sk - 1 - ck - 1) - kck - 1)(1 + k) - sk - 1}(1 + k) + ck - 1(1 + k)](1 + k) = [{(sk - 1 - ck - 1)k - kck-1(1 + k) - ck - 1}(1 + k) + ck - 1(1 + k)](1 + k) = [(sk - 1 - ck - 1)k(1 + k) - ck - 1(k + k(k + k + kk))](1 + k), sk - ck = ((sk - 1 - ck - 1) - kck - 1) (1 + k) - [(sk - 1 - ck - 1)k(1 + k) - ck - 1(k + k(k + k + kk)](1 + k) = (sk- 1 - ck - 1)((1 + k) - k(1 + k)(1 + k)) + ck - 1(-k(1 + k) + (k + k(k + k + kk)) (1 + k)) = (s- 1 - ck - 1) (1 - k(k + k + kk)) + ck - 1 - [k + k + k(k + kk) + (k + k(k + k + kk))k] " This is why I switched to graphic arts. Re: On your OS X calculator app... - MacMagus - 05-03-2007 Floating Point Math 102: a.k.a. Math for Graphic Artists Who Passed Math 101: http://www.regdeveloper.co.uk/2006/08/12/floating_point_approximation/ |