On your OS X calculator app...

[Greg the dogsitter]

View >> Scientific

Click or type "7" then "%." What do you see?

GtDS

[M A V I C]

0.07

woah, that's not what I see, but that's what copy & pastes...

I actually see 0.07000000000000001

[Greg the dogsitter]

Okay; so it's not just me. Good!

[LaserKun]

Huh?

[Greg the dogsitter]

What MAVIC said!

[MacMagus]

http://docs.sun.com/source/806-3568/ncg_goldberg.html

[morlock]

Reminds me about the story behind the naming of the pentium chip. They had to change the format, because it was 286, 386, 486, but when they did the math, it came to 585.999999999971.

[M A V I C]

[quote MacMagus]http://docs.sun.com/source/806-3568/ncg_goldberg.html
*displays geek badge

That's pretty cool. I knew that, but didn't know it, if you know what I mean.

[mikebw]

"k and Ck, expand the definitions of sk and ck, ignoring all terms involving xi with i > 1 to get

sk = (sk - 1 + yk)(1 + k)
= [sk - 1 + (xk - ck - 1) (1 + k)](1 + k)
= [(sk - 1 - ck - 1) - kck - 1](1+k)
ck = [{sk - sk - 1}(1 + k) - yk](1 + k)
= [{((sk - 1 - ck - 1) - kck - 1)(1 + k) - sk - 1}(1 + k) + ck - 1(1 + k)](1 + k)
= [{(sk - 1 - ck - 1)k - kck-1(1 + k) - ck - 1}(1 + k) + ck - 1(1 + k)](1 + k)
= [(sk - 1 - ck - 1)k(1 + k) - ck - 1(k + k(k + k + kk))](1 + k),
sk - ck = ((sk - 1 - ck - 1) - kck - 1) (1 + k)
- [(sk - 1 - ck - 1)k(1 + k) - ck - 1(k + k(k + k + kk)](1 + k)
= (sk- 1 - ck - 1)((1 + k) - k(1 + k)(1 + k))
+ ck - 1(-k(1 + k) + (k + k(k + k + kk)) (1 + k))
= (s- 1 - ck - 1) (1 - k(k + k + kk))
+ ck - 1 - [k + k + k(k + kk) + (k + k(k + k + kk))k] "

This is why I switched to graphic arts.

[MacMagus]

Floating Point Math 102: a.k.a. Math for Graphic Artists Who Passed Math 101:
http://www.regdeveloper.co.uk/2006/08/12...oximation/