A lot of decimal in components attributes

c_jy · August 11, 2016, 4:52am

a lot of decimal in components attributes when with the formula

see the picture:

the attr cabtk =contxt(Pnlst,Top,Pnrst,Bottom+toeH1)

the attr pnlst =1.8cm

so the value supposed to be 1.8cm, but it shows 1.79999999999999

so what make it like that?

c_jy · August 11, 2016, 4:52am

pcmoor · September 9, 2016, 1:45pm

I believe that because the units for the program is in inches, the conversion to metric is a factor, perhaps rounding by an interger like 2 will give the result you are after

slbaumgartner · September 9, 2016, 2:08pm

That’s a typical example of finite-precision computer arithmetic. The value 1.8 has no exact representation in binary. 1.799999999… is as close as the computer can get. So unless the value is rounded for display, you will see all those trailing 9’s. However, they signify nothing unusual.