Hi all
When I loading a file from CSV to a table with real data type, I found that
a:“720.1”
“E”$a
It will save 720.0999756 instead of 720.1, Just to confirm, it is because memory of real is not precise enough to hold 720.1 so I enter live with it or I need to switch the column to float, right?
Regards
If you want to know the reason, see https://en.wikipedia.org/wiki/Floating_point#Representable_numbers.2C_conversion_and_rounding
If you just want to see “720.1” without the gory details, see http://code.kx.com/wiki/Reference/DisplayPrecision
Any suggested display precision for real datatype for view decimal properly for most case? .Q.fmt[8;4]?