## precision getting?

precision getting?
# 1
10-10-2001
precision getting?

I need to find out the precision on a solaris machine using the unix terminal.
How do I find this out?

Specifics needed:
How are single precision numbers represented (8 or 16 bit)
How are double precision numbers represented (16 or 32 bit)
How are they stored. ( some computers store numbers with more bits than they print out)

Any help would be greatly appreciated.

TF
 Townsfolk View Public Profile for Townsfolk Find all posts by Townsfolk
# 2
10-10-2001
Sun uses IEEE standard floating point numbers. Standard Precision is 32 bits and double precision is 64 bits. There is also long double which is 128 bits on a sparc but only 80 bits if solaris is running on an intel.

 Perderabo View Public Profile for Perderabo Find all posts by Perderabo

## How to get defined precision after arithmetic operation using syncsort?

I have to do some arithmetic operation on Field 8 which is calculated by Field 9/Field 7 Suppose i have data like : 0800123456|JAN|2017|JAN|2018|0800123456|0|0.0000|0.00| 0800234567|JAN|2017|JAN|2018|0800234567|4|2.5812|10.32| 0800666666|JAN|2017|JAN|2018|0800666666|2|1.7255|3.45|...

## Precision in print

I have a shell script which prints a variable to a text file (sorry if this is the wrong terminology, I'm new to this): awk `{sumdiffsqt+=\$1;stdevt=sqrt(sumdiffsqt/('\${n}'-1));errt=stdevt/sqrt('\${n}')} END {print '\$period',stdevt,errt}' diffsqt.txt >> \${xstation1}_\${xstation2}_tt.err I need...

## Get timestamp with millisecond precision

Hi All, could any body let me know. how to get timestamp with millisecond precision in unix bash shell. example -->2005-12-06- 4-22-35-195 please help me. Thanks, Krupa:wall:

## change precision of bash variable

I have a variable in a bash script, DISTANCE=`awk 'BEGIN {FS="\t"} {if (NR==2) print \$3;}' \$OUTFILE` this is a real number taken from a file. The value are like, 0.334561754018 I am using this value in a file name, '\$NAME'_'\$DISTANCE'.txt I would like to shorten the number some to...

## Double-precision result (awk)

hi, I am a new awk user, now i want to change my result from 1 ca 0.2057422D-01 -0.7179106D-02 -0.5600872D-02 2 o 0.2463722D-01 -0.1554542D-01 0.3110649D-01 3 h -0.1068047D-01 0.1016889D-01 -0.4088230D-02 to 1 ca 0.02057422 -0.007179106 -0.005600872 2 o 0.02463722 -0.01554542 ...

## Count the decimal numbers with 6 precision

Hi guys, I have a single column file with millions of records. I want to count the number of records with 6 decimal precision. for ex: 1234.12 1234.132 12345.12345 1234.1 1234.13 1234.123456 243435.454555 i need to count the number of records with precision of 6 ( i.e here the...

## unix diff with numerical precision

Hi, I search a unix utility to diff two files, that takes as argument numerical precision as well. If two files are different only in numbers and the difference is less than precision then the result as they are the same. The precision may be absolute (x1-x2) or relative (x2/x1). Also I need the...

## max precision in float

Hi, As all of us know that size of int is machine as well as compiler dependent we can get the range and size of an int , float and char etc in /usr/include/limits.h header file of a compiler but could any one tell me how to get info of precision of float and ...

## GMP multi precision math library

Hello all, I'm having trouble building the GNU Multi Precision (GMP 4.1.3) on the HP Intel Itanium 2 HP-UX 11i I'm hoping someone out there has had some experience building GMP on this platform. After running the ./configure and doing a make I get an error saying: `.rodata` is not a section ...

## bc arbitrary precision cal lang

Hello all, I don't know ksh that well but when I try to run a simple script using the bc command I get "unexpected '.' ", has any one encouter this or help me. I'm running under redaht 7.2. Here is a simple example: #!/bin/ksh # kilo=`echo "2495 * .25"|bc` if then echo "LESS THEN"...