Sponsored Content
Top Forums Shell Programming and Scripting printf (awk,perl,shell) float rounding issue Post 302715363 by Corona688 on Sunday 14th of October 2012 06:02:01 PM
Old 10-14-2012
Quote:
Originally Posted by Don Cragun
On the machines most of us work on, floating point numbers are represented as x*2^y or x*16^y rather than x*10^y
I know how it works. It wasn't too relevant to the example. The point is it uses an exponent, it's not stored literally.
Quote:
but .5 is exactly representable in any of them.
0.5 is. Anything else .5 depends.
Quote:
As pointed out by Scrutinizer, the real answer lies in the rounding mode being used by whatever function is converting the internal floating point value to a printable decimal representation of that value.
Yes, which I pointed out most generally don't. ksh93 would be an exception.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Float and Double in Perl

HI! What is the notation which correspond to C's doubleandfloatin Perl?? Please tell me. Thanks. Well what I want to do is, for example, calculatingsqrt(2)in two way: float and double. (5 Replies)
Discussion started by: Euler04
5 Replies

2. UNIX for Dummies Questions & Answers

Annoying rounding issue in awk

Hello I am getting this very annoying issue in awk: awk '{a=12825;b=a*1.25; print b}' test 16031.2 Thing is the multiplication result is wrong... Result should be 16031.25. I think the issue only happens on bigger numbers. What can I do to get passed this? Thanks by advance (3 Replies)
Discussion started by: Indalecio
3 Replies

3. Shell Programming and Scripting

Rounding off decimals to the nearest number in PERL

Hi Guys, I am generating a statistical report , below is the snippet of the code : Now, $nSlices stands for the time duration,meaning,the statistics will be displayed for that particular time duration. Trouble is, for certain values of $totalTime (which is the end time - start time ), i... (9 Replies)
Discussion started by: rdlover
9 Replies

4. Shell Programming and Scripting

How to format the output using float in awk{printf}

Hi I'm using awk to manipulate the data in the 6th field of the file xxx_yyy.hrv. The sample data that is available in this field is given below 220731.7100000000000000 When i tried using this command cat xxx_yyy.hrv | awk '{printf("%23.16f\n",$6*-1)}' I get the output as... (4 Replies)
Discussion started by: angelarosh
4 Replies

5. Shell Programming and Scripting

Rounding issue with awk

Hi Friends, I am trying to round following number. 0.07435000 echo "0.07435000"|awk '{printf "%s\n",$1*100}'|awk '{printf "%.2f\n",$1}' It returns: 7.435 It should return: 7.44 Any suggestion please? Thanks, Prashant (2 Replies)
Discussion started by: ppat7046
2 Replies

6. Shell Programming and Scripting

rounding time in perl

Is there a way I can round time in perl to the nearest five minutes? For example if I have log giving the following time stamps 23,52,30 it would rounded up to 23,55,00 and 23,50,01 would be rounded to 23,50,00 (3 Replies)
Discussion started by: borderblaster
3 Replies

7. Shell Programming and Scripting

AWK rounding up numbers

Hi, I have managed to round up numbers by using the following command: echo "5.54" | awk '{printf "%.0f\n", $1}' result 6 How can I round up all the numbers in a column in a file and print the lines with the new calculated totals? Thanks, (3 Replies)
Discussion started by: keenboy100
3 Replies

8. Shell Programming and Scripting

PERL - rounding fractional number

It seems that perl sprintf uses the round-to-even method: foreach my $i ( 0.5, 1.5, 2.5, 3.5 ) { printf "$i -> %.0f\n", $i; } __END__ 0.5 -> 0 1.5 -> 2 2.5 -> 2 3.5 -> 4 4.5 -> 4 Where we probably wants to use round-half-up, i.e. output should be as below: 0.5 -> 1 1.5 -> 2... (8 Replies)
Discussion started by: ganapati
8 Replies

9. UNIX for Dummies Questions & Answers

How to restrict Rounding using Printf?

Hello, I am using bash shell on Linux OS, May i please know why is it rounding for big numbers but not for others, is there a workaround to print it as it is with out round off? printf '%'\''.2f\n' 9999999999999999999.99 10,000,000,000,000,000,000.00 printf '%'\''.2f\n' 99999999999999.99... (1 Reply)
Discussion started by: Ariean
1 Replies

10. Shell Programming and Scripting

[awk] rounding a float number?

Heyas Trying to calculate the total size of a file by reading its bitrate. Code snippet: fs_expected() { # # Returns the expected filesize in bytes # pr_str() { ff=$(cat $TMP.info) d="${ff#*bitrate: }" echo "${d%%,*}" | $AWK '{print $1}' | head -n 1 } t_BYTERATE=$((... (9 Replies)
Discussion started by: sea
9 Replies
float.h(3HEAD)							      Headers							    float.h(3HEAD)

NAME
float.h, float - floating types SYNOPSIS
#include <float.h> DESCRIPTION
The characteristics of floating types are defined in terms of a model that describes a representation of floating-point numbers and values that provide information about an implementation's floating-point arithmetic. The following parameters are used to define the model for each floating-point type: s sign (+-1) b base or radix of exponent representation (an integer >1) e exponent (an integer between a minimum emin and a maximum emax) p precision (the number of base-b digits in the significand) fk non-negative integers less than b (the significand digits) In addition to normalized floating-point numbers (f1>0 if x!=0), floating types might be able to contain other kinds of floating-point num- bers, such as subnormal floating-point numbers (x!=0, e=emin, f1=0) and unnormalized floating-point numbers (x!=0, e=emin, f1=0), and val- ues that are not floating-point numbers, such as infinities and NaNs. A NaN is an encoding signifying Not-a-Number. A quiet NaN propagates through almost every arithmetic operation without raising a floating-point exception; a signaling NaN generally raises a floating-point exception when occurring as an arithmetic operand. The accuracy of the library functions in math.h(3HEAD) and complex.h(3HEAD) that return floating-point results is defined on the libm(3LIB) manual page. All integer values in the <float.h> header, except FLT_ROUNDS, are constant expressions suitable for use in #if preprocessing directives; all floating values are constant expressions. All except DECIMAL_DIG, FLT_EVAL_METHOD, FLT_RADIX, and FLT_ROUNDS have separate names for all three floating-point types. The floating-point model representation is provided for all values except FLT_EVAL_METHOD and FLT_ROUNDS. The rounding mode for floating-point addition is characterized by the value of FLT_ROUNDS: -1 Indeterminable. 0 Toward zero. 1 To nearest. 2 Toward positive infinity. 3 Toward negative infinity. The values of operations with floating operands and values subject to the usual arithmetic conversions and of floating constants are evalu- ated to a format whose range and precision might be greater than required by the type. The use of evaluation formats is characterized by the architecture-dependent value of FLT_EVAL_METHOD: -1 Indeterminable. 0 Evaluate all operations and constants just to the range and precision of the type. 1 Evaluate operations and constants of type float and double to the range and precision of the double type; evaluate long double operations and constants to the range and precision of the long double type. 2 Evaluate all operations and constants to the range and precision of the long double type. The values given in the following list are defined as constants. o Radix of exponent representation, b. FLT_RADIX o Number of base-FLT_RADIX digits in the floating-point significand, p. FLT_MANT_DIG DBL_MANT_DIG LDBL_MANT_DIG o Number of decimal digits, n, such that any floating-point number in the widest supported floating type with pmax radix b digits can be rounded to a floating-point number with n decimal digits and back again without change to the value. DECIMAL_DIG o Number of decimal digits, q, such that any floating-point number with q decimal digits can be rounded into a floating-point number with p radix b digits and back again without change to the q decimal digits. FLT_DIG DBL_DIG LDBL_DIG o Minimum negative integer such that FLT_RADIX raised to that power minus 1 is a normalized floating-point number, emin. FLT_MIN_EXP DBL_MIN_EXP LDBL_MIN_EXP o Minimum negative integer such that 10 raised to that power is in the range of normalized floating-point numbers. FLT_MIN_10_EXP DBL_MIN_10_EXP LDBL_MIN_10_EXP o Maximum integer such that FLT_RADIX raised to that power minus 1 is a representable finite floating-point number, emax. FLT_MAX_EXP DBL_MAX_EXP LDBL_MAX_EXP o Maximum integer such that 10 raised to that power is in the range of representable finite floating-point numbers. FLT_MAX_10_EXP DBL_MAX_10_EXP LDBL_MAX_10_EXP The values given in the following list are defined as constant expressions with values that are greater than or equal to those shown: o Maximum representable finite floating-point number. FLT_MAX DBL_MAX LDBL_MAX The values given in the following list are defined as constant expressions with implementation-defined (positive) values that are less than or equal to those shown: o The difference between 1 and the least value greater than 1 that is representable in the given floating-point type, b**1 - p. FLT_EPSILON DBL_EPSILON LDBL_EPSILON o Minimum normalized positive floating-point number, b**emin**-. FLT_MIN DBL_MIN LDBL_MIN ATTRIBUTES
See attributes(5) for descriptions of the following attributes: +-----------------------------+-----------------------------+ | ATTRIBUTE TYPE | ATTRIBUTE VALUE | +-----------------------------+-----------------------------+ |Interface Stability |Standard | +-----------------------------+-----------------------------+ SEE ALSO
complex.h(3HEAD), math.h(3HEAD), attributes(5), standards(5) SunOS 5.10 17 Dec 2003 float.h(3HEAD)
All times are GMT -4. The time now is 05:48 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy