Sponsored Content
Top Forums Shell Programming and Scripting awk, floating point and rounding Post 302488947 by fpmurphy on Wednesday 19th of January 2011 12:09:44 AM
Old 01-19-2011
The "error" is due to the default rounding.
Code:
BEGIN   {
        for (i=5; i < 7; i+=1) {
                printf "Pass %s...\n",i
                for (j = 0.0; j < (0.1*i); j = j + 0.1) {
                        printf "j=%.20f %.20f\n", j, .1*i;
                }
        }
exit
}

Code:
Pass 5...
j=0.00000000000000000000 0.50000000000000000000
j=0.10000000000000000555 0.50000000000000000000
j=0.20000000000000001110 0.50000000000000000000
j=0.30000000000000004441 0.50000000000000000000
j=0.40000000000000002220 0.50000000000000000000
Pass 6...
j=0.00000000000000000000 0.60000000000000008882
j=0.10000000000000000555 0.60000000000000008882
j=0.20000000000000001110 0.60000000000000008882
j=0.30000000000000004441 0.60000000000000008882
j=0.40000000000000002220 0.60000000000000008882
j=0.50000000000000000000 0.60000000000000008882
j=0.59999999999999997780 0.60000000000000008882

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Floating Point Division

Does anyone have a simple way of doing floating point ("fp") division? For example, if I divide 3 by 5, I can get 0.6. The built-in calc (`bc`) will perform fp multiplication, but not division, at least not straight-up (i.e., starting bc and just typing in 3/5). I am trying to do this using... (1 Reply)
Discussion started by: gsatch
1 Replies

2. Shell Programming and Scripting

problem with floating point numbers in awk

hi all, i have the following problem using awk in a script i want to read the values from a column with real numbers and calculate the mean.the problem is that when i use a statement such as this num = $4 i cant find a way to convert the variable from string to floating point to perform... (7 Replies)
Discussion started by: kanagias
7 Replies

3. Shell Programming and Scripting

floating point addition

hi, :) I have a file like this 10.456 123.567 456.876 234.987 ........ ....... What i want to do is ia have to add all those numbers and put the result in some other file. Any help pls. cheers RRK (8 Replies)
Discussion started by: ravi raj kumar
8 Replies

4. Shell Programming and Scripting

Replace floating-point by integer in awk

Hi, I am trying to write a script to extract multiple sets of data from a chemistry output file. The problem section is in the following format... Geometry "geometry" -> "geometry" 1 Pd 46.0000 -0.19290971 0.00535260 0.02297606 2 P ... (7 Replies)
Discussion started by: smadonald1
7 Replies

5. Shell Programming and Scripting

Rounding off the value of Floating point value

Hello, i have some variables say: x=1.4 y=3.7 I wish to round off these values to : x = 2 (after rounding off) y = 4 (after rounding off) I am stuck. Please help. (7 Replies)
Discussion started by: damansingh
7 Replies

6. Linux

Floating Point Exception

Hi, I am compiling "HelloWorld" C progam on 32-bit CentOS and i want to execute it on 64-bit CentOS architecture. For that i copied the a.out file from 32-bit to 64-bit machine, but while executing a.out file on 64bit machine I am getting "Floating point exception error". But we can run... (3 Replies)
Discussion started by: Mandar123
3 Replies

7. Shell Programming and Scripting

how to compare 2 floating point no.

Hi, Could any one tell me how to compare to floating point no. using test command. As -eq option works on only intergers. i=5.4 if then echo "equal" else echo "not equal" fi here output will be equal even though no. are unequal. Thanks, ravi (1 Reply)
Discussion started by: useless79
1 Replies

8. Shell Programming and Scripting

Arithmetic in floating point

is it not possible to simply di aritmetic without using bc or awk i have tried folllowing operatrions but they support only integer types plz suggest me code for floating using values stored in the variables.the ans i get is integer and if i input floating values i get error numeric constant... (6 Replies)
Discussion started by: sumit the cool
6 Replies

9. Programming

Floating Point

Anyone help me i cant found the error of floating point if needed, i added the code complete #include <stdio.h> #include <string.h> #include <stdlib.h> #include <ctype.h> typedef struct { int hh; int mm; int ss; char nom; int punt; }cancion; typedef struct... (9 Replies)
Discussion started by: Slasho
9 Replies

10. Shell Programming and Scripting

Rounding off to the nearest floating number

I have a number, which I want to convert into the nearest floating number upto two places after the decimal point. E.g. 1.2346 will become 1.23 but 1.2356 will become 1.24 . Similarly 0.009 will be 0.01 and 0.001 will be 0.00 or 0.0 (not 0, wnat to keep the decimal... (1 Reply)
Discussion started by: hbar
1 Replies
wml::std::tags(3)						     EN Tools							 wml::std::tags(3)

NAME
wml::std::tags - Standard Support Tags SYNOPSIS
#use wml::std::tags # Pass 2: advanced if constructs <ifdef varname thenval elseval> # Pass 3: support tag <perl> ... </perl> <say> ... </say> # Pass 4: support tag <m4> ... </m4> # Pass 4: symbols <symbol name value> <symbol name undef> # Pass 5: diversions <dump NAME> <enter NAME> ... <leave> <divert NAME> ... </divert> # Pass 6: support tag <asubst ...> ... </asubst> # Client-Side JavaScript: support tag <javascript [version=..] [language=..] [type=..] [src=...] [defer] [nohead] [nolang]> ... </javascript> # Resynchronize line numbers for more accurate pass 3 warnings <sync-lines> DESCRIPTION
This include file defines some standard support tags one needs all the time. All tags are self-explanatory and briefly mentioned in wml_intro(1), except the last two which are described below. "<javascript>": This tag was primarily a shorthand for "<script type="text/javascript" language="JavaScript">" but it has evolved. If the "<head>" tag is defined and is a complex macro, e.g. when calling "wml::std::page", then Javascript code is automatically passed to this macro and should be diverted to the HEAD section of HTML documents. This diversion preserve lang slices in multi-lingual documents. Those features may be disabled by the ``nohead'' and ``nolang'' attributes. "<sync-lines>": WML tries to print information on input file and line numbers when warnings or errors are reported in passes 2 and 3. Some special sentences containing file names and line numbers are inserted during pass 1. So pass 2 have an accurate knowledge of where warnings appear in input file. But it also filters it without preserving lines, so after pass 2 information is almost unusable. By putting "<sync-lines>" in input file, it forces pass 2 to resynchronize information on line numbers. So for debugging pass 3, it could be of some help to insert "<sync-lines>" before ePerl code. AUTHORS
Ralf S. Engelschall rse@engelschall.com www.engelschall.com Denis Barbier barbier@engelschall.com REQUIRES
Internal: P1, P2, P3, P4, P6 External: -- SEE ALSO
wml(1) EN Tools 2014-04-16 wml::std::tags(3)
All times are GMT -4. The time now is 03:05 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy