Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Change numbers in flat file
Top Forums Shell Programming and Scripting Change numbers in flat file Post 302877222 by faka on Friday 29th of November 2013 12:13:23 PM
Old 11-29-2013
Quote:
Originally Posted by Don Cragun
Your latest set of revisions to the 1st message in this thread still has grossly inconsistent output. (Some lines have a trailing space; most do not. Some lines have two spaces as field separators; some have one space. The values in the Variables do not always match the corresponding field in your output file.

It looks like MadeInGermany's script captured most of the intent of your latest changes, but missed two points:
  1. You added a new line at the start of the desired output.
  2. Sometimes you want 5 digits after the decimal point in your output and sometimes you want 6.
The script below consistently only uses a single space as the field separator, does not add any trailing space, adds the new line you added as the first line of your output file, and adjusts the output to have the same number of digits after the decimal point as the longest input value for that line:
Code:
awk -v Variable='54.24425 35.24535  25.53231 24.24225 35.24535 28.350132' '
# dpm(v1, v2) returns the maximum number of digits after the decimal point in
#       the two given values.
function dpm(v1, v2,        n1, n2) {
        n1 = length(v1) - index(v1, ".")
        n2 = length(v2) - index(v2, ".")
        return(n1 > n2 ? n1 : n2)
}
BEGIN { split(Variable, vlist)
        print "New File generated"
}
NF > 2 { p = dpm(vlist[++v], $NF)
        $(NF + 1) = sprintf("%+.*f", p, vlist[v] - $NF)
        $(NF - 1) = vlist[v]
}
1' file1.text > file2.txt

The output it saves in file2.txt is when your latest sample input is in file1.text is:
Code:
New File generated
Data 1
Value One 54.24425 +29.99999
Value Two 35.24535 -10.00000
Other values in the list 25.53231 -59.71304

Data 2
Value One 24.24225 -20.00000
Value Two 35.24535 +10.00000
Other values of new 28.350132 -26.785328

Don thanks for your help, but I have some problems with the results of the code.
I have added data to the original question to don`t get wrong answers.
In the real example I have a mix of text data in the file and in some cases have one word, there it`s a problem to the script however in the other cases with more than one word works printing only the variable value, not the operation result.
original data
Code:
awk -v Variable='20.90000 21.45000 28.25000 29.35000 1.75000 2.75000 8.30000 9.80000 1.61140 1.66910 0.91310 0.89940 102.88000 101.40000 1.35200 1.36900 12.25710 7.60000 2.58430 2.13270 4508.34000 4318.94000 2.73230 2.73230 16097.33000 1219.47000 1219.47000' '
# dpm(v1, v2) returns the maximum number of digits after the decimal point in
#       the two given values.
function dpm(v1, v2,        n1, n2) {
        n1 = length(v1) - index(v1, ".")
        n2 = length(v2) - index(v2, ".")
        return(n1 > n2 ? n1 : n2)
}
BEGIN { split(Variable, vlist)
        print "New File generated"
}
NF > 2 { p = dpm(vlist[++v], $NF)
        $(NF + 1) = sprintf("%+.*f", p, vlist[v] - $NF)
        $(NF - 1) = vlist[v]
}
1' file1 > file2

file 1
Code:
Values
Data 20.90000
Data1 21.45000
Value 1
Data 28.25000
Data1 29.35000
Value 2
Data 1.75000
Data1 2.75000
Value 3
Data1 8.30000
Data2 9.80000
Values data text in the text with in
Data1 1.61140
Data2  1.66910
Values text in the text
Data1 0.91310
Data2 0.89940
Data in the text
Data1 102.88000
Data2 101.40000
Data in the example
Data1 1.35200
Data2 1.36900
Text example data with text
Data1 12.25710
Data2 7.60000
Data with text
Data1 2.58430
Data2 2.13270
Data of the text
Data1 4508.34000
Data2 4318.94000
Values in data
Data1 2.73300
Data2 2.73300
Data in the text
Data1
Data2 16097.33000
Data in all text
Data1 1219.47000
Data2 1219.47000

Result of the script
Code:
Values
Data 20.90000
Data1 21.45000
Value 1
Data 28.25000
Data1 29.35000
Value 2
Data 1.75000
Data1 2.75000
Value 3
Data1 8.30000
Data2 9.80000
Values data text in the text with 20.90000 +20.90000
Data1 1.61140
Data2  1.66910
Values text in the 21.45000 +21.45000
Data1 0.91310
Data2 0.89940
Data in the 28.25000 +28.25000
Data1 102.88000
Data2 101.40000
Data in the 29.35000 +29.3500000
Data1 1.35200
Data2 1.36900
Text example data with 1.75000 +1.75000
Data1 12.25710
Data2 7.60000
Data with 2.75000 +2.75000
Data1 2.58430
Data2 2.13270
Data of the 8.30000 +8.30000
Data1 4508.34000
Data2 4318.94000
Values in 9.80000 +9.80000
Data1 2.73300
Data2 2.73300
Data in the 1.61140 +1.61140
Data1
Data2 16097.33000
Data in all 1.66910 +1.66910
Data1 1219.47000
Data2 1219.47000

Update: I haved modified the original source of your code and I get some differences.
Code:
awk -v Variable='20.90000 21.45000 28.25000 29.35000 1.75000 2.75000 8.30000 9.80000 1.61140 1.66910 0.91310 0.89940 102.88000 101.40000 1.35200 1.36900 12.25710 7.60000 2.58430 2.13270 4508.34000 4318.94000 2.73230 2.73230 16097.33000 1219.47000 1219.47000' '
# dpm(v1, v2) returns the maximum number of digits after the decimal point in
#       the two given values.
function dpm(v1, v2,        n1, n2) {
        n1 = length(v1) - index(v1, ".")
        n2 = length(v2) - index(v2, ".")
        return(n1 > n2 ? n1 : n2)
}
BEGIN { split(Variable, vlist)
        print "New File generated"
}
NF > 1 { p = dpm(vlist[++v], $NF)
        $(NF + 1) = sprintf("%+.*f", p, vlist[v] - $NF)
        $(NF - 1) = vlist[v]
}
1' file1 > file2

result file
Code:
Values
Data 20.90000 +0.00000
Data1 21.45000 +0.00000
Value 28.25000 +27.25000
Data 29.35000 +1.10000
Data1 1.75000 -27.60000
Value 2.75000 +0.75000
Data 8.30000 +6.55000
Data1 9.80000 +7.05000
Value 1.61140 -1.38860
Data1 1.66910 -6.63090
Data2 0.91310 -8.88690
Values data text in the text with 0.89940 +0.89940
Data1 102.88000 +101.26860
Data2 101.40000 +99.73090
Values text in the 1.35200 +1.35200
Data1 1.36900 +0.45590
Data2 12.25710 +11.35770
Data in the 7.60000 +7.60000
Data1 2.58430 -100.29570
Data2 2.13270 -99.26730
Data in the 4508.34000 +4508.3400000
Data1 4318.94000 +4317.58800
Data2 2.73230 +1.36330
Text example data with 2.73230 +2.73230
Data1 16097.33000 +16085.07290
Data2 1219.47000 +1211.87000
Data with 1219.47000 +1219.47000
Data1  -2.58430
Data2  -2.13270
Data of the  +0.0000
Data1  -4508.34000
Data2  -4318.94000
Values in  +0.0000
Data1  -2.73300
Data2  -2.73300
Data in the  +0.0000
Data1
Data2  -16097.33000
Data in all  +0.0000
Data1  -1219.47000
Data2  -1219.47000

Update 2: I haved update the file1 to replace the space separator inter words with one _ and I get the right value in the output, how I can change the code to accept the space separator between words without limit of words before the number?
Thanks again

---------- Post updated at 03:13 PM ---------- Previous update was at 09:39 AM ----------

Another Problem
Im trying to get the variable value from an assignation of a cat of a file and I cant get the values inside the variable.
In awk -v Variable='value' where value cant load from
I have the variable with the values: example $NUMBERS='20.90000 21.45000 28.25000 29.35000 1.75000 2.75000 8.30000 9.80000 1.61520 1.67080 0.91100 0.89800 103.11000 101.58000 1.35140 1.36840 12.04630 7.73540 2.58430 2.13270 4517.90000 4325.33000 2.73300 2.73300 16097.33000 1225.98000 1225.98000'
If I add $NUMBERS to Variable='$NUMBERS' I get a problem I don`t know why.
If I do echo $NUMBERS I get in STDOUT the correct values.

Thanks in advance
Last edited by faka; 11-29-2013 at 01:14 PM.. Reason: Update
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

script to change filename with numbers

ok, this one is definitely too hard for my shell-script-skills. Hopefully, there is somebody who can help me with this: I have a folder with files in it named 0.ppm 10.ppm 2.ppm ... 5.ppm 50.ppm 55.ppm ... 355.ppm 360.ppm etc. As you will notice, the order in which the files are... (5 Replies)
Discussion started by: silversurfer202
5 Replies

2. AIX

how do I change major-minor numbers of disk devices

Good evening ... does anyone of you know how to change major/minor numbers of disk devices ? I had to migrate from raid1 to raid5 and this messed up my ASM cluster - I know which devices should have which IDs to match the content - but I have no idea how to change it. Any help would be... (2 Replies)
Discussion started by: zxmaus
2 Replies

3. Shell Programming and Scripting

read numbers from file and output which numbers belongs to which range

Howdy experts, We have some ranges of number which belongs to particual group as below. GroupNo StartRange EndRange Group0125 935300 935399 Group2006 935400 935476 937430 937459 Group0324 935477 935549 ... (6 Replies)
Discussion started by: thepurple
6 Replies

4. Shell Programming and Scripting

Change numbers in a file, incrementing them

Hello, Here's a file of mine: key1:431 key2:159 key3:998 I need to change these keys to something bigger - and I actually need to shift them all by a range of 3. The output would be: key1:434 key2:162 key3:1001 I can't find the propper sed/awk line that would alter all my... (4 Replies)
Discussion started by: fzd
4 Replies

5. Shell Programming and Scripting

Regarding change in column numbers after some commands

Hi All, I was using some commands to: replace a column by a constant string character awk -v a=CA 'NF>1{ $3=a; print; } ' $line>$line"_1" to copy a column and paste it in another place awk '$5=$2" "$5' $line>$line"_2" to delete the extra columns awk '{for(i=1;i<=NF;i++)... (9 Replies)
Discussion started by: CAch
9 Replies

6. Shell Programming and Scripting

How to change the format of the date column in a flat file?

Hi, i have a flat file namely temp.txt with this data below ID|name|contact_date 101|Kay|2013-12-26 102|let|2013-12-26 I need to modify the date data in the flat file into MM/DD/YYYY HH24:MI:SS format let me know the code for this. Thank you! (5 Replies)
Discussion started by: srikanth_sagi
5 Replies

7. Shell Programming and Scripting

Trying to take file numbers from a file, pass them to sed to change strings in corresponding lines

I have a bunch of file numbers in the file 'test': I'm trying the above command to change all the instances of "H" to "Na+" in the file testsds.pdb at the line numbers indicated in the file 'test'. I've tried the following and various similar alternatives but nothing is working: cat test |... (3 Replies)
Discussion started by: crunchgargoyle
3 Replies

8. Shell Programming and Scripting

Adding (as in arithmetic) to numbers in columns in file, and writing new file with new numbers

Hi again. Sorry for all the questions — I've tried to do all this myself but I'm just not good enough yet, and the help I've received so far from bartus11 has been absolutely invaluable. Hopefully this will be the last bit of file manipulation I need to do. I have a file which is formatted as... (4 Replies)
Discussion started by: crunchgargoyle
4 Replies

9. Shell Programming and Scripting

Change the numbers

Hi friends, i need a command which can be used to change the values in file. I have file which contain some values. Data_Center_costing=XXXX Financial_loss=XXXX operational_cost=XXX I am not aware about the values of XXXX, They may be 4 digit or less/more than that. but i need these... (12 Replies)
Discussion started by: Nakul_sh
12 Replies

10. Shell Programming and Scripting

Change numbers

Hallo This is the content of the file 3 4 5 6 7 8 9 10 11 12 And I want the following output 1 2 3 4 5 6 7 (4 Replies)
Discussion started by: thailand
4 Replies
All times are GMT -4. The time now is 08:36 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy