Today (Saturday) We will make some minor tuning adjustments to MySQL.

You may experience 2 up to 10 seconds "glitch time" when we restart MySQL. We expect to make these adjustments around 1AM Eastern Daylight Saving Time (EDT) US.


Inserting a field without disturbing field separator on other fields


Login or Register to Reply

 
Thread Tools Search this Thread
# 1  
Inserting a field without disturbing field separator on other fields

Hi All,

I have the input as below:

Code:
cat input
032016002  2.891 97.109 16.605 27.172 24.017 32.207  0.233  0.021 39.810  0.077  0.026 19.644 13.882  0.131 11.646  0.102 11.449 76.265 23.735 16.991 83.009  8.840 91.160  0.020 99.980 52.102 47.898 44.004 55.996 39.963 18.625  0.121  1.126 40.189 91.289  2.822  0.317  5.571

I need to add a value at 19th field without disturbing the field separator between the fields.

The field separator in my input is space. and each field contains 6 positions in it except the first field.

Now the value i need to add at 19th field is below:

Code:
cat bb
 2.979

My output should look like below:

Code:
cat output
032016002  2.891 97.109 16.605 27.172 24.017 32.207  0.233  0.021 39.810  0.077  0.026 19.644 13.882  0.131 11.646  0.102 11.449  2.979 76.265 23.735 16.991 83.009  8.840 91.160  0.020 99.980 52.102 47.898 44.004 55.996 39.963 18.625  0.121  1.126 40.189 91.289  2.822  0.317  5.571

I have tried the below codes:

Code:
nawk 'NR==FNR{A[FNR]=$0; next} {$19=A[FNR] OFS $19}1' bb input > op

nawk '(getline p<f)>0{$19=p OFS $19}1' f=bb input > op2

I have got the same output from the above two codes as below:

Code:
cat op
032016002 2.891 97.109 16.605 27.172 24.017 32.207 0.233 0.021 39.810 0.077 0.026 19.644 13.882 0.131 11.646 0.102 11.449  2.979 76.265 23.735 16.991 83.009 8.840 91.160 0.020 99.980 52.102 47.898 44.004 55.996 39.963 18.625 0.121 1.126 40.189 91.289 2.822 0.317 5.571

Here in the above output, if we observe,the bb value got inserted at 19th field in the input file. But the spaces got removed from the fields which contains a combination of blank space and values.
For ex:- see field2. field2 = 2.891 but after inserting bb value the leading blank space at field2 got removed. Likewise blankspaces got removed in other fields as well.

Any idea how to overcome this ?

Thanks in advance,
am24
# 2  
Is that one of your fixed field width files again? Then you shouldn't say the field separator is space...
Your problem is (man awk: )
Quote:
Assignment to NF or to a field causes $0 to be reconstructed by concatenating the $i's separated by OFS
Try adapting the method to copy the line into an array, then add the array element to be inserted, and print the array using a fixed width format.
This User Gave Thanks to RudiC For This Post:
# 3  
Hi Rudi,

Thanks for the reply. I will try on this and will let you know.

Regards,
am24

---------- Post updated 05-12-16 at 02:52 AM ---------- Previous update was 05-11-16 at 03:52 AM ----------

Hi Rudi,

I have tried the below code.

Code:
nawk '
              {CNF = (length()-10)/7
               printf "%9s", substr ($0,1,9)
               for (i=0;i<=CNF;i++) T[i+2] = substr ($0, 10+i*7, 7)
               T[19] = 2.979
               for (i=2; i<=CNF+2; i++) printf "%7s", T[i]
               printf RS
              }
       ' input > ruop

with the above code, i can keep the 19th field value as 2.979 and the field width also adjusted properly. But the problem is the original value of 19th field in my input 76.265 is getting removed. Al other field values are coming correctly.

I just need to insert 2.979 in 19th filed but i should not remove any other field values. How can i overcome this ?

Could you please help me on this ?

Thanks in advance,
am24
# 4  
You can modify your for loop as below.
Code:
for (i=2; i<=CNF+2; i++) {printf "%7s", T[i]; if ( i == 19) {printf "%7s", "2.979"}}

This User Gave Thanks to pravin27 For This Post:
# 5  
Hi pravin27,

Thanks for the reply. I have modified the loop as you suggested. In the output , 2.979 placed in 20th field and 76.265 placed in 19th field.

So i just modified as below:

Code:
for (i=2; i<=CNF+2; i++) {printf "%7s", T[i]; if ( i == 18) {printf "%7s", " 2.979"}}

Now the value 2.979 is placed in 19th field and 76.265 in 20th field. and all other fields placed correctly.

Also i have question that , if 2.979 value is stored in one variable, then can i assign it to T[19] ?

Reason for this is, the 2.979 is not constant value, i am taking the value from some other file. So if i pull out the value from the file and store it in one variable then can i assign the variable value to array element ?

I have tried something on this but did not get the proper result.

Thanks in advance,
am24
# 6  
You want to insert that value, i.e. it will be $19, $19 will become $20, etc.? Then you need to shove every single value one index back. Like for (i=CNF; i>18; i--) $(i+1) = $i.

IF there's NO empty fields in your file, you could extend the 19th field like $19 = 2.979 " " $19, and then split $0 into T for formatted output.


EDIT: Of course you can use a variable for the value to be inserted: $19 = var " " $19! But - it needs to be an awk variable, NOT a shell variable.
This User Gave Thanks to RudiC For This Post:
# 7  
Thanks Rudi,

I will try on this and will let you know.

Regards,
am24

---------- Post updated 05-13-16 at 02:12 AM ---------- Previous update was 05-12-16 at 03:30 AM ----------

Hi Rudi,

I have tried different ways to assign variable value to array element but i did not succeed in this. for ex see the below:

Code:
nawk '{print " " $NF}' line2 > nawk6
a="/export/home/batham51/radio/nawk6"
     
     
      nawk -v '
              var="$a"
              {CNF = (length()-10)/7
              printf "%9s", substr ($0,1,9)
              for (i=0;i<=CNF;i++) T[i+2] = substr ($0, 10+i*7, 7)
              for (i=2; i<=CNF+2; i++){printf "%7s", T[i]; if( i == 18){printf "%7s", var }}
              printf RS
             }
      ' input > ruop

Can you please help me with this ?

Code:
cat nawk6
 2.979

Code:
cat input
032016002  2.891 97.109 16.605 27.172 24.017 32.207  0.233  0.021 39.810  0.077  0.026 19.644 13.882  0.131 11.646  0.102 11.449 76.265 23.735 16.991 83.009  8.840 91.160  0.020 99.980 52.102 47.898 44.004 55.996 39.963 18.625  0.121  1.126 40.189 91.289  2.822  0.317  5.571

I need to insert nawk6 value at 19th field in my input

Thanks in advance,
am24
Login or Register to Reply

|
Thread Tools Search this Thread
Search this Thread:
Advanced Search

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Field separator

Hello All, I have a file, but I want to separate the file at a particular record with comma"," in the line Input file APPLE6SSAMSUNGS5PRICEPERPIECEDOLLAR600EACH010020340URX581949695US to Output file APPLE6S,SAMSUNGS5,PRICEPERPIECE,DOLLAR600EACH,010020340URX581949695,US This is for... (11 Replies)
Discussion started by: m6248m
11 Replies

2. UNIX for Dummies Questions & Answers

change field separator only from nth field until NF

Hi ! input: 111|222|333|aaa|bbb|ccc 999|888|777|nnn|kkk 444|666|555|eee|ttt|ooo|ppp With awk, I am trying to change the FS "|" to "; " only from the 4th field until the end (the number of fields vary between records). In order to get: 111|222|333|aaa; bbb; ccc 999|888|777|nnn; kkk... (1 Reply)
Discussion started by: beca123456
1 Replies

3. Shell Programming and Scripting

Strings as Field separator

Hi, How i can use two strings as field separator.. I want to use filed separator's as &lt; and &gt; input - shdhd ads&lt;adsd adfs &gt;sdfsd sfsdfsd&lt; Please help me in this..:wall: thanks a lot... (3 Replies)
Discussion started by: pamu
3 Replies

4. Shell Programming and Scripting

Inserting a new field inbetween two exisitng field

I have a '|' delimited file. My file looks like below 23|nationalhoilday|feb12||||||||||||||california|northdistrict|| In the same way, each record has 164 fields. I have to insert one more field after the 85th field. Expected output... (3 Replies)
Discussion started by: machomaddy
3 Replies

5. Shell Programming and Scripting

Field separator X'1F'

Hi, I have a flat file with fields separated by a X'1F' i have to fetch 4th field from second line. please help me how to achieve it. I tried with below command and its not working. cut -f4 -d`echo -e '\x1f'` filename.txt I am using SunOS. Thanks in advance. (2 Replies)
Discussion started by: rohan10k
2 Replies

6. Shell Programming and Scripting

awk, comma as field separator and text inside double quotes as a field.

Hi, all I need to get fields in a line that are separated by commas, some of the fields are enclosed with double quotes, and they are supposed to be treated as a single field even if there are commas inside the quotes. sample input: for this line, 5 fields are supposed to be extracted, they... (8 Replies)
Discussion started by: kevintse
8 Replies

7. Shell Programming and Scripting

Sorting on two fields time field and number field

Hi, I have a file that has data in it that says 00:01:48.233 1212 00:01:56.233 345 00:09:01.221 5678 00:12:23.321 93444 The file has more line than this but i just wanted to put in a snippet to ask how I would get the highest number with time stamp into another file. So from the above... (2 Replies)
Discussion started by: pat4519
2 Replies

8. Shell Programming and Scripting

field separator in Perl

is there a similar parameter you can set in perl like FS in awk? I think I've read all the tutorials on the subject, but cannot get this map split and so on thing to work. I need to sort a file by columns, eg. first, third, fifth... The script I need to add this column sorting is this: use... (38 Replies)
Discussion started by: ahsog
38 Replies

9. Shell Programming and Scripting

field separator as regexp

I have some version of AWK that does not support regular expression field separators ( neither do I have nawk or gawk). How do I go about reading a line with the field separator as either the string "=#" or "+=". My data looks like this: abhishek=#nnnnn+#1234+#87 One option is to use... (2 Replies)
Discussion started by: Abhishek Ghose
2 Replies

10. Shell Programming and Scripting

how to include field separator if there are blank fields?

Hi, I have the following data in the format as shown (note: there are more than 1 blank spaces between each field and the spaces are not uniform, meaning there can be one blank space between field1 and field2 and 3 spaces between field3 and field4, in this example, # are the spaces in between... (19 Replies)
Discussion started by: ReV
19 Replies

Featured Tech Videos