Shell Programming and Scripting

Hi all, i am writting a script to fix some problems we have with data that we need that contains 1000s of records. I have a text file with 3 columns of data. The problem is there should be a space between the end of the first column and the start of the second column. The majority of the data is ok. But as you can see for example 'ADD-SRY_NEES1202106-002' is all one and should have a space after the S and before the 1 the separate the columns of data.

The way I have approched the script is this. The text file data.text contains the data I want to sort out. A second text file called packagesList.txt contains all the possible names of the items in the left column. I go into a while read loop cat the file for each name, then use sed to find and replace with a space at the end.


while read packlist
do
echo $packlist

cat /root/data.txt | grep -w "$packlist" | sed ''s/"'$packlist'"/"$packlist" /'' >> /root/datadelimited.txt

done < /tmp/packagesList.txt

The problem is there is something wrong with the grep because names such as ADD-SRY_NEES and AL ALKGREENS are not being outputed to datadelimited.txt

Any ideas?

nawk -f border.awk packagesList.txt data.txt

border.awk:

Code:

FNR==NR { pack[$0]; next }
NF != 3 {
   for (i in pack)
    if (match($1, "^" i)) {
       $1 = substr($1, 1, RSTART+RLENGTH-1) OFS substr($1, RSTART+RLENGTH)
       break
    }
}
1

Hi vgersh that seems to work well. There is a problem however if the package contains a space e.g. AL ALKGREENS it does not match and doesnt put a space after?

Then you already have 3 fields - you're using space as a field separator - how would you distiguish fields with embedded spaces then?

thats the problem I have vgersh, some package names have spaces in them and the field separator is a space also. the file called packs.txt contains the names of the packages, is there not some way to do a regex that will match the names of the packs exactly?

how about this:

Code:

FNR==NR { pack[$0]; next }
{
   for (i in pack)
    if (match($0, "^" i) && !($1 in pack)) {
       $0 = substr($0, 1, RSTART+RLENGTH-1) OFS substr($0, RSTART+RLENGTH)
       break
    }
}
1

vgersh that works perfectly! your a genious