UNIX for Dummies Questions & Answers

Hi,

Test file below:

Code:

$: cat file1
DATE          TIME    COL1    COL2  COL3  COL4   ID
01/10/2013    0800    100     200   300   401    112
01/31/2013    1000    201     123   345   456    107
03/05/2013    1100    150     789   311   789    109
02/15/2013    1500    199     456   234   555    105

If I want to exclude a set of strings, for example, I want a subset of the current file but without the following line of text? How do I do that?

01/31/2013 1000 201 123 345 456 107
02/15/2013 1500 199 456 234 555 105

At the moment, I am doing as below:

Code:

 
awk '{ print $0 }' file1 | grep -v "01/31/2013    1000    201     123   345   456    107" | grep -v "02/15/2013    1500    199     456   234   555    105"

Assuming that the ID column is what I am most interested in to exclude, I am also trying out

Code:

 
awk '$7 != 107 && $7 != 105' file1

But in case that assumption is wrong and I need to exclude some particular strings, is there any other way? I am thinking of creating a function/sub for it inside the script that I can call during the script when I needed to.

Any advice much appreciated. Thanks

its better you store the lines in a file and use

Code:

 
grep -v -f exclude.txt filename.txt

Hi,

-f works on most of my servers but on some it doesn't like it 'coz I do not have the /usr/xpg4/bin/grep

Use fgrep!
With awk you can exclude field 7 only:

Code:

awk 'FILENAME=="-" {a[$NF]=1; next} !($7 in a)' - file.txt < exclude.txt

The exclude-file only contains the IDs. awk reads it to a hashed array, then processes file.txt: prints if field 7 is not in the array.