Shell Programming and Scripting

Shell script help
Here is 3 sample lines from a log file

<date> INFO <java.com.blah> abcd:ID= user login
<date> DEBUG <java.com.blah> <nlah bla> abcd:ID=123 user login
<date> INFO <java.com.blah> abcd:ID=3243 user login

I want to find unique "ID" from this log file which has thousands of rows. Problem is that "ID" is not in the same delimiter field and also as null sometimes "ID=" without any value which I like to ignore .

Any pointers or even possible with simple grep/awk command if not script?

Try this to get you going:

Code:

matt@matt-macbook$ cat test.f
ID=10
ID=10
ID=1
ID=1
ID=3
ID=4
ID=3
ID=3
ID=3
ID=
ID=3
ID=4
matt@matt-macbook$ grep -e ID=[0-9] test.f | sort | uniq
ID=1
ID=10
ID=3
ID=4
matt@matt-macbook$

Code:

awk -F":" '{gsub(/user login.*/,"",$2);$1=""}1' file

Code:

while(<DATA>){
	print $1,"\n" if /ID=([^ ]+)/;
}
__DATA__
<date> INFO <java.com.blah> abcd:ID= user login
<date> DEBUG <java.com.blah> <nlah bla> abcd:ID=123 user login
<date> INFO <java.com.blah> abcd:ID=3243 user login