Hi All,
A small question:

I have a file check.txt which looks like below:

KRPROD2,2012-11-20 08:46:50:408,ODK3325688102
KRPROD2,2012-11-20 08:47:35:289,ODK3325688102
KRPROD2,2012-11-20 08:47:35:446,ODK3325688102
KRPROD2,2012-11-20 08:48:32:973,ODK3325689120
KRPROD2,2012-11-20 09:29:17:833,ODK3325689120
KRPROD2,2012-11-20 09:29:17:912,ODK3325689120

KRPROD2,2012-11-20 08:46:50:408,ODK3325688102
KRPROD2,2012-11-20 08:48:32:973,ODK3325689120

awk -F, '!c[$3]++' file

Thanks so much...it works.
Can you please help to explain as i m new bie in unix

awk -F, '!c[$3]++' file

Thanks for detailed explanation

But when I am using below line/command its giving me error;

ssh ${fmsServerUserName}@${fmsServerName} "awk -F, '!c[$3]++' 10_FMS_CRXtoFMS.csv" >> 10_FMS_CRXtoFMS.csv

Error:
awk: !c[]++
awk:    ^ syntax error
awk: fatal: invalid subscript expression

Hi
escape ! and $ chars. it will work.

ssh ${fmsServerUserName}@${fmsServerName} "awk -F, '\!c[\$3]++' 10_FMS_CRXtoFMS.csv" >> 10_FMS_CRXtoFMS.csv

By putting the !c[$e]++ in a double quoted string (i.e., "awk -F, '!c[$3]++' 10_FMS_CRXtoFMS.csv" ), you had the shell expand $3 instead of awk. Given the error message, it would appear that the shell you were executing when you invoked this command either didn't have three positional parameters or the third positional parameter at that time was an empty string.

Then when you invoked awk, the script that it was given was '!c[]++' and you got the syntax error from awk.

I don't use ssh much, but adding the backslash escape as shown in red in the following should get rid of the syntax error for you:

ssh ${fmsServerUserName}@${fmsServerName} "awk -F, '!c[\$3]++' 10_FMS_CRXtoFMS.csv" >> 10_FMS_CRXtoFMS.csv