Shell Programming and Scripting

Sorry it took so long. I have tried both techniques but I am unable to get them to work. I put the GNUWin directory path in the windows $PATH and the version of gawk is from 10/2003. However, I have been informed of 2 changes in the file. Apparently there will be instances where a duplicate is acceptable so an additional column has been added. If the last column in the line is Y then that line and the original are to be removed.

Code:

"180222","1","8.5","1Z0E947E0355363450","9.49","UPAC","N"
"180223","1","7.3","1Z0E947E0357325461","6.53","UPAC","N"
"180225","1","3.9","1Z0E947E0355178080","4.77","UPAC","N"
"180223","1","7.3","1Z0E947E0357325461","6.53","UPAC","N"
"180222","1","8.5","1Z0E947E0355363450","9.49","UPAC","Y"

As you can see the because the last line has Y then it and the first line are to be removed while lines 2 and 4 are to remain. Thanks again.

---------- Post updated at 12:19 PM ---------- Previous update was at 12:06 PM ----------

I forgot to add that when I run either technique I dont receive any errors of any type only blank output to the file. Below are examples of how I set it up.

Code:

sort C:\Users\username\Desktop\TestingFile\myfile1.csv |uniq -u > C:\Users\username\Desktop\TestingFile\myfile2.csv

Code:

gawk "NR==FNR{a[$0]++;next} a[$0]<2" C:\Users\username\Desktop\TestingFile\myfile1.csv C:\Users\username\Desktop\TestingFile\myfile1.csv >> C:\Users\username\Desktop\TestingFile\myfile2.csv

awk command with single quota only.

Code:

gawk 'NR==FNR{a[$0]++;next} a[$0]<2' 

And you need provide your expect output. I still really don't understand.

Sorry about that. I forgot to post the expectation:

"180223","1","7.3","1Z0E947E0357325461","6.53","UPAC","N"
"180225","1","3.9","1Z0E947E0355178080","4.77","UPAC","N"
"180223","1","7.3","1Z0E947E0357325461","6.53","UPAC","N"

In regards to the single quotes, I found in MS-DOS that it requires double quotes otherwise I get the following error:

"The system cannot find the file specified."

I thought it was my path, however, it was correct.