Shell Programming and Scripting

I am very very new to this (as in, I didn't even know awk existed till today)

I have a huuuuge csv file. In column 1, there is a ton of emails. I need to find which emails are unique, and save those rows to a separate file. I also need to find which emails are duplicates, and save a record of those too.

I have found a ton of different lines of code that can seemingly do this. Here are some I came across to find unique:
However I don't know how to save the output of these things to a file. I tried adding > desktop/output.txt to the end, and while the file always appears on my desktop, it has the same amount of rows that my original csv has, nothing changes at all.

What am I doing wrong?

Can you post few sample lines from your input file?

All of your examples are operating on totally different columns, so I suspect that's part of the problem.

If we knew which column, we could give a more exact answer. Post your data please.

Right now the csv im using to test with just contains emails.

email1@email.com
email2@email.com
email3@email.net
etc...

There are no headers, nothing else in any columns

Oh, and also, I have been changing the examples I found to match my column ($1, right?) and I have been changing the filenames to match mine of course

Code:

sort file.csv | uniq -c | awk '$1==1{print $2}' > unique.csv
sort file.csv | uniq -c | awk '$1>1{print $2}' > duplicate.csv

The first one displayed ~300 results, and there should be ~380k
The second one displayed nothing.



Could there be something wrong with my csv file, maybe?

Make sure your csv file isn't full of carriage returns.

Code:

tr -d '\r' < inputfile > outputfile