Shell Programming and Scripting

hi everyone, i have a document where i have email addresess and names, i need to check if the email addresses are uniq, if they repeat erase one of them, how can i do that?

document sample:

aD00763357@cucei.udg.mx,ABRAHAM ANTONIO SEVERIANO
a199721111@cucei.udg.mx,ABRAHAM GONZALEZ MIGUEL
a090784803@cucei.udg.mx,ABREGO FLORES JAIRO ALONSO
a088667212@cucei.udg.mx,ABREU GALAN ALEJANDRO
a394204925@cucei.udg.mx,ABREU MARISCAL JOSE MANUEL
aD03861546@cucei.udg.mx,ABREU MARISCAL LUIS RODRIGO
a084461709@cucei.udg.mx,ABREW GARCIA ALFONSO
a396242948@cucei.udg.mx,ABRICA MOJARRO LAURA MARISELA
a193209451@cucei.udg.mx,ABUNDIO RAMIREZ BERNARDO
a198121765@cucei.udg.mx,ABUNDIS PANTOJA HUGO MARTIN
a398298339@cucei.udg.mx,ABUNDIS RUIZ BERENICE
a394210925@cucei.udg.mx,ABUNDIS RUIZ RAQUEL
a393046129@cucei.udg.mx,ACEVEDO ACEVEDO JUAN ENRIQUE
a300581275@cucei.udg.mx,ACEVEDO BERNAL GERMAN
a399273925@cucei.udg.mx,ACEVEDO CARDENAS KARLA GUADALUPE
a396206372@cucei.udg.mx,ACEVEDO HERNANDEZ ERICK
a093781856@cucei.udg.mx,ACEVEDO MANRIQUEZ MARIA MARINA
a394006445@cucei.udg.mx,ACEVEDO PARRA HECTOR RUBEN
a300205133@cucei.udg.mx,ACEVEDO PARRA ERIK EDUARDO

sort -u -t ',' -k 1,1 yourDocument

if the file is already sorted ... see "man uniq" ...

if the file has not been sorted ... see "man sort" and/or "man uniq" as required

wow... thank you very much, that was really simple solution, i was writing a script... very complicated.. and it didnt even worked anyway...

Code:

#!/usr/bin/bash
ARCH=cuaad.txt
sort $ARCH >> temp
cp temp $ARCH
rm temp
tr ' ' '%' < $ARCH  >> cuceitmp.txt
cp cuceitmp.txt $ARCH
for x in `cat $ARCH`
do
echo $x > x.txt
a=`cut -d, -f1 x.txt`
b=`cut -d, -f2 x.txt`
grep $a $ARCH >> tmpswap.txt
wc -l tmpswap.txt > count.txt
tr ' ' ':' < count.txt >> counttmp.txt
n=`cut -d: -f7 counttmp.txt`
echo $n
rm tmpswap.txt
if [$n != 1];
then
echo $a,$b Repetido $n veces... >> DUPL
else
echo $a,$b >> tmp.txt
fi
done
tr '%' ' ' < $ARCH

it never really worked, and is awfully slow

what is that 1,1 thing you use, is it awk or something like that?

naah, nothing like that - 'man sort'