UNIX for Dummies Questions & Answers

Hello,
I am a total linux newbie and I can't seem to find a solution to this little problem.
I have two text files with a huge list of URLS. Let's call them file1.txt and file2.txt

What I want to do is grab an URL from file2.txt, search file1.txt for the URL and if found, delete it from file1.txt.

What would be the best way to go around doing this? Would I need a full bash script or does anyone know a simple oneliner to do it.

Thanks,
Rafael

hope it will work...
right now i don't have terminal to test...

while read line
do
sed "/$line/d" file1.txt >tempfile /*sed -i "/$line/d" file1.txt (works in higher version of linux)*/
done < file2.txt

Thanks for your quick answer vidyadhar!
I'm getting the following error
sed: -e expression #1, char 8: unknown command: `/'

This is my bash script:

Code:

#!/bin/sh
while read line
do
sed "/$line/d" file1.txt >tempfile
done < file2.txt

I tried searching around google for more sed info to see if I could fix it but had no luck.

Thanks again!

another way to do it is just

Code:

for i in `cat file1`; do echo $i|grep -v -f file2; done

that will output only the lines in file1 which are not found in file2. Then if you want you can redirect the output to another file so you can create a new file1

Code:

for i in `cat file1`; do echo $i|grep -v -f file2; done > file1.new

Just changed the double quotes to single quotes and I got no errors.
Thanks again!

ya sorry i typed double quote instead of single quote
usually in sed "" is used to expan the variable... when you are using variables inside sed you should be extra carefull :-)

vidyadhar85 , that didn't seem to work. I dont know what might be wrong, but it's not finding any common lines.
File1.txt has 1687 lines, of which 472 are in File2.txt

I am trying redoubtable's solution but it's a bit slow. It's been working for a bit over 10min which is understandable since the files are big.

I'll let you know how that works.