Diff online files


 
Thread Tools Search this Thread
Top Forums UNIX for Advanced & Expert Users Diff online files
# 1  
Old 01-06-2009
Diff online files

Hiya.

I'm trying to create a script to diff between two web pages in a single line. This is partly just to improve my knowledge of the unix command-line, and cos it's an interesting problem.

First of all, the following command will output a web page's content to the command line:
Code:
> wget -q -O - http://aserver/file1.html

So, from there, I realised I could do this in two lines, if I didn't mind leaving a temporary file (which I do)
Code:
> wget -q -O tempfile.html http://aserver/file1.html
> wget -q -O - http://aserver/file2.html | diff - tempfile.html

What I want to know is, is there some way that I can do this on one line, without leaving any files behind? Like, can I write to a variable, or a temporary file handle, or something? E.g.:
Code:
> wget -q -O - http://aserver/file1.html > <FILEHANDLE>; wget -q -O - http://aserver/file2.html | diff <FILEHANDLE> -

(I know this doesn't work, it's just to illustrate the kind of thing I'd like to do).

Ta,
Robin.

Last edited by nottrobin; 01-06-2009 at 10:41 PM.. Reason: added tags
# 2  
Old 01-06-2009
If your shell supports process substitution (ksh93, zsh or bash),
you could use something like this:
Code:
diff <(wget -q -O - url1) <(wget -q -O - url2)

# 3  
Old 01-06-2009
Yes, I am using bash, so that works fine Smilie

That's nice and intuitive. I didn't realise you could do that.

Thanks very much Smilie
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Diff 3 files, but diff only their 2nd column

Guys i have 3 files, but i want to compare and diff only the 2nd column path=`/home/whois/doms` for i in `cat domain.tx` do whois $i| sed -n '/Registry Registrant ID:/,/Registrant Email:/p' > $path/$i.registrant whois $i| sed -n '/Registry Admin ID:/,/Admin Email:/p' > $path/$i.admin... (10 Replies)
Discussion started by: kenshinhimura
10 Replies

2. Shell Programming and Scripting

Diff of 2 files using perl

Assitance needed in checking file difference using a perl script Below is the example I wanted a report saying file2 has an update of new value. File1 old date Alpha 156 Beta 255 Gama 6987 segma 4578 File2 new date Alpha 156 Beta 255 Gama 1000 (3 Replies)
Discussion started by: ajayram_arya
3 Replies

3. UNIX for Advanced & Expert Users

Binary files diff

Hi I am very happy to joined this group!!! I need your suggestion for get it resolved my issue. I have two class files both class files are same, there is no diff in both two files. Both 2 files were compiled in Linux environment with different type of OS. When i am using diff command,... (13 Replies)
Discussion started by: suresh1256644
13 Replies

4. Shell Programming and Scripting

Diff 2 Delimiter Files.

Hi, I need a small help to compare two PIPE delimited files. Note : All The Files Have A Column Name Example: file1.txt ================= column1|column2|column3 one|two|three four|five|six seven|eight|nine file2.txt ================= column1|column2|column3 1|two|three... (2 Replies)
Discussion started by: anshultongia
2 Replies

5. Shell Programming and Scripting

.procmailrc and uudeview (put attachments from diff senders to diff folders)

Moderator, please, delete this topic (1 Reply)
Discussion started by: optik77
1 Replies

6. Shell Programming and Scripting

diff bw two files

Hi All, I have two files which look as below File1 serial="1" name="abc" type="employee" field="IT" serial="2" name="cde" type="intern" field="Marketing" serial="3" name="pqr" type="contractor" field="IT" serial="4" name="xyz" type="employee" field="Sales" File2 serial="1"... (3 Replies)
Discussion started by: grajp002
3 Replies

7. Shell Programming and Scripting

diff of files

Hi, I have 2 files.I want to check if file1 is contained in file2. A.txt: ----- AAA BBB B.txt: ------ CCC AAA BBB DDD I want to check if A.txt is contained in B.txt. Can it be done using SED ? (12 Replies)
Discussion started by: giri_luck
12 Replies

8. Shell Programming and Scripting

Diff b/w 2 files

Hi Masters, I have two files named file1 and file2. Both the files contains the same contents with some difference in comments,space.But no content change. I tried to find the diff between the two files to make sure that contents are same. For that i tried diff -ibw file1 file2 But... (1 Reply)
Discussion started by: ecearund
1 Replies

9. Shell Programming and Scripting

Find duplicates from multuple files with 2 diff types of files

I need to compare 2 diff type of files and find out the duplicate after comparing each types of files: Type 1 file name is like: file1.abc (the extension abc could any 3 characters but I can narrow it down or hardcode for 10/15 combinations). The other file is file1.bcd01abc (the extension... (2 Replies)
Discussion started by: ricky007
2 Replies

10. Shell Programming and Scripting

diff 2 files; output diff's to 3rd file

Hello, I want to compare two files. All records in file 2 that are not in file 1 should be output to file 3. For example: file 1 123 1234 123456 file 2 123 2345 23456 file 3 should have 2345 23456 I have looked at diff, bdiff, cmp, comm, diff3 without any luck! (2 Replies)
Discussion started by: blt123
2 Replies
Login or Register to Ask a Question