Shell Programming and Scripting

Need a help with a simple(i hope) script that would get a website location from stdin and then check all the links that site contains for some random regular expression ,and then save the links name and the expression found in some random file.Any help would be really helpfull.

Considerin i`m not that good with shell scripting i wouldnt know where to start

I think I a little good in shell scripting but I don't know where to start too...

PS This would not be a "simple" script in any ways. You either need to get all site with a special program like HTTPTrack and then grepping through for your regex and links, or use a special library for some programming language (like libwww for perl) and write a non trivial program.

There r only 2 issues with the script that r hard i guess , how to get to download the links , and how to search the contents of the links itself , but as to how to do that , i got no idea :S

Do you need get and search links from one page or from the whole site?
For one page you can use:

Code:

curl -s URL | perl -0777 -nE 'say for /<a href.*?>/g'

get links and then use grep on them.

uhh from 1 domain i think

Then see my post above. (You need to work with inner, outer, cross, multi links, redirection and so on, and so on).