Shell Programming and Scripting

I'm trying to get a script to copy a url then put it in a different place in the file.

Example is currently the script goes to a site takes the urls on it and then puts them into an html file. Only thing is I want to make them into links.

So currently lynx goes to the page takes out the urls. Then using sed I add <a href etc to the start and end of the lines.

E.g. <a href="http://url.com/site.html" > site name</a>

I want to the put url into the site name so I'm looking for a command that will search for a string inside the " " and then put it at the end of that line. Because there could be 20 or 30 lines in each page I'm not sure how to do this.

Its probily really easy but i'm getting lost here.

Also any books you could recomend for working on simple shell stuff ?

Thanks.

Do it with sed at the same time as you add the "< href="

I recommend using on-line resources; see my shell page, http://cfaj.freeshell.org/shell/resources.shtml for links to many pages of shell information

Sorry I should have explained better ....

When using lynx to I use the -dump command which automatically lists all the links on a page. This is listed after Referances: at the end of the page. So when I used sed its to already existing text. All I'm doing is adding the <a href=" to the beginning of this text. I haven't actually inserted the url anywhere its already in the stream from lynx...

I'm sure sed can do it but i'm stumped as to how.

Thanks.

Paul.

Code:

lynx -dump "$URL" | 
  sed -e '1,/^References$/d' \
      -e 's/.*[0-9]. http:/<a href="http:/' \
      -e 's/http:.*/&">&<\/a>/'

Hey thanks.... I'm s till not really explaining this to well the code above does one of the things I was doing better. however the output from that will give me

<a href="http://www.google.com"></a>

I'm trying to get it ot do <a href="http://www.google.com">http://www.google.com</a>

So I'm trying to look up the domain and put it as the name on the url as well as adding hte tags.

The code I'm using at the min is...

lynx -dump "$1" |\
sed -n '/^References$/,$p' |\
sed 's/http:/<a href="http:/|\
sed 's/http:.*/&"><\/a/' <- Thats your code replacing mine which was
#sed 's/$/"><\/a>/'

Sorry to keep bothering you.

Thanks..
Paul.

Did you try it?

It will give you what you want:

Code:

$ lynx -dump http://cfaj.freeshell.org/ |
> sed -e '1,/^References$/d' \
>       -e 's/.*[0-9]. http:/<a href="http:/' \
>       -e 's/http:.*/&">&<\/a>/'

<a href="http://cfaj.freeshell.org/xword/">http://cfaj.freeshell.org/xword/</a>
<a href="http://cfaj.freeshell.org/chess/lessons/">http://cfaj.freeshell.org/chess/lessons/</a>
...

Code:

sed 's_"\([^"][^"]*\)"[^>]*>.*</a>_"\1">\1</a>_'