Shell Programming and Scripting

I am trying to download a page and retrieve only wav and mp3 files via wget.

the website is:

Alarm Sounds | Free Sound Effects | Alarm Sound Clips | Sound Bites

my command is :

Code:

wget -rl 2 -e robots=off -A wav,mp3 http://soundbible.com/tags-alarm.html

When not using the

Code:

-A wav,mp3

option, then I get the mp3/wav files, but of course a whole lot more.

So what am I doing wrong?

Thanks,
Narnie

---------- Post updated at 09:55 PM ---------- Previous update was at 09:19 PM ----------

I believe I have figured it out.

It sees the -A wav,mp3 argument and is expecting a .wav and .mp3 extension.

wget is not saving them as such, but as a strange string name like this for example:

force-sounds.php?id=wav%2FWorld War 2 Rifle-SoundBible.com-1227426354.wav&clip=wav

which is confusing the -A wav,mp3 argument.

Problem is, when I tried -A *wav*,*mp3* which then assumes it is a pattern and not a suffix, then it still won't download them.

At least it is known why this is, but it appears there is not a work-around other than downloading everything and then deleting what is not necessary.

Yours,
Narnie

It looks like it's because they're embedded in javascript/flash. I hate when sites do that. Try these three commands:

Code:

wget http://soundbible.com/tags-alarm.html
awk 'BEGIN{ RS="&"}{gsub(/.*theFile=/,"");print}' < tags-alarm.html | grep mp3 | uniq > list
wget -i list

Explanation:
After wget gets the page, the links in the raw HTML look like this:

Code:

<embed src="wimpy_button.swf" flashvars="theFile=http://soundbible.com/mp3/Turn Off The Air-SoundBible.com-100970025.mp3&wimpyReg=MiU....(a lot more gibberish)

I got the awk line from someone here and it's very useful. When it see "theFile=", it extracts everything until it runs into "&". There is some extra gibberish for some reason but piping it to "grep mp3" gets rid of it and every mp3 link is duplicated so piping to uniq takes care of that. The output goes to list and "wget -i list" gets the links in the list file.

That gets 59 links, I hope that's all of them. I didn't see any wav files so I just did it for mp3s.

Thanks. I figured it was due to the embedded nature. Thanks for the awk line. That is very helpful.

Yours,
Narnie