Hi,

i am downloading a html file with wget and now need to extract certain informations from it.

The string starts after "Attributes:" and ends before "Stats:". It may span across multiple Lines.
Within that string there are random additional strings that i need.
They have the pattern "String1:String2", these are the Attributes and their Values separated by a ":"

So based on the example below my result shuld be:
Category: Movies
Video Source: DVD
Video Format: WMV
Video Genre: Horror, Mystery, Thriller
Language: English
Audio Format: WMA

I tried sed with sed -n "/Attributes:/,/Stats:/p" but that will get the whole line and not only the text between the two strings.

I have not found a parameter to change that behavior.

Thanks in advance for any help
Rag

second example on two lines:
it seems like its always "Attributes:</th><td>" at the start and "<br /></td></tr><tr><th>Stats:" at the End.

What is your OS ?

If you're on Linux try:

Output of the first example:

Output of the second example:


If there are opened tags somewhere in the records replace RS with:

Wow i have no idea how exactly that awk command is working, but fortunately i dont have to Big thanks rubin! Im on Windows with the unixutils. i'll additionally clean the spaces gawk "/Stats/{f=0} f && NF; /Attributes/{f=1}" RS="]+>" index-3123947.html|sed -e "s/ //g">x.txt then set them as Environment variables in batch for /F "delims=: tokens=1,2" %f in (x.txt) do set nzb%f=%g

Now i wanted to use that on my XP download machine but unfortunately the wget output is different there.

The result has newline's and Tab's. For me all whitespace could be cleaned. space, tab, CR and LF.
I added: |sed -e "s/\t*//g"|tr -d "\n" but then i dont have any CR/LF left.

please help again
Thanks

after awk

If I understood correctly your requirement, the following code will remove extra spaces, newlines and tabs.

After running the command save the file as text file, and then use Wordpad or MS Word to open the output file ( not Notepad ), so the newlines are preserved in the output.

From your other sample, this is the output from running the code on Cygwin ( on Windows):

Is this what you required ?

Not to detract from this solution, but it appears to only work with gawk.

That's correct, I've noticed that. To get it to work on older awk ( say HP-UX or Solaris), RS has to be changed to FS, and eventually some code modifications too. That's because older awk has a problem parsing correctly RS, the whole regex get reduced to a mere "<", but luckily not FS which is parsed the way it's expected.

That's why first goes the question that on what OS will the code be run.