Sponsored Content
Top Forums Shell Programming and Scripting SED to extract HTML text data, not quite right! Post 302391181 by lagagnon on Saturday 30th of January 2010 10:53:33 PM
Old 01-30-2010
SED to extract HTML text data, not quite right!

I am attempting to extract weather data from the following website, but for the Victoria area only:

Text Forecasts - Environment Canada

I use this:

Code:
 sed -n "/Greater Victoria./,/Fraser Valley./p"

But that phrasing does not sometimes get it all and think perhaps the website has more than one linefeed, carriage return, whatever, that messes up my coding. Any ideas appreciated.

Larry
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

How do I extract text only from html file without HTML tag

I have a html file called myfile. If I simply put "cat myfile.html" in UNIX, it shows all the html tags like <a href=r/26><img src="http://www>. But I want to extract only text part. Same problem happens in "type" command in MS-DOS. I know you can do it by opening it in Internet Explorer,... (4 Replies)
Discussion started by: los111
4 Replies

2. UNIX for Dummies Questions & Answers

extract data from html tables

hi i need to use unix to extract data from several rows of a table coded in html. I know that rows within a table have the tags <tr> </tr> and so i thought that my first step should be to to delete all of the other html code which is not contained within these tags. i could then use this method... (8 Replies)
Discussion started by: Streetrcr
8 Replies

3. UNIX for Advanced & Expert Users

sed to extract HTML content

Hiya, I am trying to extract a news article from a web page. The sed I have written brings back a lot of Javascript code and sometimes advertisments too. Can anyone please help with this one ??? I need to fix this sed so it picks up the article ONLY (don't worry about the title or date .. i got... (2 Replies)
Discussion started by: stargazerr
2 Replies

4. Shell Programming and Scripting

Extract URLs from HTML code using sed

Hello, i try to extract urls from google-search-results, but i have problem with sed filtering of html-code. what i wont is just list of urls thay apears between ........<p><a href=" and next following " in html code. here is my code, i use wget and pipelines to filtering. wget works, but... (13 Replies)
Discussion started by: L0rd
13 Replies

5. Shell Programming and Scripting

extract data with awk from html files

Hello everyone, I'm new to this forum and i am new as a shell scripter. my problem is to have html files in a directory and I would like to extract from these some data that lies between two different lines Here's my situation <td align="default"> oxidizability (mg / l): data_to_extract... (6 Replies)
Discussion started by: sbobotex
6 Replies

6. Shell Programming and Scripting

help with sed needed to extract content from html tags

Hi I've searched for it for few hours now and i can't seem to find anything working like i want. I've got webpage, saved in file par with form like this: <html><body><form name='sendme' action='http://example.com/' method='POST'> <textarea name='1st'>abc123def678</textarea> <textarea... (9 Replies)
Discussion started by: seb001
9 Replies

7. Shell Programming and Scripting

extract complex data from html table rows

I have bash, awk, and sed available on my portable device. I need to extract 10 fields from each table row from a web page that looks like this: </tr> <tr> <td>28 Apr</td> <td><a... (6 Replies)
Discussion started by: rickgtx
6 Replies

8. Shell Programming and Scripting

awk -- Extract data from html within multiple tags as reference

Hi, I'm trying to get some data from an html file, but the problem is before it can extract the information I have multiple patterns that need to be passed through. https://www.unix.com/shell-programming-scripting/150711-extract-data-awk-html-files.html Is a similar problem. The only... (5 Replies)
Discussion started by: counfhou
5 Replies

9. Shell Programming and Scripting

Awk/sed HTML extract

I'm extracting text between table tags in HTML <th><a href="/wiki/Buick_LeSabre" title="Buick LeSabre">Buick LeSabre</a></th> using this: awk -F "</*th>" '/<\/*th>/ {print $2}' auto2 > auto3 then this (text between a href): sed -e 's/\(<*>\)//g' auto3 > auto4 How to shorten this into one... (8 Replies)
Discussion started by: p1ne
8 Replies

10. Shell Programming and Scripting

Extract text from html using perl or awk

I am trying to extract text after keywords fron an html file. The keywords are reportLink":, "barcodedSamples": {", "barcodedSamples": {". Both the perl and awk run but the output is just the entire index.html not the desired output. Also for the reportLink": only the text after the second / until... (5 Replies)
Discussion started by: cmccabe
5 Replies
HTML::Quoted(3pm)					User Contributed Perl Documentation					 HTML::Quoted(3pm)

NAME
HTML::Quoted - extract structure of quoted HTML mail message SYNOPSIS
use HTML::Quoted; my $html = '...'; my $struct = HTML::Quoted->extract( $html ); DESCRIPTION
Parses and extracts quotation structure out of a HTML message. Purpose and returned structures are very similar to Text::Quoted. SUPPORTED FORMATS
Variouse MUAs use quite different approaches for quoting in mails. Some use blockquote tag and it's quite easy to parse. Some wrap text into p tags and add '>' in the beginning of the paragraphs. Things gettign messier when it's an HTML reply on plain text mail thread. If you found format that is not supported then file a bug report via rt.cpan.org with as short as possible example. Test file is even better. Test file with patch is the best. Not obviouse patches without tests suck. METHODS
extract my $struct = HTML::Quoted->extract( $html ); Takes a string with HTML and returns array reference. Each element in the array either array or hash. For example: [ { 'raw' => 'Hi,' }, { 'raw' => '<div><br><div>On date X wrote:<br>' }, [ { 'raw' => '<blockquote>' }, { 'raw' => 'Hello,' }, { 'raw' => '<div>How are you?</div>' }, { 'raw' => '</blockquote>' } ], ... ] Hashes represent a part of the html. The following keys are meaningful at the moment: o raw - raw HTML o quoter_raw, quoter - raw and decoded (entities are converted) quoter if block is prefixed with quoting characters AUTHOR
Ruslan.Zakirov <ruz@bestpractical.com> LICENSE
Under the same terms as perl itself. perl v5.10.1 2011-01-09 HTML::Quoted(3pm)
All times are GMT -4. The time now is 05:37 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy