04-11-2014
Retrieve information Text/Word from HTML code using awk/sed
awk/sed newbie here. I have a HTML file and from that file and I would like to retrieve a text word.
HTML Code:
<font face=arial size=-1><li><a href=/value_for_clients/Tokyo/abc_process.txt>abc</a> NDK Version: 4.0 </li>
<font face=arial size=-1><li><a href=/value_for_clients/Tokyo/abc01_process.txt>abc01</a> NDK Version: 4.0 </li>
<font face=arial size=-1><li><a href=/value_for_clients/Tokyo/abc045_process.txt>abc045</a> NDK Version: 4.0 </li>
<font face=arial size=-1><li><a href=/value_for_clients/Tokyo/cdf_process.txt>cdf</a> NDK Version: 4.0 </li>
<font face=arial size=-1><li><a href=/value_for_clients/Tokyo/Manhattan_process.txt>Manhattan</a> NDK Version: 4.0 </li>
For eg. From the 1st line I would like to retrieve abc placed between: txt>abc</a>
I have used the following command but as you can see that number of letters in the word keeps changing abc, abc01, abc045, cdf, Manhattan.
awk -F\/ '{print substr($4,0,3)}' list.html
So this command is getting the output for only the 3 letter word. However I want to extract the same information (abc01, abc045, cdf, Manhattan) from all the lines in the HTML code. Please help.
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
How to use sed to remove html tags including text between them?
Example: User <b> rolvak </b> is stupid. It does not using <b>OOP</b>!
and should output: User is stupid. It does not using !
Thank you.. (2 Replies)
Discussion started by: alphagon
2 Replies
2. UNIX for Dummies Questions & Answers
Hi,
I'm looking for a command to retrieve a block of lines using sed or grep, probably awk if that can do the job.
In below example,
By searching for words "Third line2" i'm expecting to retrieve the full block starting with 'BEGIN' and ending with 'END' of the search.
Example:
... (3 Replies)
Discussion started by: learning_linux
3 Replies
3. Shell Programming and Scripting
I am attempting to extract weather data from the following website, but for the Victoria area only:
Text Forecasts - Environment Canada
I use this:
sed -n "/Greater Victoria./,/Fraser Valley./p"
But that phrasing does not sometimes get it all and think perhaps the website has more... (2 Replies)
Discussion started by: lagagnon
2 Replies
4. Shell Programming and Scripting
Hi,
I have filename in the following format:
YUENLONG_20070818.DMP
HK_20070818_V0.DMP
WANCHAI_20070820.DMP
KWUNTONG_20070820_V0.DMP
How to retrieve only the digital part with sed or awk and return the following format:
20070818
20070818
20070820
20070820
Thanks!
Victor (3 Replies)
Discussion started by: victorcheung
3 Replies
5. Shell Programming and Scripting
I am trying to retrieve that max 'year' in a text file that is delimited by tilde (~). It is the second column and the values may be in Char format (double quoted) and have duplicate values.
Please help. (4 Replies)
Discussion started by: CKT_newbie88
4 Replies
6. Shell Programming and Scripting
Hi
I have the following script:
#!/bin/sh
gcc -o program program.c
./program &
PID=$!
where i execute a C program and i get its pid. I want to retrieve information about this program (e.g memory consumption) using command top.
So far i have: top -d 1.0 -p $PID
But i dont know how to... (6 Replies)
Discussion started by: nteath
6 Replies
7. Shell Programming and Scripting
Hi,
I have a script that, basically, has two input files of this type:
file1
key1=value1_1_1
key2=value1_2_1
key4=value1_4_1
...
file2
key2=value2_2_1
key2=value2_2_2
key3=value2_3_1
key4=value2_4_1
...
My files are 10k lines big each (approx).
The keys are strings that don't... (7 Replies)
Discussion started by: fzd
7 Replies
8. Shell Programming and Scripting
Hello, I need some help extracting the number after the RBA e.g 15911688 from the below block of text (e.g: grep RBA |sed .......). The code should be valid for blocks if text generated at different times as well and not for the below text only.
... (2 Replies)
Discussion started by: drbiloukos
2 Replies
9. Shell Programming and Scripting
perl -MLWP::Simple -le '$s=shift;$c=get("http://www.google.com/intl/en/chrome/devices/chromecast/$s/");$c=~/meta content=(.*?)name=\"Remote free\"/msg; print length($1),"\t$1"' ?gclid=CJDg27OdnL0CFcFlOgodFD8A6Q >output.txt
output.txt should be: Chromecast works with devices you already own,... (9 Replies)
Discussion started by: cmccabe
9 Replies
10. Shell Programming and Scripting
I'm extracting text between table tags in HTML
<th><a href="/wiki/Buick_LeSabre" title="Buick LeSabre">Buick LeSabre</a></th>
using this:
awk -F "</*th>" '/<\/*th>/ {print $2}' auto2 > auto3
then this (text between a href):
sed -e 's/\(<*>\)//g' auto3 > auto4
How to shorten this into one... (8 Replies)
Discussion started by: p1ne
8 Replies
LEARN ABOUT DEBIAN
html::rewriteattributes::links
HTML::RewriteAttributes::Links(3pm) User Contributed Perl Documentation HTML::RewriteAttributes::Links(3pm)
NAME
HTML::RewriteAttributes::Links - concise link rewriting
SYNOPSIS
# up for some HTML::ResolveLink?
$html = HTML::RewriteAttributes::Links->rewrite($html, "http://search.cpan.org");
# or perhaps HTML::LinkExtor?
HTML::RewriteAttributes::Links->rewrite($html, sub {
my ($tag, $attr, $value) = @_;
push @links, $value;
$value;
});
DESCRIPTION
"HTML::RewriteAttributes::Links" is a special case of HTML::RewriteAttributes for rewriting links.
See HTML::ResolveLink and HTML::LinkExtor for examples of what you can do with this.
METHODS
"new"
You don't need to call "new" explicitly - it's done in "rewrite". It takes no arguments.
"rewrite" HTML, (callback|base)[, args] -> HTML
See the documentation of HTML::RewriteAttributes.
Instead of a callback, you may pass a string. This will mimic the behavior of HTML::ResolveLink -- relative links will be rewritten using
the given string as a base URL.
SEE ALSO
HTML::RewriteAttributes, HTML::Parser, HTML::ResolveLink, HTML::LinkExtor
AUTHOR
Shawn M Moore, "<sartak@bestpractical.com>"
LICENSE
Copyright 2008-2010 Best Practical Solutions, LLC. HTML::RewriteAttributes::Links is distributed under the same terms as Perl itself.
perl v5.10.1 2010-11-18 HTML::RewriteAttributes::Links(3pm)