|
|
Sponsored Content
Top Forums
Shell Programming and Scripting
How to extract url from html page?
Post 302463361 by kurumi on Sunday 17th of October 2010 04:53:38 AM
10-17-2010
Hi Neo
I think extraction/parsing has no real big difference. We are still getting information out of something anyway.
Yup, urls indeed can be easily extracted (or is it? well....
) . That is, if the requirement is only urls, nothing else. But not so for this particular question/thread since OP wanted to get the inner text as well. As demonstrated by Scrutinizer, its possible using gawk+regex, but there are still some corner cases left out. Anyway, i think OP (where ever he is) will find Scrutinizer's gawk code to be good enough for his purpose.
Quote:
Originally Posted by Neo
I thought this discussion was about extracting URLs from HTML, not parsing HTML.
Quote:
Originally Posted by Neo
There is a difference, you know, between a generic HTML parser, and simply extracting a URL.
URLs can easily be extracted with regex.
URLs can easily be extracted with regex.
) . That is, if the requirement is only urls, nothing else. But not so for this particular question/thread since OP wanted to get the inner text as well. As demonstrated by Scrutinizer, its possible using gawk+regex, but there are still some corner cases left out. Anyway, i think OP (where ever he is) will find Scrutinizer's gawk code to be good enough for his purpose.|
|
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi ,
I am trying to get page size of a url(e.g.,www.example.com) using wget command.Any thoughts what are the parameters i need to send with wget to get the size alone?
Regards,
Raj (1 Reply)
Discussion started by: rajbal
1 Replies
2. UNIX for Dummies Questions & Answers
I have a html file called myfile. If I simply put "cat myfile.html" in UNIX, it shows all the html tags like <a href=r/26><img src="http://www>. But I want to extract only text part.
Same problem happens in "type" command in MS-DOS.
I know you can do it by opening it in Internet Explorer,... (4 Replies)
Discussion started by: los111
4 Replies
3. Solaris
Hi All,
In our unix server we have an apache web server running. I can access the default apache web page from my windows machine.
Now, I want to create my own webpage. Therefore I created webpage at /export/home/myname/test.html file. Where do I need to place this file and what do I need... (0 Replies)
Discussion started by: pkm_oec
0 Replies
4. Web Development
I am planning to create an html page that will count number of connected ports, challenge for me is how to put it in a page. Thanks! (1 Reply)
Discussion started by: webmunkey23
1 Replies
5. UNIX for Dummies Questions & Answers
Hi All,
Thanks for reading.
I am not sure if I am asking this in the correct group. But here it goes:
There is a shell script which does some system checks and creates an html file called system_summary.html on my Red Hat machine say in /reports directory every hour.
Now I want to view it... (1 Reply)
Discussion started by: deepakgang
1 Replies
6. Red Hat
Hi All,
Thanks for reading.
I am not sure if I am asking this in the correct group. But here it goes:
There is a shell script which does some system checks and creates an html file called system_summary.html on my Red Hat machine say in /reports directory every hour.
Now I want to view it... (6 Replies)
Discussion started by: deepakgang
6 Replies
7. Shell Programming and Scripting
Hi All,
I have some HTML files and my requirement is to extract all the anchor text words from the HTML files along with their URLs and store the result in a separate text file separated by space. For example, <a href="/kid/stay_healthy/">Staying Healthy</a>
which has /kid/stay_healthy/ as... (3 Replies)
Discussion started by: shoaibjameel123
3 Replies
8. Shell Programming and Scripting
Hey guys, looking for a way to encode a string into URL and HTML in a bash script that I'm making to encode strings in various different digests etc.
Can't find anything on it anywhere else on the forums.
Any help much appreciated, still very new to bash and programming etc. (4 Replies)
Discussion started by: 3therk1ll
4 Replies
9. Shell Programming and Scripting
Hi I am try to use curl to send a static xml file using url encoding to a web page using post. This has to go through a particular port on our firewall as well. This is my first exposure to curl and am not having much success, so any help you can supply, or point me in the right direction would be... (1 Reply)
Discussion started by: Paul Walker
1 Replies
10. Post Here to Contact Site Administrators and Moderators
Hi
I just tried to post following link while answering, its not parsing properly, just try on your browser
Tried to paste while answering :
https://www.unix.com/302873559-post2.htmlNot operator is not coming with HTML/PHP tags so attaching file (2 Replies)
Discussion started by: Akshay Hegde
2 Replies
LEARN ABOUT SUSE
page_util_quote
page_util_quote(n) Parser generator tools page_util_quote(n) __________________________________________________________________________________________________________________________________________________ NAME
page_util_quote - page character quoting utilities SYNOPSIS
package require page::util::quote ?0.1? package require snit ::page::util::quote::unquote char ::page::util::quote::quote'tcl char ::page::util::quote::quote'tclstr char ::page::util::quote::quote'tclcom char _________________________________________________________________ DESCRIPTION
This package provides a few utility commands to convert characters into various forms. API
::page::util::quote::unquote char A character, as stored in an abstract syntax tree by a PEG processor (See the packages grammar::peg::interpreter, grammar::me, and their relations), i.e. in some quoted form, is converted into the equivalent Tcl character. The character is returned as the result of the command. ::page::util::quote::quote'tcl char This command takes a Tcl character (internal representation) and converts it into a string which is accepted by the Tcl parser, will regenerate the character in question and is 7bit ASCII. The string is returned as the result of this command. ::page::util::quote::quote'tclstr char This command takes a Tcl character (internal representation) and converts it into a string which is accepted by the Tcl parser and will generate a human readable representation of the character in question. The string is returned as the result of this command. The string does not use any unprintable characters. It may use backslash-quoting. High UTF characters are quoted to avoid problems with the still prevalent ascii terminals. It is assumed that the string will be used in a double-quoted environment. ::page::util::quote::quote'tclcom char This command takes a Tcl character (internal representation) and converts it into a string which is accepted by the Tcl parser when used within a Tcl comment. The string is returned as the result of this command. BUGS, IDEAS, FEEDBACK This document, will undoubtedly contain bugs and other problems. Please report such in the category page of the Tcllib SF Trackers [http://sourceforge.net/tracker/?group_id=12883]. Please also report any ideas for enhancements you may have. KEYWORDS
page, parser generator, quoting, text processing COPYRIGHT
Copyright (c) 2007 Andreas Kupries <andreas_kupries@users.sourceforge.net> page 1.0 page_util_quote(n)