Sponsored Content
Top Forums Shell Programming and Scripting How to extract url from html page? Post 302463152 by 14th on Saturday 16th of October 2010 01:32:21 AM
Old 10-16-2010
Quote:
Originally Posted by kurumi
http://hpricot.com/
Code:
#!/usr/bin/env ruby -Ku

require 'hpricot'
doc = open("file"){|f|Hpricot(f)}
(doc/"a").each do |x|
 print "-->#{x.get_attribute("href)}, #{x.inner_text}\n"
end

Code:
$ ruby geturl.rb
-->http://awebsite, website
-->http://bwebsite, websiteb

thanks for the answering, but I don't really know what is hpricot and how to use it.
I'm new to shell programming and I don't know ruby at all.Smilie

do you know any solution using sed, awk, or grep maybe?
thanks.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to get the page size (of a url) using wget

Hi , I am trying to get page size of a url(e.g.,www.example.com) using wget command.Any thoughts what are the parameters i need to send with wget to get the size alone? Regards, Raj (1 Reply)
Discussion started by: rajbal
1 Replies

2. UNIX for Dummies Questions & Answers

How do I extract text only from html file without HTML tag

I have a html file called myfile. If I simply put "cat myfile.html" in UNIX, it shows all the html tags like <a href=r/26><img src="http://www>. But I want to extract only text part. Same problem happens in "type" command in MS-DOS. I know you can do it by opening it in Internet Explorer,... (4 Replies)
Discussion started by: los111
4 Replies

3. Solaris

Accessing a HTML page

Hi All, In our unix server we have an apache web server running. I can access the default apache web page from my windows machine. Now, I want to create my own webpage. Therefore I created webpage at /export/home/myname/test.html file. Where do I need to place this file and what do I need... (0 Replies)
Discussion started by: pkm_oec
0 Replies

4. Web Development

findstr in html page

I am planning to create an html page that will count number of connected ports, challenge for me is how to put it in a page. Thanks! (1 Reply)
Discussion started by: webmunkey23
1 Replies

5. UNIX for Dummies Questions & Answers

Publishing HTML Page

Hi All, Thanks for reading. I am not sure if I am asking this in the correct group. But here it goes: There is a shell script which does some system checks and creates an html file called system_summary.html on my Red Hat machine say in /reports directory every hour. Now I want to view it... (1 Reply)
Discussion started by: deepakgang
1 Replies

6. Red Hat

Publishing HTML Page

Hi All, Thanks for reading. I am not sure if I am asking this in the correct group. But here it goes: There is a shell script which does some system checks and creates an html file called system_summary.html on my Red Hat machine say in /reports directory every hour. Now I want to view it... (6 Replies)
Discussion started by: deepakgang
6 Replies

7. Shell Programming and Scripting

Extracting anchor text and its URL from HTML files in BASH

Hi All, I have some HTML files and my requirement is to extract all the anchor text words from the HTML files along with their URLs and store the result in a separate text file separated by space. For example, <a href="/kid/stay_healthy/">Staying Healthy</a> which has /kid/stay_healthy/ as... (3 Replies)
Discussion started by: shoaibjameel123
3 Replies

8. Shell Programming and Scripting

URL/HTML encoding

Hey guys, looking for a way to encode a string into URL and HTML in a bash script that I'm making to encode strings in various different digests etc. Can't find anything on it anywhere else on the forums. Any help much appreciated, still very new to bash and programming etc. (4 Replies)
Discussion started by: 3therk1ll
4 Replies

9. Shell Programming and Scripting

Use curl to send a static xml file using url encoding to a web page using pos

Hi I am try to use curl to send a static xml file using url encoding to a web page using post. This has to go through a particular port on our firewall as well. This is my first exposure to curl and am not having much success, so any help you can supply, or point me in the right direction would be... (1 Reply)
Discussion started by: Paul Walker
1 Replies

10. Post Here to Contact Site Administrators and Moderators

Page Not Found error while parsing url

Hi I just tried to post following link while answering, its not parsing properly, just try on your browser Tried to paste while answering : https://www.unix.com/302873559-post2.htmlNot operator is not coming with HTML/PHP tags so attaching file (2 Replies)
Discussion started by: Akshay Hegde
2 Replies
Gtk2::GladeXML::Simple(3pm)				User Contributed Perl Documentation			       Gtk2::GladeXML::Simple(3pm)

NAME
Gtk2::GladeXML::Simple - A clean object-oriented interface to Gtk2::GladeXML SYNOPSIS
package MyApp; use base qw( Gtk2::GladeXML::Simple ); sub new { my $class = shift; my $self = $class->SUPER::new( $gladefile ); return $self; } ... # Signal handlers are methods of your class sub on_button_clicked { my $self = shift; # You have access to your widgets directly # or using $self->get_widget( widget_name ) my $button = $self->{button1}; } DESCRIPTION
Gtk2::GladeXML::Simple is a module that provides a clean and easy interface for Gnome/Gtk2 and Glade applications using an object-oriented syntax. You just make Gtk2::GladeXML::Simple your application's base class, have your "new" call "SUPER::new", and the module will do the tedious and dirty work for you. Gtk2::GladeXML::Simple offers: o Signal handler callbacks as methods of your class. sub on_button1_clicked { my $self = shift; # $self always received as first parameter ... # do anything you want in a OO fashioned way } o Autoconnection of signal handlers. o Autocalling of creation functions for custom widgets. o Access to the widgets as instance attributes. my $btn = $self->{button1}; # fetch widgets as instance attributes by their names my $window = $self->{main_window}; my $custom = $self->{custom_widget}; METHODS
This class provides the following public methods: new( $gladefile [, $root, $domain ] ); This method creates a new object of your subclass of Gtk2::GladeXML::Simple. The $gladefile parameter is the name of the file created by the Glade Visual Editor. The $root is an optional parameter that tells "libglade" the name of the widget to start building from. The optional $domain parameter that specifies the translation domain for the glade xml file ( undef by default ). glade_object This method returns the Gtk2::GladeXML object in play. get_widget( $widget_name ) Returns the widget with given name. Same as calling $self->{$widget_name}. get_widgets Returns a list with all the widgets in the glade file. run Call this method in order to run your application. If you need another event loop rather than the Gtk one, override run in your class with your event loop (for example the GStreamer event loop). EXTENDED EXAMPLE
This example shows the usage of the module by creating a small Yahoo search engine using WWW::Search::Yahoo. package YahooApp; use strict; use warnings; use Gtk2 '-init'; use Gtk2::Html2; #not part of the Gtk2 core widgets use Gtk2::GladeXML::Simple; use WWW::Search; use base qw( Gtk2::GladeXML::Simple ); my $header =<<HEADER; <html> <meta HTTP-EQUIV="content-type" CONTENT="text/html; charset=UTF-8"> <header><title>Yahoo Gtk2 App</title> <style type="text/css"> .title {font-family: Georgia; color: blue; font-size: 13px} .description {padding-left: 3px; font-family: Georgia; font-size:10px} .url {padding-left: 3px; font-family: Georgia; font-size:10px; color: green} </style> </head> <body> <h2 style="font-family: Georgia, Arial; font-weight: bold"> Found: </h2> HEADER my $footer =<<FOOTER; </body> </html> FOOTER sub new { my $class = shift; #Calling our super class constructor my $self = $class->SUPER::new( 'yahoo.glade' ); #Initialize the search engine $self->{_yahoo} = WWW::Search->new( 'Yahoo' ); return $self; } sub do_search { my $self = shift; $self->{_yahoo}->native_query( shift ); my $buf = $header; for( 1..10 ) { my $rv = $self->{_yahoo}->next_result || last; $buf .= qq{<p><div class="title">} . $rv->title; $buf .= qq{</div><br /><div class="description">} . $rv->description; $buf .= qq{</div><br /><div class="url">} . $rv->url . q{</div></p><br />}; } $buf .= $footer; $self->{buf} = $buf; } ### Signal handlers, now they're methods of the class ### sub on_Clear_clicked { my $self = shift; my $html = $self->{custom1}; #fetch widgets by their names $html->{document}->clear; my $statusbar = $self->{statusbar1}; #another widget $statusbar->pop( $statusbar->get_context_id( "Yahoo" ) ); } sub on_Search_clicked { my $self = shift; my $text = $self->{text_entry}->get_text; return unless $text ne ''; my $statusbar = $self->{statusbar1}; $statusbar->push( $statusbar->get_context_id( "Yahoo" ), "Searching for: $text" ); $self->do_search( $text ); my $html = $self->{custom1}; $html->{document}->clear; $html->{document}->open_stream( "text/html" ); $html->{document}->write_stream( $self->{buf} ); $html->{document}->close_stream; } ### Creation function for the custom widget, method of the class as well ### sub create_htmlview { my $self = shift; my $view = Gtk2::Html2::View->new; my $document = Gtk2::Html2::Document->new; $view->set_document( $document ); $view->{document} = $document; $view->show_all; return $view; } sub gtk_main_quit { Gtk2->main_quit } 1; package main; YahooApp->new->run; #Go! 1; The yahoo.glade file needed for this example is in the examples directory, along with other example programs. UTILITIES
Rapid Application Development with gpsketcher The Gtk2::GladeXML::Simple distribution includes gpsketcher, a program that generates Perl code stubs from glade XML files. The code stubs include the basic framework for Gtk2::GladeXML::Simple interaction, method signatures, and everything that describes the application itself. Developers must fill in the code stubs to add the correct functionality to the application. SEE ALSO
Gtk2::GladeXML, Gtk2, gpsketcher The Libglade Reference Manual at <http://developer.gnome.org/doc/API/2.0/libglade/> The gtk2 API Reference at <http://developer.gnome.org/doc/API/2.0/gtk/index.html> TODO
Tests. More examples? Add Gtk2::GladeXML::Simple::new_from_buffer()? Support to I18N ( bindtextdomain ) AUTHOR
Marco Antonio Manzo <marcoam@perl.org.mx> Special thanks in no order to Scott Arrington "muppet" <scott at asofyet dot org> who provided lots of great ideas to improve this module. Sandino "tigrux" Flores <tigrux at ximian dot com> who is the author of SimpleGladeApp and the main source of this module's core idea. Sean M. Burke <sburke at cpan dot org> and Rocco Caputo <rcaputo at cpan dot org> for constantly helping me with ideas and cleaning my POD. COPYRIGHT AND LICENSE
Copyright (C) 2005 by Marco Antonio Manzo This library is free software; you can redistribute it and/or modify it under the same terms as Perl itself, either Perl version 5.8.6 or, at your option, any later version of Perl 5 you may have available. perl v5.10.1 2005-07-23 Gtk2::GladeXML::Simple(3pm)
All times are GMT -4. The time now is 07:13 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy