Sponsored Content
Top Forums Shell Programming and Scripting Extract urls from index.html downloaded using wget Post 302462269 by mnanavati on Wednesday 13th of October 2010 06:34:27 PM
Old 10-13-2010
This creates a directory structure of the site itself. I donot want to create a directory stucture. Basically, just like index.html , i want to have another text file that contains all the URLs present in the site.

Thanks,
M
 

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Extract URLs from HTML code using sed

Hello, i try to extract urls from google-search-results, but i have problem with sed filtering of html-code. what i wont is just list of urls thay apears between ........<p><a href=" and next following " in html code. here is my code, i use wget and pipelines to filtering. wget works, but... (13 Replies)
Discussion started by: L0rd
13 Replies

2. Shell Programming and Scripting

how to limit files downloaded by wget

I am trying to download a page and retrieve only wav and mp3 files via wget. the website is: Alarm Sounds | Free Sound Effects | Alarm Sound Clips | Sound Bites my command is : wget -rl 2 -e robots=off -A wav,mp3 http://soundbible.com/tags-alarm.html When not using the -A wav,mp3... (2 Replies)
Discussion started by: Narnie
2 Replies

3. Shell Programming and Scripting

Help with WGET and renaming downloaded files :(

Hi everybody, I would greatly appreciate some expertise in this matter. I am trying find an efficient way to batch download files from a website and rename each file with the url it originated from (from the CLI). (ie. Instead of xyz.zip, the output file would be http://www.abc.com/xyz.zip) A... (10 Replies)
Discussion started by: o0110o
10 Replies

4. Shell Programming and Scripting

Remove external urls from .html file

Hi everyone. I have an html file with lines like so: link href="localFolder/..."> link href="htp://..."> img src="localFolder/..."> img src="htp://..."> I want to remove the links with http in the href and imgs with http in its src. I'm having trouble removing them because there... (4 Replies)
Discussion started by: CowCow339
4 Replies

5. Shell Programming and Scripting

extract fields from a downloaded html file

I have around 100 html files and in each html file I have 5-6 such paragraphs of a company and I need to extract the Name of the company from either the one after "title" or "/company" and then the number of employees and finally the location . <div class="search_result"> <div... (1 Reply)
Discussion started by: gubbu
1 Replies

6. Shell Programming and Scripting

How to remove urls from html files

Does anybody know how to remove all urls from html files? all urls are links with anchor texts in the form of <a href="http://www.anydomain.com">ANCHOR</a> they may start with www or not. Goal is to delete all urls and keep the ANCHOR text and if possible to change tags around anchor to... (2 Replies)
Discussion started by: georgi58
2 Replies

7. Shell Programming and Scripting

Specific image to be downloaded with wget

Hello All, I have gone through Google and came to know that we can download images from a site using wget. Now I am been asked to check whether an image is populated in a site or not. If yes, please send that image to an address as an attachment.. Say for example, the site is Wiki -... (6 Replies)
Discussion started by: sathyaonnuix
6 Replies

8. UNIX for Dummies Questions & Answers

Wget -i URLs.txt problem

Hi Everyone, I have a problem with wget using an input file of URLs. When I execute this -> wget -i URLs.txt I get the login.php pages transferred but not the files I have in the URLs.txt file. I need to use the input file because it will have new products to download each week. I want my VA to... (3 Replies)
Discussion started by: Keith londrie
3 Replies

9. Shell Programming and Scripting

BASH scripting - Preventing wget messed downloaded files

hello. How can I detect within script, that the downloaded file had not a correct size. linux:~ # wget --limit-rate=20k --ignore-length -O /Software_Downloaded/MULTIMEDIA_ADDON/skype-4.1.0.20-suse.i586.rpm ... (6 Replies)
Discussion started by: jcdole
6 Replies
Catalyst::Helper::View::TTSite(3pm)			User Contributed Perl Documentation		       Catalyst::Helper::View::TTSite(3pm)

NAME
Catalyst::Helper::View::TTSite - Helper for TT view which builds a skeleton web site SYNOPSIS
# use the helper to create the view module and templates $ script/myapp_create.pl view HTML TTSite # add something like the following to your main application module sub message : Global { my ( $self, $c ) = @_; $c->stash->{template} = 'message.tt2'; $c->stash->{message} ||= $c->req->param('message') || 'No message'; } sub default : Private { my ( $self, $c ) = @_; $c->stash->{template} = 'welcome.tt2'; } sub end : Private { # Or use Catalyst::Action::RenderView my ( $self, $c ) = @_; $c->forward( $c->view('HTML') ); } DESCRIPTION
This helper module creates a TT View module. It goes further than Catalyst::Helper::View::TT in that it additionally creates a simple set of templates to get you started with your web site presentation. It creates the templates in root/ directory underneath your main project directory. In here two further subdirectories are created: root/src which contains the main page templates, and root/lib containing a library of other template components (header, footer, etc.) that the page templates use. The view module that the helper creates is automatically configured to locate these templates. Default Rendering To render a template the following process is applied: The configuration template root/lib/config/main is rendered. This is controlled by the "PRE_PROCESS" configuration variable set in the controller generated by Catalyst::Helper::View::TTsite. Additionally, templates referenced by the "PROCESS" directive will then be rendered. By default the following additional templates are set: root/lib/config/col, which defines color names and RGB their RGB values and /root/lib/config/url, which defines site wide variables available to templates. Next, the template defined by the "WRAPPER" config variable is called. The default wrapper template is located in root/lib/site/wrapper. The wrapper template passes files with ".css/.js/.txt" extensions through as text OR processes the templates defined after the "WRAPPER" directive: "site/html" and "site/layout". Based on the default value of the "WRAPPER" directive in root/lib/site/wrapper, the following templates are processed in order: o root/src/your_template.tt2 o root/lib/site/footer o root/lib/site/header o root/lib/site/layout o root/lib/site/html Finally, the rendered content is returned to the bowser. METHODS
mk_compclass Generates the component class. mk_templates Generates the templates. SEE ALSO
Catalyst, Catalyst::View::TT, Catalyst::Helper, Catalyst::Helper::View::TT AUTHOR
Andy Wardley <abw@cpan.org> LICENSE
This library is free software. You can redistribute it and/or modify it under the same terms as perl itself. NAME
[% class %] - Catalyst TTSite View SYNOPSIS
See "[% app %]" DESCRIPTION
Catalyst TTSite View. AUTHOR
[% author %] LICENSE
This library is free software. You can redistribute it and/or modify it under the same terms as Perl itself. perl v5.14.2 2011-08-02 Catalyst::Helper::View::TTSite(3pm)
All times are GMT -4. The time now is 09:56 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy