Sponsored Content
Top Forums Shell Programming and Scripting write page source to standard output Post 302216331 by Ikon on Friday 18th of July 2008 04:46:48 PM
Old 07-18-2008
This works for me:

Code:
use strict;
use warnings;
use LWP::Simple;
 
my $web = get('http://www.perl.com');
print "$web";


To write to file just:

perl thisscript.pl > /path/to/some/file.log
 

8 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Getting source code of a page

I want to download a particular page from the internet and get the source code of the page in html format. I want to parse the source code to find a specific parameters using grep command. could someone tell me the linux command to download a specific page and parse the source code of it. ... (1 Reply)
Discussion started by: ahamed
1 Replies

2. UNIX for Dummies Questions & Answers

Redirect Standard output and standard error into spreadsheet

Hey, I'm completely new at this and I was wondering if there is a way that I would be able to redirect the log files in a directories standard output and standard error into and excel spreadsheet in anyway? Please remember don't use too advanced of terminology as I just started using shell... (6 Replies)
Discussion started by: killaram
6 Replies

3. Shell Programming and Scripting

sed command works from cmd line to standard output but will not write to file

Hi all .... vexing problem here ... I am using sed to replace some special characters in a .txt file: sed -e 's/_<ED>_/_355_/g;s/_<F3>_/_363_/g;s/_<E1>_/_341_/g' filename.txt This command replaces <ED> with í , <F3> with ó and <E1> with á. When I run the command to standard output, it works... (1 Reply)
Discussion started by: crumplecrap
1 Replies

4. UNIX for Dummies Questions & Answers

display command output page per page

Good afternoon, I wonder how i could use unix commands to ease the reading of long command result output ? like the "php -i" or any other command that returns a long answer. I could not find the right terms to Google it or search the forum. Therefore I bother you with this question. ... (3 Replies)
Discussion started by: Mat_k
3 Replies

5. Shell Programming and Scripting

web page source cleanup

is it possible to pass webpages to remove all tag style information, but leave the tag... say I have <h1 style='font-size: xxx; color: xxxxxx'>headline 1</h1> i want to get <h1>headline 1</h1> BTW, i got an oneliner here to remove all tags: sed -n '/^$/!{s/<*>//g;p; Thanks a... (4 Replies)
Discussion started by: dtdt
4 Replies

6. Shell Programming and Scripting

Performing extractions on web source page

I have downloaded a web source page to a file. I then egrep a single word to extract a line containing it to another file. I then cat the second file and remove everything before a word and after a second word to capture the phrase desired. This did not work. I used vi to validate that the 2... (1 Reply)
Discussion started by: slak0
1 Replies

7. Shell Programming and Scripting

Save page source, including javascript

I need to get the source code of a webpage. I have tried to use wget and curl, but it doesn't show the necessary javascript part of the source. I don't have to execute it, only to view the source. How do I do that? (1 Reply)
Discussion started by: locoroco
1 Replies

8. Red Hat

Command understanding the output file destination in case of standard output!!!!!

I ran the following command. cat abc.c > abc.c I got message the following message from command cat: cat: abc.c : input file is same as the output file How the command came to know of the destination file name as the command is sending output to standard file. (3 Replies)
Discussion started by: ravisingh
3 Replies
Arch::LiteWeb(3pm)					User Contributed Perl Documentation					Arch::LiteWeb(3pm)

NAME
Arch::LiteWeb - simple way to access web pages SYNOPSIS
my $web = Arch::LiteWeb->new; my $content = $web->get("http://some.domain:81/some/path"); die $web->error . " while processing " . $web->request_url unless $content; my $content_type = $web->response_headers->{content_type}; DESCRIPTION
This class provides a basic and easy to use support for the client-side HTTP. It is supplied in order to avoid dependency on LWP. If such dependency is not a problem, consider to use LWP instead that provides much better support for HTTP and other protocols. METHODS
The following class methods are available: get, post, request_url, error, error_with_url, network_error, response_code, response_codestr, response_error, response_headers, response_content. get url [params ...] Execute HTTP get of the given url and return the html string or undef on network/response error. Use other methods to get the details about the error and the response. params is key-value hash, the following keys are supported: url_host - only used if url is none url_port - only used if url is none(80) url_path - only used if url is none endl - default is "1512" timeout - default is 20 seconds user_agent - default is "Arch::LiteWeb/0.1" nocache - add a no-cache header noredirect - don't follow redirect responses max_redirect_depth - default is 5 use_proxy - default is false proxy_url - proxy url ($http_proxy supported too) proxy_host - only used if proxy_url is none proxy_port - only used if proxy_url is none(80) post url input [params] Not implemented yet. request_url Actual url of the last issued request or undef. If partial redirect responses are enabled, then the result is the last (non-redirect) url. error If the last request resulted in error (i.e. get/post returned undef), then this method returns the error message, otherwise it returns undef. This is just a shortcut for network_error || response_error. error_with_url Like error, but with " while fetching request_url " text appended if non undef. network_error The network error message for the last request or undef. response_error The response error message for the last request or undef. response_code The last response code (integer) or undef. response_codestr The last response code (string) or undef. response_headers The last response headers (hashref of HTTP headers) or undef. response_content The last response content or undef. This is the same thing that the last get/post returns. BUGS
Not intended for use in mission-critical applications. AUTHORS
Mikhael Goikhman (migo@homemail.com--Perl-GPL/arch-perl--devel). SEE ALSO
For more information, see LWP, LWP::Simple. perl v5.10.1 2005-03-25 Arch::LiteWeb(3pm)
All times are GMT -4. The time now is 03:50 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy