I want to download a particular page from the internet and get the source code of the page in html format.
I want to parse the source code to find a specific parameters using grep command.
could someone tell me the linux command to download a specific page and parse the source code of it.
... (1 Reply)
Hey, I'm completely new at this and I was wondering if there is a way that I would be able to redirect the log files in a directories standard output and standard error into and excel spreadsheet in anyway?
Please remember don't use too advanced of terminology as I just started using shell... (6 Replies)
Hi all .... vexing problem here ...
I am using sed to replace some special characters in a .txt file:
sed -e 's/_<ED>_/_355_/g;s/_<F3>_/_363_/g;s/_<E1>_/_341_/g' filename.txt
This command replaces <ED> with í , <F3> with ó and <E1> with á.
When I run the command to standard output, it works... (1 Reply)
Good afternoon,
I wonder how i could use unix commands to ease the reading of long command result output ?
like the "php -i" or any other command that returns a long answer.
I could not find the right terms to Google it or search the forum. Therefore I bother you with this question.
... (3 Replies)
is it possible to pass webpages to remove all tag style information, but leave the tag...
say I have
<h1 style='font-size: xxx; color: xxxxxx'>headline 1</h1>
i want to get
<h1>headline 1</h1>
BTW, i got an oneliner here to remove all tags:
sed -n '/^$/!{s/<*>//g;p;
Thanks a... (4 Replies)
I have downloaded a web source page to a file. I then egrep a single word to extract a line containing it to another file.
I then cat the second file and remove everything before a word and after a second word to capture the phrase desired.
This did not work. I used vi to validate that the 2... (1 Reply)
I need to get the source code of a webpage. I have tried to use wget and curl, but it doesn't show the necessary javascript part of the source. I don't have to execute it, only to view the source.
How do I do that? (1 Reply)
I ran the following command.
cat abc.c > abc.c
I got message the following message from command cat:
cat: abc.c : input file is same as the output file
How the command came to know of the destination file name as the command is sending output to standard file. (3 Replies)
Discussion started by: ravisingh
3 Replies
LEARN ABOUT DEBIAN
lwp::protocol::socks4
LWP::Protocol::socks4(3pm) User Contributed Perl Documentation LWP::Protocol::socks4(3pm)NAME
LWP::Protocol::socks - adds support for the socks protocol and proxy facility
SYNOPSIS
use LWP::Protocol::socks;
DESCRIPTION
Use this package when you wish to use a socks proxy for your connections.
It provides some essential hooks into the LWP system to implement a socks "scheme" similar to http for describing your socks connection,
and can be used to proxy either http or https connections.
The use case is to use LWP::UserAgent's proxy method to register your socks proxy like so:
$ua->proxy([qw(http https)] => 'socks://socks.yahoo.com:1080');
Then just use your $ua object as usual!
EXAMPLES
#!/usr/local/bin/perl
use strict;
use LWP::UserAgent;
my $ua = new LWP::UserAgent(agent => 'Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.5) Gecko/20060719 Firefox/1.5.0.5');
$ua->proxy([qw(http https)] => 'socks://socks.yahoo.com:1080');
my $response = $ua->get("http://www.freebsd.org");
print $response->code,' ', $response->message,"
";
my $response = $ua->get("https://www.microsoft.com");
print $response->code,' ', $response->message,"
";
SEE ALSO
URI::socks4
LWP::Protocol::socks
AUTHORS
Oleg G <oleg@cpan.org>
perl v5.14.2 2012-02-12 LWP::Protocol::socks4(3pm)