Do you want to capture the HTTP requests and their status?
Try this:
This will get you your files. You need to do the 2>&1 so that the stderr, where wget writes all this info is routed to stdout. This in turn is piped to the egrep which gives you your output.
Where can I find the source code to basic unix core utilities like less, wget, and unzip?
I'm on a HP-UX system that is missing a lot of basic tools. I Don't have admin access to the box. Google searches won't give me the source code.
I would like to install some of the missing tools, like... (4 Replies)
I want to make a script to use wget to find and download mp3s on a website into a directory with a name derived from that URL. So far I have:
#!/bin/sh
echo “MP3 Downloader”
echo -n "Enter full URL address of website or website subdirectory > "
read text
cd ~
mkdir $text
cd $text
... (3 Replies)
Hi All,
I am using wget to call a url..i am getting 202 if it is successful. if not i am forcing the response code to 417.
how can i capture the response code and print 0 if it is 202 and 1 if it is not 202
any ideas, please share
Thanks,
Jack. (2 Replies)
Hi,
I am using a linux with bash.
I have a script written which will login to a remote server and from there it runs a "wget" to downlaod a build file from a webserver.
Here is the line inside the script:
ssh -t -q -o StrictHostKeyChecking=no -o ConnectTimeout=5 root@${a}'wget... (4 Replies)
I am trying to validate links inside file if its up or not.
Heres what I am trying :
#!/bin/bash
link='cat url'
get=$(wget -q "$link")
if
then echo "Link not up"
else echo "OK"
fi
$ ./validate
./validate: line 4:
Please suggest ..
Thanks, (2 Replies)
Hi ,
Iam using " WGET " command to hit the URL,i.e. servlet url.
I can trigger the servlet using wget but when servlet is not responding this command retries automatically until it get the positive response from the server.
So this script is running for more than 8 hrs to get the positive... (2 Replies)
Hi Guys,
Is there any way that we can know whether a website is fullly loaded with Linux command line ?? is there any command in Linux that can achieve that ??
Also,naturally I would also like to get the response code of the particular website/URL that i am testing for ??
Any help would be... (3 Replies)
Can a modified command be used to download multiple source codes from specific sites and output each into a separate output file?. All the sites are in a text file (attached):
wget -qO- http://www.genedx.com/test-catalog/available-tests/edar-gene-sequencing/ | cat > output.txt (4 Replies)
hello
check this script it jump to else part, in n both cases,
(if files exist or not)
wget $MIRROR/kkk.zip && wget $MIRROR/jjj.zip
RC="$?"
if ]
then
echo -e "$RED Ooops, Download links are broken...! $RESET"
else
echo -e "$GREEN Everything is fine, Cheers ... $RESET"
fi (4 Replies)
Hi,
I need help in wget or curl command to invoke a REST client services.
This is the format i need to send request
wget -H "tokenId: F6" -H "Authorization: Basic <64 bit encoded username:password>" -H "https://example.com" -H "Accept: application/Json" -o download.xml... (1 Reply)
Discussion started by: zen01234
1 Replies
LEARN ABOUT DEBIAN
yaz-url
YAZ-URL(1) Commands YAZ-URL(1)NAME
yaz-url - YAZ URL fetch utility
SYNOPSIS
yaz-url [-H name:value] [-m method] [-O fname] [-p fname] [-u user/password] [-x proxy] [url...]
DESCRIPTION
yaz-url is utility to get web content. It is very limited in functionality compared to programs such as curl, wget.
The options must be precede the URL given on the command line to take effect.
Fetched HTTP content is written to stdout, unless option -O is given.
OPTIONS -H name:value
Specifies HTTP header content with name and value. This option can be given multiple times (for different names, of course).
-m method
Specifies the HTTP method to be used for the next URL. Default is method "GET". However, option -p sets it to "POST".
-O fname
Sets output filename for HTTP content.
-p fname
Sets a file to be POSTed in the folloing URL.
-u user/password
Specifies a user and a password to be uesd in HTTP basic authentication in the following URL fetch. The user and password must be
separated by a slash (this it is not possible to specify a user with a slash in it).
-x proxy
Specifies a proxy to be used for URL fetch.
SEE ALSO yaz(7)YAZ 4.2.30 04/16/2012 YAZ-URL(1)