Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: WGET cycling on an updating page
Top Forums Shell Programming and Scripting WGET cycling on an updating page Post 302421446 by prafulnama on Friday 14th of May 2010 10:07:27 AM
Old 05-14-2010
WGET cycling on an updating page
Hello,

I am experiencing an issue while downloading a few pages using wget. All of them work without a problem except one which is a page that does a tail on the log and as a result is constantly getting updated.

wget here seems to run endlessly and needs to be manually killed. I wanted to check if there was something that could be done to prevent this? I am currently letting it run for a specified number of seconds.

The command is
Code:
wget -q --no-check-certificate -O "/home/wgettest"  --user="$user" --password="$password" https://10.10.0.30:8082/Accesslog/tail-f/main

Thanks,
-p
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Power Cycling

Hello Friends , I have been reading some of the Sys Admin notes when i came across a term "Power Cycling" Can anybody please explain what this means Thank You (1 Reply)
Discussion started by: DPAI
1 Replies

2. Shell Programming and Scripting

How to get the page size (of a url) using wget

Hi , I am trying to get page size of a url(e.g.,www.example.com) using wget command.Any thoughts what are the parameters i need to send with wget to get the size alone? Regards, Raj (1 Reply)
Discussion started by: rajbal
1 Replies

3. Shell Programming and Scripting

awk updating one file with another, comparing, updating

Hello, I read and search through this wonderful forum and tried different approaches but it seems I lack some knowledge and neurones ^^ Here is what I'm trying to achieve : file1: test filea 3495; test fileb 4578; test filec 7689; test filey 9978; test filez 12300; file2: test filea... (11 Replies)
Discussion started by: mecano
11 Replies

4. Shell Programming and Scripting

KSH switches editin modes when cycling through history. Why?

Hello all, Working in KSH using Solaris, the default editor is VIM. So, per session, I run a small rc script which calls export editor=emacs This works for commands at the prompt. But if I cycle through command history (Using the up arrow) the command line editor defaults to VIM. How can I... (2 Replies)
Discussion started by: eggmatters
2 Replies

5. UNIX for Dummies Questions & Answers

wget with semicolon in page name

So, I'd like to wget a webpage, as its not going to stick around forever - but the problem is the webpage has a semicolon in it. wget http://example.com/stuff/asdf;asdf obviously doesn't get the right webpage. Any good way around this? (2 Replies)
Discussion started by: Julolidine
2 Replies

6. Shell Programming and Scripting

Print multiple copies page by page using lp command

Hi I have a pdf file that is being generated using the rwrun command in the shell script. I then have the lp command in the shell script to print the same pdf file. Suppose there are 4 pages in the pdf file , I need to print 2 copies of the first page, 2 copies of the second page , then 2... (7 Replies)
Discussion started by: megha2525
7 Replies

7. Shell Programming and Scripting

Wget and single page

Good evening to all!! I'm trying to become familiar with wget. I would like to download a page from Wikipedia with all images and CSSs but without going down to all links present in the page. It should be named index.html. I would like also to save it to /mnt/us inside a new folder. This is... (5 Replies)
Discussion started by: silver18
5 Replies

8. Shell Programming and Scripting

Random web page download wget script

Hi, I've been attempting to create a script that downloads web pages at random intervals to mimic typical user usage. However I'm struggling to link $url to the URL list and thus wget complains of a missing URL. Any ideas? Thanks #!/bin/sh #URL List url1="http://www.bbc.co.uk"... (14 Replies)
Discussion started by: shadyuk
14 Replies

9. Hardware

USB power cycling poblem on RPI

I am having a problem with cycling USB bus power on the RPI B+ (3.18.7+). Each time I power the USB bus off and on, a device plugged into it gets a higher Device number, and eventually the bus crashes (does not enumerate new devices any more) As a demonstration, I wrote the python script... (4 Replies)
Discussion started by: vthielen
4 Replies

10. Shell Programming and Scripting

Wget - working in browser but cannot download from wget

Hi, I need to download a zip file from my the below US govt link. https://www.sam.gov/SAMPortal/extractfiledownload?role=WW&version=SAM&filename=SAM_PUBLIC_MONTHLY_20160207.ZIP I only have wget utility installed on the server. When I use the below command, I am getting error 403... (2 Replies)
Discussion started by: Prasannag87
2 Replies

LEARN ABOUT LINUX

update-smart-drivedb

UPDATE-SMART-DRIVEDB(8)                                       SMART Monitoring Tools                                       UPDATE-SMART-DRIVEDB(8)

NAME

       update-smart-drivedb - update smartmontools drive database

SYNOPSIS

       update-smart-drivedb [OPTIONS] [DESTFILE]

DESCRIPTION

       [This man page is generated for the Linux version of smartmontools.  It does not contain info specific to other platforms.]

       update-smart-drivedb updates /var/lib/smartmontools/drivedb/drivedb.h or DESTFILE from smartmontools SVN repository.

       It  tries  to  download  first  from  the  current  branch and then from trunk. The tools used for downloading are either curl(1), wget(1),
       lynx(1), or svn(1).

       The old file is kept if the downloaded file is identical (ignoring the differences in Id string) otherwise it is moved to drivedb.h.old.

OPTIONS

       -s SMARTCTL
              Use the smartctl(8) executable at path SMARTCTL for drive database syntax check.  The form '-s -' disables the  syntax  check.   The
              default is /usr/sbin/smartctl.

       -t TOOL
              Use TOOL for download.  TOOL is one of: curl wget lynx svn.  The default is the first one found in PATH.

       -u LOCATION
              Use URL of LOCATION for download. LOCATION is one of:
              sf (Sourceforge code browser via HTTPS),
              svn (SVN repository via HTTPS),
              svni (SVN repository via HTTP),
              trac (Trac code browser via HTTPS).
              The default is svn.

       --cacert FILE
              Use CA certificates from FILE to verify the peer.

       --capath DIR
              Use CA certificate files from DIR to verify the peer.

       --insecure
              Don't abort download if certificate verification fails.  This option is also required if a HTTP URL is selected with '-u' option.

       --dryrun
              Print download commands only.

       -v     Verbose output.

EXAMPLES

       # update-smart-drivedb
       /var/lib/smartmontools/drivedb/drivedb.h updated from branches/RELEASE_6_6_DRIVEDB

EXIT STATUS

       The exit status is 0 if the database has been successfully updated. If an error occurs the exit status is 1.

FILES

       /usr/sbin/update-smart-drivedb
              full path of this script.

       /usr/sbin/smartctl
              used to check syntax of new drive database.

       /var/lib/smartmontools/drivedb/drivedb.h
              current drive database.

       /var/lib/smartmontools/drivedb/drivedb.h.old
              previous drive database.

       /var/lib/smartmontools/drivedb/drivedb.h.error
              new drive database if rejected due to syntax errors.

       /var/lib/smartmontools/drivedb/drivedb.h.lastcheck
              empty file created if downloaded file was identical.

AUTHORS

       Christian Franke.
       This manual page was originally written by Hannes von Haugwitz <hannes@vonhaugwitz.com>.

REPORTING BUGS

       To submit a bug report, create a ticket in smartmontools wiki:
       <http://www.smartmontools.org/>.
       Alternatively send the info to the smartmontools support mailing list:
       <https://lists.sourceforge.net/lists/listinfo/smartmontools-support>.

SEE ALSO

       smartctl(8), smartd(8).

PACKAGE VERSION

       smartmontools-6.6 2016-05-31 r4324
       $Id: update-smart-drivedb.8.in 4223 2016-02-26 20:18:40Z chrfranke $

smartmontools-6.6                                                   2016-05-31                                             UPDATE-SMART-DRIVEDB(8)
All times are GMT -4. The time now is 03:34 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy