WGET cycling on an updating page

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Wget - working in browser but cannot download from wget

Hi, I need to download a zip file from my the below US govt link. https://www.sam.gov/SAMPortal/extractfiledownload?role=WW&version=SAM&filename=SAM_PUBLIC_MONTHLY_20160207.ZIP I only have wget utility installed on the server. When I use the below command, I am getting error 403...

2. Hardware

USB power cycling poblem on RPI

I am having a problem with cycling USB bus power on the RPI B+ (3.18.7+). Each time I power the USB bus off and on, a device plugged into it gets a higher Device number, and eventually the bus crashes (does not enumerate new devices any more) As a demonstration, I wrote the python script...

3. Shell Programming and Scripting

Random web page download wget script

Hi, I've been attempting to create a script that downloads web pages at random intervals to mimic typical user usage. However I'm struggling to link $url to the URL list and thus wget complains of a missing URL. Any ideas? Thanks #!/bin/sh #URL List url1="http://www.bbc.co.uk"...

4. Shell Programming and Scripting

Wget and single page

Good evening to all!! I'm trying to become familiar with wget. I would like to download a page from Wikipedia with all images and CSSs but without going down to all links present in the page. It should be named index.html. I would like also to save it to /mnt/us inside a new folder. This is...

5. Shell Programming and Scripting

Print multiple copies page by page using lp command

Hi I have a pdf file that is being generated using the rwrun command in the shell script. I then have the lp command in the shell script to print the same pdf file. Suppose there are 4 pages in the pdf file , I need to print 2 copies of the first page, 2 copies of the second page , then 2...

6. UNIX for Dummies Questions & Answers

wget with semicolon in page name

So, I'd like to wget a webpage, as its not going to stick around forever - but the problem is the webpage has a semicolon in it. wget http://example.com/stuff/asdf;asdf obviously doesn't get the right webpage. Any good way around this?

7. Shell Programming and Scripting

KSH switches editin modes when cycling through history. Why?

Hello all, Working in KSH using Solaris, the default editor is VIM. So, per session, I run a small rc script which calls export editor=emacs This works for commands at the prompt. But if I cycle through command history (Using the up arrow) the command line editor defaults to VIM. How can I...

8. Shell Programming and Scripting

awk updating one file with another, comparing, updating

Hello, I read and search through this wonderful forum and tried different approaches but it seems I lack some knowledge and neurones ^^ Here is what I'm trying to achieve : file1: test filea 3495; test fileb 4578; test filec 7689; test filey 9978; test filez 12300; file2: test filea...

9. Shell Programming and Scripting

How to get the page size (of a url) using wget

Hi , I am trying to get page size of a url(e.g.,www.example.com) using wget command.Any thoughts what are the parameters i need to send with wget to get the size alone? Regards, Raj

10. UNIX for Dummies Questions & Answers

Power Cycling

Hello Friends , I have been reading some of the Sys Admin notes when i came across a term "Power Cycling" Can anybody please explain what this means Thank You

LEARN ABOUT DEBIAN

logtop

LOGTOP(1)						      General Commands Manual							 LOGTOP(1)

NAME

       logtop - Realtime log line rate analyser

SYNOPSIS

       logtop [OPTIONS]

DESCRIPTION

	logtop is a System Administrator tool analyzing line rate on stdin.
	It reads on stdin and print a constantly updated result
	displaying, in columns:
	Line number, count, frequency, and the actual line.

	 $ tail -f FILE | logtop
	is the friendly version of:
	 $ watch 'tail FILE | sort | uniq -c | sort -gr'

OPTIONS

       -s, --size=K
	      Only keep K lines in memory, instead of 10000.

       -q, --quiet
	      Do not display a live view of the data, only display a top at exit.

       -l, --line-by-line=K
	      Print result line by line, in a machine friendly format, K is the number of result to print per line.

		Line by line format is : [%d %f %s	]*

		  %d : Number of occurences
		  %f : Frequency of apparition
		  %s : String (Control chars replaced by dots.

       -i, --interval=K
	      Interval between graphical updates, in seconds. Defaults to 1.

       -h, --help
	      Show summary of options.

       -v, --version
	      Show version of program.

EXAMPLES

       Here are some logtop usage examples.

       tail -f cache.log | grep -o "HIT|MISS" | logtop

       Realtime hit / miss ratio on some caching software log file.

       tail -f access.log | cut -d' ' -f1 | logtop -s 10000

       Realtime most querying IPs on your server, as long as log lines in access.log starts with the client IP.

       tail -f access.log | cut -d' ' -f7 | logtop -s 10000

       Realtime most requested web pages in a NCSA like log file.

       cat auth.log | grep -v "CRON" | grep -o ": .*" | logtop -q -s 100000

       Display a one-shot simple analyse of your auth.log.

SEE ALSO

       watch(1)

AUTHOR

       logtop was written by Julien Palard.

       This manual page was written by Julien Palard <julien@palard.fr>, for the Debian project (and may be used by others).

								  April 16, 2011							 LOGTOP(1)

Shell Programming and Scripting