Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: gather, modify stats, email to self
Top Forums Shell Programming and Scripting gather, modify stats, email to self Post 302486389 by ScannerDarkly on Saturday 8th of January 2011 06:43:18 AM
Old 01-08-2011
Question gather, modify stats, email to self
I have a range of log files from rsync on an Ubuntu 10.04 server. At the bottom of these files, I have "--stats" -- a rsync switch -- which produces interesting information/statistics.

Steps the script will take:
  • take the the lines that contain the words "sent, total size, bytes"
  • put these into a text file
  • format the text e.g. "MiB transferred: ####MiB"
  • pipe the text file to mailx with the subject "rsync stats yyyy/mm/dd"
  • daily cron job
I'm a novice to this sort of work. I don't know what the best tools to use would be. Perhaps I could tail the information to the text file?, and then use a tool to format the text nicely. I don't know if grep would suffice to grab those bottom 12 lines or so, or if I should dive into the sed/awk world? Maybe even a shell/perl/python script? If you could point me into a good direction with suggestions, that'd be great
Last edited by ScannerDarkly; 01-08-2011 at 08:13 AM.. Reason: typo
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

script to gather weblogic jvm heap size stats

Hello, has anyone written something that will monitor/gather weblogic heap info ? I need to gather size, high/low stats to a file that I can upload to a speadsheet thanks for your help! (2 Replies)
Discussion started by: galenw
2 Replies

2. Shell Programming and Scripting

Gather File permission during scripting on unix as numbers.

Hi, I have a script with following file permission on box. -rwxr-xr-x 1 root system 15347 Aug 14 15:08 b_reboot.ksh Without calculating or watching at -rwxr-xr-x (permission's) of this above mentioned file. I would like to get the file permission assigned to a file. Basically... (7 Replies)
Discussion started by: ajilesh
7 Replies

3. Shell Programming and Scripting

FTP script to gather logs.

Hi, I am currently working on a FTP script which would ftp to extranet servers from intranet server and gather logs based on timestamps in archive logs and by using a wildcard character in the present logs. I have the following in place AAA="Extranet Server 1:Instance Extranet Server... (2 Replies)
Discussion started by: openspark
2 Replies

4. AIX

IO Stats

Aix 5.3 I am trying to view the IO stats. I do the sar 5 5 but that is the WIO and si different than the IO stats right? I am just blanking on this. I know there is a command that I used to run that brings up a whole bunch of live stats that run live such as mem and so on just can't rememeber... (4 Replies)
Discussion started by: rocker40
4 Replies

5. AIX

Using NIM to gather system information

Hi, Need help if its possible to use NIM server to gather information. Basically, we need to gather firmware version and oslevel for environment wide servers (these servers are connected thru nim). I understand you can use NIM script resource to trigger the script but don't know if possible to... (3 Replies)
Discussion started by: depam
3 Replies

6. AIX

how to gather HMC information

does somebody know how to gather HMC information? It looks like there is some tool can gather HMC configuration to a html file and make them as a xx.tar.gz file? (2 Replies)
Discussion started by: rainbow_bean
2 Replies

7. UNIX for Dummies Questions & Answers

How can I use my code to gather information from a file in a completely different directory?

I need my code to compare two different files that are in two completely different directories, How can I do this? So for example, my code will look at file1 which is in my home directory, and compare the files with those from file2 that is in /abc/adf/adr/afc/adf/file2... does that make sense? (1 Reply)
Discussion started by: castrojc
1 Replies

8. Shell Programming and Scripting

Execute Oracle gather stats via shell script

Hi , I am trying to automate a gather stats in shell script #!/usr/bin/ksh export ORACLE_HOME=/orcl/app/oracle/product/11.2.0.1/db_1 export PATH="$PATH:$ORACLE_HOME/bin" export LD_LIBRARY_PATH="$LD_LIBRARY_PATH:$ORACLE_HOME/lib32" export TNS_ADMIN=/opt/netprobe/config... (1 Reply)
Discussion started by: neil.k
1 Replies

9. Shell Programming and Scripting

Script to Gather data from logs and export to a CSV file

Greetings, After a few hours of trial and error, I decide to ask for some help. I am new to AWK and shell script, so please don't laugh :p I made the below script, to gather data from some logs and have the output into a CSV file : #!/bin/sh #Script to collect Errors ... (9 Replies)
Discussion started by: Yagami_Sama
9 Replies

10. UNIX for Beginners Questions & Answers

Create a shell script to gather user account information and displays the result to administrator

I want to create a shell script to gather user account information and displays the result to administrator. I have created a script but its showing all the information when i search for username like: amit@mx:~$ ./uinfo.sh amit Username : amit User Info ... (2 Replies)
Discussion started by: amit1986
2 Replies

LEARN ABOUT CENTOS

cracklib-format

cracklib-format(8)					      Debian GNU/Linux manual						cracklib-format(8)

NAME

       cracklib-format, cracklib-packer, cracklib-unpacker - cracklib dictionary utilities

SYNOPSIS

       cracklib-format file ...

       cracklib-packer cracklib_dictpath

       cracklib-unpacker cracklib_dictpath

DESCRIPTION

       cracklib-format	takes a list of text files each containing a list of words, one per line, It lowercases all words, removes control charac-
       ters, and sorts the lists.  It outputs the cleaned up list to standard output.  The text files may be optionally compressed with gzip(1).

       If you supply massive amounts of text to cracklib-format you must have enough free space available for use by the sort(1) command.  If  you
       do not have 20Mb free in /var/tmp (or whatever temporary area your sort(1) command uses), have a look at the /usr/sbin/cracklib-format pro-
       gram which is a sh(1) program.  You can usually tweak the sort(1) command to use any large area of disk	you  desire,  by  use  of  the	-T
       option.	cracklib-format has a hook for this.

       cracklib-packer	reads  from  standard input a list of sorted and cleaned words and creates a database in the directory and prefix given by
       the command line argument cracklib_dictpath.  Three files are created with the suffixes of .hwm, .pwd, and .pwi.  These three files are	in
       the  format  that  the  FascistCheck(3) subroutine, cracklib-unpacker(8), and cracklib-check(8), utilities understand.  The number of words
       read and written are printed on stdout(3).

       cracklib-unpacker reads from the database in the directory and prefix given by the command line argument cracklib_dictpath and  outputs	on
       standard output the list of words that make up the database.

       The  database  is in a binary format generated by the utilities cracklib-format(8) and cracklib-packer(8).  On a Debian system the database
       is located in the directory /var/cache/cracklib/cracklib_dict and is generated daily with the program /etc/cron.daily/cracklib.	The  loca-
       tion  is  also  defined	in  the  header  file  crack.h using the constant CRACKLIB_DICTPATH though none of the subroutines in the cracklib
       libraries have this location hardcoded into their implementations.

FILES

       /var/cache/cracklib/cracklib_dict.[hwm|pwd|pwi]
	      cracklib dictionary database files used by utilities.

       /etc/cron.daily/cracklib
	      cracklib daily cron program to rebuild the cracklib dictionary database.

       /etc/cracklib/cracklib.conf
	      cracklib configuration file used by the cracklib daily cron program to rebuild the cracklib dictionary database.

       /usr/include/crack.h
	      cracklib header file defining the subroutine FascistCheck(3) and the constant CRACKLIB_DICTPATH used to compile in the  location	of
	      the cracklib dictionary database for these utilities.

       /usr/sbin/cracklib-format
	      cracklib shell script to create initial list of words for dictionary database.

SEE ALSO

       FascistCheck(3), cracklib-check(8), update-cracklib(8), create-cracklib-dict(8)
       /usr/share/doc/libcrack2/libcrack2.html
       /usr/share/doc/cracklib-runtime/cracklib-runtime.html

AUTHOR

       cracklib2 is written by Alec Muffett <alecm@crypto.dircon.co.uk>. Manual added by Jean Pierre LeJacq <jplejacq@quoininc.com>.

2.7-8.5 						   Sat Jun 21 22:43:12 CEST 2008					cracklib-format(8)
All times are GMT -4. The time now is 01:36 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy