Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Grep string from logs of last 1 hour on files of 2 different servers and calculate count
Top Forums Shell Programming and Scripting Grep string from logs of last 1 hour on files of 2 different servers and calculate count Post 302451161 by poweroflinux on Monday 6th of September 2010 01:19:48 AM
Old 09-06-2010
Question Grep string from logs of last 1 hour on files of 2 different servers and calculate count
Hi frank,

Check my output below and suggest the changes that have to be done or more optimized way of doing that:
Code:
+ set -u
++ date '+%d-%b-%Y %T'
+ to='06-Sep-2010 10:46:22'
+ echo 06-Sep-2010 10:46:22
06-Sep-2010 10:46:22
++ date +%s
+ let from_in_seconds=1283750182-900
++ date -d @1283749282 '+%d-%b-%Y %T'
+ from='06-Sep-2010 10:31:22'
+ echo 06-Sep-2010 10:31:22
06-Sep-2010 10:31:22
+ shortcodes=("56882")
+ for shortcode in '${shortcodes[@]}'
+ count=0
++ awk '$0>=from && $0<=to' 'from=06-Sep-2010 10:31:22' 'to=06-Sep-2010 10:46:22' /opt/bea/ocsg_4.1/logs/customlogs/App_OP.log
++ grep -c ShortCode=tel:56882
+ sh_count=0
++ expr 0 + 0
+ count=0
++ ssh -n smehan@172.30.16.225
+ grep -c ShortCode=tel:56882
Pseudo-terminal will not be allocated because stdin is not a terminal.
+ sh_count2=awk
+ '$0>=from && $0<=to' 'from=06-Sep-2010 10:31:22' 'to=06-Sep-2010 10:46:22' /opt/bea/ocsg_4.1/logs/customlogs/App_OP.log
./test_mo_count2: line 17: $0>=from && $0<=to: command not found
0
./test_mo_count2: line 18: sh_count2: unbound variable
+ count=
+ echo '56882 : '
56882 :

Quote:
Originally Posted by frank_rizzo
add these lines to the top of the script(but after the first line) and then post the entire output. the command your running remotely is kind of complex to troubleshoot because of the variables and quoting. can you put the logic in a script on the remote side and then just execute the script?

Code:
set -x
set -u

another suggestion - use
Code:
grep -c

instead of
Code:
|wc -l

you could easily remove the grep and place use the logic in awk to streamline even further.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

how to calculate busy hour

Dear All, please tell me any script which can able to calculate the bus hours by claculating the volume for example hour volume 1 100 2 200 3 300 4 7000 5 50 6 80 7 77 8 77 9 165 10 888 11 99 12 89 13 33 14 676 15 878 16 90 17 56 (14 Replies)
Discussion started by: shary
14 Replies

2. Shell Programming and Scripting

Count files every hour

Hi, I have a directory which uploads files every minute.I want to check the number of files uploaded for every one hour. I want to run a cron every hour to chk this but iam hanged like how to write the script. Like the script should count for one hr ie from 00:00 to 01:00 hrs then next hr... (3 Replies)
Discussion started by: nessj
3 Replies

3. Shell Programming and Scripting

Parse file from remote server to calculate count of string existence in that file

Hi I need to parse the file of same name which exist on different servers and calculate the count of string existed in both files. Say a file abc.log exist on 2 servers. I want to search for string "test" on both files and calculate the total count of search string's existence. For... (6 Replies)
Discussion started by: poweroflinux
6 Replies

4. UNIX for Dummies Questions & Answers

Rotate logs every 1 hour

Hello All, I am learning unix and basically I want to rotate one of my application logs every 1 hour. I need to rotate that file every one hour. I looked in the forums and googled.. but couldn;t get proper information. Requesting you all to kindly guide me. Our application is running on... (4 Replies)
Discussion started by: arunpvp
4 Replies

5. Shell Programming and Scripting

script to grep latest outofmemory string from the logs

I have requirement to prepare script which will grep for latest outofmemory message from the logs. I have used following command to grep the string from the logs,this script is not effective when logs are not getting updated as it will grep for old message. f=catalina.out var=`tail -10 $f |... (17 Replies)
Discussion started by: coolguyamy
17 Replies

6. Shell Programming and Scripting

Calculate total of log by hour

Hi, Just wondering, is there anyway I can get the total of logs generated by hours ? Let say I have these logs, Sep 23 04:48:43 hsbcufs: NOTICE: realloccg /: file system full Sep 23 04:48:47 hsbcufs: NOTICE: alloc: /: file system full Sep 23 04:48:51 hsbcufs: NOTICE: realloccg /: file... (14 Replies)
Discussion started by: dehetoxic
14 Replies

7. Shell Programming and Scripting

Finding/Grep on files with date and hour in the file name

Hi, I have a folder structure as follows, DATA -> 2012-01-01 -> 00 -> ABC_2012-01-03_00.txt -> 01 -> ABC_2012-01-03_01.txt -> 02 -> ABC_2012-01-03_02.txt ... -> 23 -> ABC_2012-01-03_02.txt -> 2012-01-02 -> 2012-01-03 So the dir DATA contains the above hierarchy, User input Start and... (6 Replies)
Discussion started by: mihirvora16
6 Replies

8. UNIX for Advanced & Expert Users

Finding/Grep on files with date and hour in the file name

Hi, I have a folder structure as follows, DATA -> 2012-01-01 -> 00 -> ABC_2012-01-03_00.txt -> 01 -> ABC_2012-01-03_01.txt -> 02 -> ABC_2012-01-03_02.txt ... -> 23 -> ABC_2012-01-03_02.txt -> 2012-01-02 ... (1 Reply)
Discussion started by: mihirvora16
1 Replies

9. Shell Programming and Scripting

Search string or words in logs without using Grep

I'm in need of some kind of script that will search for a string in each logfile in a directory but we don't want to use GREP. GREP seems to use up to much of our memory causing the server to use up a lot of swap space. Our log files are bigger than 500M on a daily basis. We lately started... (8 Replies)
Discussion started by: senormarquez
8 Replies

10. Shell Programming and Scripting

Grep a string and count following lines starting with another string

I have a large dataset with following structure; C 0001 Carbon D SAR001 methane D SAR002 ethane D SAR003 propane D SAR004 butane D SAR005 pentane C 0002 Hydrogen C 0003 Nitrogen C 0004 Oxygen D SAR011 ozone D SAR012 super oxide C 0005 Sulphur D SAR013... (3 Replies)
Discussion started by: Syeda Sumayya
3 Replies

LEARN ABOUT SUNOS

rpm2cpio

rpm2cpio(1)							   User Commands						       rpm2cpio(1)

NAME

       rpm2cpio - convert Red Hat Package (RPM) to cpio archive

SYNOPSIS

       rpm2cpio [file.rpm]

DESCRIPTION

       The  rpm2cpio  utility converts the .rpm file specified as its sole argument to a cpio archive on standard output. (See NOTES.) If no argu-
       ment is given, an rpm stream is read from standard input. In both cases, rpm2cpio will fail and print a usage message if the standard  out-
       put is a terminal. Therefore, the output is usually redirected to a file or piped through the cpio(1) utility.

EXAMPLES

       Example 1: Converting an rpm file

       example% rpm2cpio Device3Dfx-1.1-2.src.rpm | cpio -itv
       CPIO archive found!
       -rw-r--r--   1 root  root    2635 Sep 13 16:39 1998, 3dfx.gif
       -rw-r--r--   1 root  root   11339 Sep 27 16:03 1998, Dev3Dfx.tar.gz
       -rw-r--r--   1 root  root    1387 Sep 27 16:04 1998, Device3Dfx-1.1-2.spec
       31 blocks

       Example 2: Converting from standard input

       example% rpm2cpio < Device3Dfx-1.1-2.src.rpm | cpio -itv
       CPIO archive found!
       -rw-r--r--   1 root  root    2635 Sep 13 16:39 1998, 3dfx.gif
       -rw-r--r--   1 root  root   11339 Sep 27 16:03 1998, Dev3Dfx.tar.gz
       -rw-r--r--   1 root  root    1387 Sep 27 16:04 1998, Device3Dfx-1.1-2.spec
       31 blocks

ATTRIBUTES

       See attributes(5) for descriptions of the following attributes:

       +-----------------------------+-----------------------------+
       |      ATTRIBUTE TYPE	     |	    ATTRIBUTE VALUE	   |
       +-----------------------------+-----------------------------+
       |Availability		     |SUNWrpm			   |
       +-----------------------------+-----------------------------+

SEE ALSO

       cpio(1), attributes(5)

NOTES

       rpm2cpio handles versions 3 and 4 RPMs.

SunOS 5.10							    20 Aug 2001 						       rpm2cpio(1)
All times are GMT -4. The time now is 11:35 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy