Sponsored Content
Top Forums Shell Programming and Scripting Extracting logs using gunzip awk and gzip Post 302976510 by pulkitbahl on Thursday 30th of June 2016 05:32:20 AM
Old 06-30-2016
Hi Kindly find the code written below:


Code:
 
 #!/usr/ssh/bin
# My first script
 echo -n "Enter Start Date in Format YYYYMMDD:"
read date
echo "You Entered : $date"
 echo -n "Enter Start Date in Format MM/DD/YYYY:"
read date1
echo "You Entered : $date1"
 echo -n "Enter END Date in Format YYYYMMDD:"
read date2
echo "You Entered : $date2"
 echo -n "Enter END Date in Format MM/DD/YYYY:"
read date3
echo "You Entered : $date3"
 echo -n "Enter Start Time in Format HH:MM:SS.SSS eg. 03:30:00.000 :"
read time
echo "You Entered : $time"
 echo -n "Enter End Time in Format HH:MM:SS.SSS eg. 05:29:59.999 :"
read time1
echo "You Entered : $time1"
 echo -n "Enter Path Where you want to save the Logs :"
read Path
echo "You Entered : $Path"
 initial=[$date1][$time]
 echo $initial
 final=[$date3][$time1]
 echo $final
 
location=$Path/smtracedefault_$server.log.gz
 
#ssh <server1>  "nohup  gunzip -c $file*.gz | awk '$0 > "'$initial'" && $0 < "'$final'"' | gzip >> $location &"
 #ssh <server2>  "nohup  gunzip -c $file*.gz | awk '$0 > "'$initial'" && $0 < "'$final'"' | gzip >> $location &"
 #ssh <server3>  "nohup  gunzip -c $file*.gz | awk '$0 > "'$initial'" && $0 < "'$final'"' | gzip >> $location &"
 #nohup gunzip -c $file*.gz | awk '$0 > "'$initial'" && $0 < "'$final'"' | gzip >> $location &


in this code


the last command works if I log into the server manually(not through script) where as I want to log in using script only.

Code:
#nohup gunzip -c $file*.gz | awk '$0 > "'$initial'" && $0 < "'$final'"' | gzip >> $location &


I am not able to use expect send and interact.Public and private keys cannot be placed on all servers.Userid and password cannot be hardcoded. SED does not work on the servers.


I want to logging into server and run the awk command working individually through script on all the required servers.

Please help.
 

10 More Discussions You Might Find Interesting

1. HP-UX

decompress in HPUX11 by Gunzip and gzip

Hello evrebody , I have HPUX-11, i try to install "Mozilla" and "unzip utillity" I cannot decompress file (F.tar.gz) or file(F.gz) by commandes: gunzip -dv F.tar.gz | tar -xvf gunzip F.tar.gz or gzip -dv F.tar.gz |tar -xvf gzip F.gz maybe someone know What's the reason? maybe i... (1 Reply)
Discussion started by: yanly64
1 Replies

2. Shell Programming and Scripting

Extracting data from large logs.

Hi all, I have a large log file that gets created daily. I need to be able to pull text out of the log when I hit a pattern including the 7 lines above it and the 3 lines below and output it to a new text file. Line 1 Line 2 Line 3 Line 4 Line 5 Line 6 Line 7 Pattern Line 9 Line 10... (11 Replies)
Discussion started by: bas
11 Replies

3. UNIX for Dummies Questions & Answers

gunzip error - not in gzip format

Hi, I am getting this error gunzip file1.tar.Z gunzip: file1.tar.Z: not in gzip format Any clues? This goes bad only in some recent installations of ids (5 Replies)
Discussion started by: eagercyber
5 Replies

4. UNIX for Dummies Questions & Answers

Cloning OracleHome (gzip/gunzip Help)

Environment: ServerA - IBM AIX 5.2 ServerB - IBM AIX 5.2 I want to clone one of my oracle installation. The easiest way is to ZIP(possibly use gzip) the installed folder from the ServerA (Here Oracle is installed and working fine) , FTP to the ServerB(Here I want to have the installation... (4 Replies)
Discussion started by: aixhp
4 Replies

5. Solaris

doubt reg gzip,gunzip

Hi, Can anyone let me explain the difference between tar , uncompress,gzip and gunzip commands. both gzip and gunzip are same i think correct me if am wrong. (1 Reply)
Discussion started by: rogerben
1 Replies

6. Shell Programming and Scripting

Awk Help for extracting report from logs

Hi I have a log file, with lines of following kind. ------------------------ 2009-05-15 07:49:42,574 INFO - SqlMapObjectDataDao - select - selectObject - 2 ms 2009-05-15 07:49:42,575 INFO - SqlMapUserDao - select - getUserSystemAdminSuperGroup - 0 ms 2009-05-15 07:49:42,576 INFO -... (3 Replies)
Discussion started by: jitendriya.dash
3 Replies

7. UNIX for Dummies Questions & Answers

gzip-gunzip a problem

Hi all, i have a gzipped file. <file_name>.gz . when i try gunzip this file i get, invalid compressed data--format violated this file gzipped like gzip -f -S <file_name> 2 > <error_log_file> there is no error in log. it seems that the file gzipped properly. how this ... (3 Replies)
Discussion started by: dummydba
3 Replies

8. UNIX for Dummies Questions & Answers

gzip to read logs

Ok here is my trouble. I run scripts whenever I am investigating problems. One of those scripts simply goes to a log folder and runs gzip -cd * | grep error | wc -l This tells me the number of errors in their log's and how much I should pay attention to them. The problem is sometimes... (3 Replies)
Discussion started by: MrEddy
3 Replies

9. UNIX for Dummies Questions & Answers

help in extracting logs in readable format

hello everyone. newbie here in unix. I am trying to extract the logs of a certain job and would like to output it in a readable format, see below the CAT part: cat /var/opt/ctma/ctm/sysout/idwesct_sh30_eng_r6_cdcs_sh.LOG_05l0du_000* | egrep -i 'orderid:|file_name=' | sed... (1 Reply)
Discussion started by: eanne_may
1 Replies

10. Shell Programming and Scripting

File name manipulation when extracting from gzip

Hi, Below is the description of my problem. I am trying to loop through the below file names sitting in the file - FileNames.txt, and trying to decompress them FileNames.txt 20150408_MGAC_.txt.gz 20150408_MGCC_.txt.gz 20150408_MGSH__.txt.gz 20150408_MGSL__.txt.gz ... (6 Replies)
Discussion started by: Richmond_CS
6 Replies
DATETIME.__CONSTRUCT(3) 						 1						   DATETIME.__CONSTRUCT(3)

DateTime::__construct - Returns new DateTime object

       Object oriented style

SYNOPSIS
public DateTime::__construct NULL ([string $time = "now"], [DateTimeZone $timezone]) DESCRIPTION
Procedural style DateTime date_create NULL ([string $time = "now"], [DateTimeZone $timezone]) Returns new DateTime object. PARAMETERS
o $time -A date/time string. Valid formats are explained in Date and Time Formats. Enter NULL here to obtain the current time when using the $timezone parameter. o $timezone - A DateTimeZone object representing the timezone of $time. If $timezone is omitted, the current timezone will be used. Note The $timezone parameter and the current timezone are ignored when the $time parameter either is a UNIX timestamp (e.g. @946684800) or specifies a timezone (e.g. 2010-01-28T15:00:00+02:00). RETURN VALUES
Returns a new DateTime instance. Procedural style returns FALSE on failure. ERRORS
/EXCEPTIONS Emits Exception in case of an error. CHANGELOG
+--------+---------------------------------------------------+ |Version | | | | | | | Description | | | | +--------+---------------------------------------------------+ | 5.3.0 | | | | | | | If $time contains an invalid date/time format, | | | then an exception is now thrown. Previously an | | | error was emitted. | | | | +--------+---------------------------------------------------+ EXAMPLES
Example #1 DateTime.__construct(3) example Object oriented style <?php try { $date = new DateTime('2000-01-01'); } catch (Exception $e) { echo $e->getMessage(); exit(1); } echo $date->format('Y-m-d'); ?> Procedural style <?php $date = date_create('2000-01-01'); if (!$date) { $e = date_get_last_errors(); foreach ($e['errors'] as $error) { echo "$error "; } exit(1); } echo date_format($date, 'Y-m-d'); ?> The above examples will output: 2000-01-01 Example #2 Intricacies of DateTime.__construct(3) <?php // Specified date/time in your computer's time zone. $date = new DateTime('2000-01-01'); echo $date->format('Y-m-d H:i:sP') . " "; // Specified date/time in the specified time zone. $date = new DateTime('2000-01-01', new DateTimeZone('Pacific/Nauru')); echo $date->format('Y-m-d H:i:sP') . " "; // Current date/time in your computer's time zone. $date = new DateTime(); echo $date->format('Y-m-d H:i:sP') . " "; // Current date/time in the specified time zone. $date = new DateTime(null, new DateTimeZone('Pacific/Nauru')); echo $date->format('Y-m-d H:i:sP') . " "; // Using a UNIX timestamp. Notice the result is in the UTC time zone. $date = new DateTime('@946684800'); echo $date->format('Y-m-d H:i:sP') . " "; // Non-existent values roll over. $date = new DateTime('2000-02-30'); echo $date->format('Y-m-d H:i:sP') . " "; ?> The above example will output something similar to: 2000-01-01 00:00:00-05:00 2000-01-01 00:00:00+12:00 2010-04-24 10:24:16-04:00 2010-04-25 02:24:16+12:00 2000-01-01 00:00:00+00:00 2000-03-01 00:00:00-05:00 SEE ALSO
DateTime.createFromFormat(3), DateTimeZone.__construct(3), Date and Time Formats, date.timezone ini setting, date_default_time- zone_set(3), DateTime.getLastErrors(3), checkdate(3). PHP Documentation Group DATETIME.__CONSTRUCT(3)
All times are GMT -4. The time now is 03:36 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy