Login or Register to Ask a Question and Join Our Community


UNIX for Advanced & Expert Users

Shell script to append a time for the existing error log file

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums UNIX for Advanced & Expert Users Shell script to append a time for the existing error log file
# 8  
Old 07-06-2007
Quote:
Originally Posted by gsprasanna
awk -v var="23:19:32 2007" ' !/parallel nursery GC/ && /GC/ { $0=$0 " " var } ; 1' filename

here in place of 23:19:32 2007 it should be replaced by system time
that is by making use of date command
Code:
awk -v var="$( date +%H":"%M":"%S" "%Y )" ' !/parallel nursery GC/ && /GC/ { $0=$0 " " var } ; 1' filename

Awk read the file line by line and process it.
!/parallel nursery GC/ ! negates the pattern i.e if the line does not contain pattern "parallel nursery GC"

!/parallel nursery GC/ && /GC/ If a line does not contain !/parallel nursery GC/ and contain GC then execute statements in { .. }

$0 contain the current line read from the file.

$0=$0 " " var Append the date

1 means true and print the line

Check man awk and tutorials available in net to know more about awk
# 9  
Old 07-06-2007
Hi anbu23 (will u let me know ur name)

i am prasanna kumar from bangalore

i executed the script
awk -v var="$( date +%H":"%M":"%S" "%Y )" ' !/parallel nursery GC/ && /GC/ { $0=$0 " " var } ; 1' prasanna

where prasanna is a file that contains

[INFO ][memory ] 4149.021: parallel nursery GC 2701220K->2655828K (2969600K), 30.574 ms
[INFO ][memory ] 4154.677: parallel nursery GC 2703428K->2657717K (2969600K), 28.287 ms
[INFO ][memory ] 4158.415: parallel nursery GC 2758546K->2712930K (2969600K), 32.175 ms
[INFO ][memory ] 4162.587: parallel nursery GC 2782109K->2736294K (2969600K), 25.666 ms
[INFO ][memory ] 4169.850: parallel nursery GC 2874669K->2829815K (2969600K), 36.132 ms
[INFO ][memory ] 4172.303-4173.282: GC 2942000K->678250K (2969600K), 979.049 ms
[INFO ][memory ] 4176.626: parallel nursery GC 770077K->723185K (2969600K), 41.395 ms
[INFO ][memory ] 4178.411: parallel nursery GC 793823K->745922K (2969600K), 27.153 ms
[INFO ][memory ] 4187.052: parallel nursery GC 810797K->763420K (2969600K), 27.971 ms
[INFO ][memory ] 4192.911: parallel nursery GC 836546K->788468K (2969600K), 24.864 ms
[INFO ][memory ] 4207.717: parallel nursery GC 954934K->909305K (2969600K), 58.163 ms
[INFO ][memory ] 4220.734: parallel nursery GC 1074869K->1027949K (2969600K), 41.402 ms
[INFO ][memory ] 4223.611: parallel nursery GC 1280344K->1234402K (2969600K), 48.997 ms
[INFO ][memory ] 4226.224: parallel nursery GC 1294774K->1247317K (2969600K), 32.585 ms
[INFO ][memory ] 4227.747: parallel nursery GC 1340665K->1293317K (2969600K), 36.518 ms
[INFO ][memory ] 4231.858: parallel nursery GC 1342917K->1295134K (2969600K), 26.400 ms
[INFO ][memory ] 4237.341: parallel nursery GC 1382464K->1334959K (2969600K), 28.912 ms
[INFO ][memory ] 4244.508: parallel nursery GC 1418893K->1371117K (2969600K), 27.960 ms
[INFO ][memory ] 4250.090: parallel nursery GC 1506707K->1460215K (2969600K), 41.302 ms
[INFO ][memory ] 4253.633: parallel nursery GC 1601128K->1554403K (2969600K), 41.705 ms
[INFO ][memory ] 4256.931: parallel nursery GC 1642007K->1594365K (2969600K), 35.355 ms
[INFO ][memory ] 4262.884: parallel nursery GC 1666922K->1619762K (2969600K), 34.114 ms
[INFO ][memory ] 4266.360: parallel nursery GC 1800444K->1753342K (2969600K), 35.357 ms
[INFO ][memory ] 4272.192: parallel nursery GC 1802942K->1755681K (2969600K), 34.750 ms
[INFO ][memory ] 4280.558: parallel nursery GC 1949104K->1903450K (2969600K), 48.986 ms
[INFO ][memory ] 4287.625: parallel nursery GC 2177829K->2131864K (2969600K), 54.820 ms
[INFO ][memory ] 4290.519: parallel nursery GC 2292667K->2246419K (2969600K), 45.289 ms
[INFO ][memory ] 4293.266: parallel nursery GC 2348322K->2301095K (2969600K), 40.879 ms
[INFO ][memory ] 4297.969: parallel nursery GC 2449739K->2403340K (2969600K), 45.764 ms
[INFO ][memory ] 4300.545: parallel nursery GC 2551023K->2504987K (2969600K), 47.164 ms
[INFO ][memory ] 4302.757: parallel nursery GC 2634647K->2587589K (2969600K), 37.921 ms
[INFO ][memory ] 4305.395: parallel nursery GC 2732599K->2685257K (2969600K), 33.979 ms
[INFO ][memory ] 4306.887: parallel nursery GC 2782062K->2734709K (2969600K), 37.463 ms
[INFO ][memory ] 4311.359: parallel nursery GC 2802868K->2755475K (2969600K), 40.694 ms
[INFO ][memory ] 4315.468: parallel nursery GC 2822175K->2774396K (2969600K), 32.332 ms
[INFO ][memory ] 4316.459: parallel nursery GC 2823996K->2775766K (2969600K), 27.037 ms
[INFO ][memory ] 4317.393: parallel nursery GC 2841257K->2792598K (2969600K), 18.883 ms
[INFO ][memory ] 4321.665-4322.667: GC 2969600K->737073K (2969600K), 1001.966 ms
[INFO ][memory ] 4329.551: parallel nursery GC 916745K->867854K (2969600K), 151.006 ms
[INFO ][memory ] 4332.423: parallel nursery GC 959372K->909114K (2969600K), 29.651 ms
[INFO ][memory ] 4336.080: parallel nursery GC 994303K->944903K (2969600K), 34.629 ms
[INFO ][memory ] 4339.405: parallel nursery GC 996903K->946451K (2969600K), 34.027 ms
[INFO ][memory ] 4345.775: parallel nursery GC 1054838K->1005315K (2969600K), 33.624 ms
[INFO ][memory ] 4355.028: parallel nursery GC 1106687K->1057153K (2969600K), 45.812 ms
[INFO ][memory ] 4362.651: parallel nursery GC 1130232K->1080475K (2969600K), 32.335 ms
[INFO ][memory ] 4372.657: parallel nursery GC 1165734K->1116103K (2969600K), 36.189 ms


it shows error message as
illegal variable name


and also as u said,
!/parallel nursery GC/ && /GC/ If a line does not contain !/parallel nursery GC/ and contain GC then execute statements in { .. }

but every line contain GC, so how can it be



But at first i am thankful to u for ur patience and trying to help me out.....
# 10  
Old 07-06-2007
I am not sure why you get that error message. Its working fine for me. Try to copy as such and run it.
Code:
$ awk -v var="$( date +%H":"%M":"%S" "%Y )" ' !/parallel nursery GC/ && /GC/ { $0=$0 " " var } ; 1' filename
[INFO ][memory ] 4594.493: parallel nursery GC 2594592K->2544691K (2969600K), 30.848 ms
[INFO ][memory ] 4605.958: parallel nursery GC 2634887K->2584986K (2969600K), 38.900 ms
[INFO ][memory ] 4619.079: parallel nursery GC 2822555K->2774812K (2969600K), 51.526 ms
[INFO ][memory ] 4623.784: parallel nursery GC 2911872K->2862488K (2969600K), 43.049 ms
[INFO ][memory ] 4634.298: parallel nursery GC 2964037K->2915007K (2969600K), 44.723 ms
[INFO ][memory ] 4642.754-4644.124: GC 2969600K->745408K (2969600K), 1369.515 ms 13:07:23 2007
[INFO ][memory ] 4657.312: parallel nursery GC 843925K->792192K (2969600K), 59.318 ms
[INFO ][memory ] 4667.661: parallel nursery GC 1023736K->973165K (2969600K), 54.639 ms
[INFO ][memory ] 4683.479: parallel nursery GC 1079790K->1028927K (2969600K), 57.430 ms
[INFO ][memory ] 4703.120: parallel nursery GC 1155728K->1104405K (2969600K), 48.580 ms
[INFO ][memory ] 4721.076: parallel nursery GC 1381399K->1331594K (2969600K), 67.131 ms
[INFO ][memory ] 4733.124: parallel nursery GC 1615502K->1565673K (2969600K), 67.668 ms
[INFO ][memory ] 4735.932: parallel nursery GC 1868345K->1818182K (2969600K), 60.527 ms
[INFO ][memory ] 4740.485: parallel nursery GC 1904639K->1852524K (2969600K), 39.426 ms
[INFO ][memory ] 4748.902: parallel nursery GC 1931641K->1880332K (2969600K), 45.826 ms
[INFO ][memory ] 4749.369: parallel nursery GC 1992582K->1939949K (2969600K), 40.806 ms
[INFO ][memory ] 4754.434: parallel nursery GC 2180168K->2130041K (2969600K), 49.643 ms
[INFO ][memory ] 4773.739: parallel nursery GC 2184441K->2132628K (2969600K), 47.404 ms
[INFO ][memory ] 4793.466: parallel nursery GC 2488886K->2439957K (2969600K), 65.046 ms
[INFO ][memory ] 4825.436: parallel nursery GC 2539740K->2489040K (2969600K), 57.110 ms
[INFO ][memory ] 4829.277: parallel nursery GC 2668261K->2617286K (2969600K), 44.117 ms
[INFO ][memory ] 4835.849: parallel nursery GC 2671686K->2619201K (2969600K), 37.932 ms
[INFO ][memory ] 4849.233: parallel nursery GC 2781360K->2730476K (2969600K), 47.521 ms
[INFO ][memory ] 4870.198: parallel nursery GC 2902826K->2851834K (2969600K), 56.248 ms
[INFO ][memory ] 4873.277-4874.744: GC 2947600K->754541K (2969600K), 1467.026 ms 13:07:23 2007
[INFO ][memory ] 4876.460: parallel nursery GC 824428K->769741K (2969600K), 146.708 ms
[INFO ][memory ] 4888.450: parallel nursery GC 916812K->862855K (2969600K), 46.349 ms
[INFO ][memory ] 4902.871: parallel nursery GC 992190K->936997K (2969600K), 30.377 ms
[INFO ][memory ] 4907.508: parallel nursery GC 1167917K->1115851K (2969600K), 63.247 ms
[INFO ][memory ] 4933.191: parallel nursery GC 1293112K->1239053K (2969600K), 51.764 ms
[INFO ][memory ] 4939.716: parallel nursery GC 1339610K->1284920K (2969600K), 41.355 ms

GC is present in all the lines. So to differentiate main and nursery, !/parallel nursery GC/ is enough. But if you have any lines that does not contain GC will also satisfy this. So to avoid these lines i added /GC/.
# 11  
Old 07-09-2007
Hi Anbu,
Thanks for your help,
i got the solution why the script is not executing ,because i am executing the script in tcsh so it displays as illegal error,

so i changed to sh and tried to execute as follows , it displays static time instead of displaying dynamic time for the corresponding dynamic data generation as shown below,





tail -f filename_error.log|awk -v var="$( date +%H":"%M":"%S" "%Y )" ' /parallel nursery GC/ || /GC/ { $0=$0 " " var } ; 1'
[INFO ][memory ] 7654.644: parallel nursery GC 1613483K->1441609K (2969600K), 58.004 ms 01:40:38 2007
[INFO ][memory ] 7672.245: parallel nursery GC 1636286K->1464021K (2969600K), 59.238 ms 01:40:38 2007
[INFO ][memory ] 7680.216: parallel nursery GC 1667206K->1494772K (2969600K), 58.330 ms 01:40:38 2007
[INFO ][memory ] 7691.249: parallel nursery GC 1691520K->1519101K (2969600K), 52.770 ms 01:40:38 2007
[INFO ][memory ] 7698.657: parallel nursery GC 1709864K->1537607K (2969600K), 52.452 ms 01:40:38 2007
[INFO ][memory ] 7705.461: parallel nursery GC 1760051K->1587293K (2969600K), 53.754 ms 01:40:38 2007
[INFO ][memory ] 7713.707: parallel nursery GC 1803076K->1630709K (2969600K), 52.372 ms 01:40:38 2007
[INFO ][memory ] 7719.741: parallel nursery GC 1807109K->1634757K (2969600K), 55.545 ms 01:40:38 2007
[INFO ][memory ] 7725.737: parallel nursery GC 1852025K->1679291K (2969600K), 48.950 ms 01:40:38 2007
[INFO ][memory ] 7731.315: parallel nursery GC 1855691K->1683135K (2969600K), 50.994 ms 01:40:38 2007
[INFO ][memory ] 7738.187: parallel nursery GC 1889400K->1717128K (2969600K), 54.150 ms 01:40:38 2007
# 12  
Old 07-09-2007
Hi Anbu,
Thanks for your help,
i got the solution why the script is not executing ,because i am executing the script in tcsh so it displays as illegal error,

so i changed to sh and tried to execute as follows , it displays static time instead of displaying dynamic time for the corresponding dynamic data generation as shown below,





tail -f filename_error.log|awk -v var="$( date +%H":"%M":"%S" "%Y )" ' /parallel nursery GC/ || /GC/ { $0=$0 " " var } ; 1'
[INFO ][memory ] 7654.644: parallel nursery GC 1613483K->1441609K (2969600K), 58.004 ms 01:40:38 2007
[INFO ][memory ] 7672.245: parallel nursery GC 1636286K->1464021K (2969600K), 59.238 ms 01:40:38 2007
[INFO ][memory ] 7680.216: parallel nursery GC 1667206K->1494772K (2969600K), 58.330 ms 01:40:38 2007
[INFO ][memory ] 7691.249: parallel nursery GC 1691520K->1519101K (2969600K), 52.770 ms 01:40:38 2007
[INFO ][memory ] 7698.657: parallel nursery GC 1709864K->1537607K (2969600K), 52.452 ms 01:40:38 2007
[INFO ][memory ] 7705.461: parallel nursery GC 1760051K->1587293K (2969600K), 53.754 ms 01:40:38 2007
[INFO ][memory ] 7713.707: parallel nursery GC 1803076K->1630709K (2969600K), 52.372 ms 01:40:38 2007
[INFO ][memory ] 7719.741: parallel nursery GC 1807109K->1634757K (2969600K), 55.545 ms 01:40:38 2007
[INFO ][memory ] 7725.737: parallel nursery GC 1852025K->1679291K (2969600K), 48.950 ms 01:40:38 2007
[INFO ][memory ] 7731.315: parallel nursery GC 1855691K->1683135K (2969600K), 50.994 ms 01:40:38 2007
[INFO ][memory ] 7738.187: parallel nursery GC 1889400K->1717128K (2969600K), 54.150 ms 01:40:38 2007

is there any another to get the dynamic time generation to append for an dynamic data generation..................waiting for ur valuable suggestions........
# 13  
Old 07-12-2007
Code:
awk ' /parallel nursery GC/ || /GC/ { "date +%H\":\"%M\":\"%S\" \"%Y" | getline var; $0=$0 " " var} ; 1' file
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Need shell script to append double quotes for each column in a file

Hi Experts, I am beginner to the shell scripting, My requirement is to append double quotes for each column in a file if double quotes does not exist. Example: "abc"|123|"gh-ch"|23.067 Use code tags, thanks. (10 Replies)
Discussion started by: spidy
10 Replies

2. Shell Programming and Scripting

Append date to sql*plus spool (log) file in shell script

SQL*Plus version : 11.2.0.4 OS : Oracle Linux 6.5 SQL*Plus is a client application to connect to oracle database. The log file for this tool is generated via spool command as shown below. I am trying to append date ( $dateString ) to spool file as shown below. $ cat test2.sh #!/bin/bash... (4 Replies)
Discussion started by: kraljic
4 Replies

3. Shell Programming and Scripting

Shell Script | Parse log file after a given date and time stamp

I am developing one script which will take log file name, output file name, date, hour and minute as an argument and based on these inputs, the script will scan and capture all the error(s) that have been triggered from a given time. Example: script should capture all the error after 13:50 on Jan... (2 Replies)
Discussion started by: ROMA3
2 Replies

4. Shell Programming and Scripting

Append files to a existing tar file.

Hi all, I want to check whether tar file exists in the directory or not. If tar file exists in the directory then I want to append the files to it. I am using the below command to tar files if the file does not exist. tar zcvf <tar file name> <Files to append> However, if want to... (4 Replies)
Discussion started by: Nagaraja Akkiva
4 Replies

5. Shell Programming and Scripting

How to append value at first line of CSV file using shell script?

I have an issue where I need to append a value at the last of the csv, I have created a shell script and it is appending the columns at the last but it is appending at all lines, and my requirement is specific to just append at the 1st line. Have a look and suggest, (7 Replies)
Discussion started by: anujrichhariya
7 Replies

6. Shell Programming and Scripting

append existing file with zeroes bsed on position

Hi i am trying to append value with 0 to an existing file in the position 50-56 & 58-64 only where empty space is there Rule: 1 row already has some value and i do not want to change anything for this row. 2nd record below you see the position 50-64 is empty, i want to replace with 0000000... (3 Replies)
Discussion started by: kshuser
3 Replies

7. Shell Programming and Scripting

shell script to read a line in gps receiver log file and append that line to new file

Hi, I have gps receiver log..its giving readings .like below Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. GPSD,R=1 $GPGSV,3,1,11,08,16,328,40,11,36,127,00,28,33,283,39,20,11,165,00*71... (3 Replies)
Discussion started by: gudivada213
3 Replies

8. Shell Programming and Scripting

shell script not getting current error messages with time from alert.log

Hi All, I need to get current error messages with time from alert.log.Below is my shell script but it's not working to meet this objective. could anyone pls share on the above issue for resolution: #################################################################### ## ckalertlog.sh ##... (2 Replies)
Discussion started by: a1_win
2 Replies

9. UNIX for Dummies Questions & Answers

Inserting Date&Time Stamp In Existing Log File

I am trying to insert a line with a date stamp in a file that is used to monitor activity in one of our directories. By doing this, I want to grep that file each day and go to the last entry for each time a error occurred and pull all errors generated if any exist. If error exists I want that error... (3 Replies)
Discussion started by: shephardfamily
3 Replies

10. Shell Programming and Scripting

script to run shell command and insert results to existing xml file

Hi. Thanks for any help with this. I'm not new to programming but I am new to shell programming. I need a script that will 1. execute 'df -k' and return the volume names with specific text 2. surround each line of the above results in opening and closing xml tags 3. insert the results of step... (5 Replies)
Discussion started by: littlejon
5 Replies
Login or Register to Ask a Question