[awk] combine and convert time from log files


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting [awk] combine and convert time from log files
# 8  
Old 08-14-2012
one log file will contain one hostname/ip
# 9  
Old 08-14-2012
Quote:
Originally Posted by raj_saini20
one log file will contain one hostname/ip
thank you raj_saini20 for helping me to explain my issue Smilie


just found a sed command to remove quote (") characters from a file
Code:
sed 's/\x22//g' filename.txt

* thanks to pspad for provide me a hint for this character Smilie
# 10  
Old 08-16-2012
all,

i have create a script
Code:
#!/bin/sh
 DATE="`date +%d`_`date +%m`_`date +%y`_`date +%H`_`date +%M`_`date +%S`.log"
 ls -lrt *.log | awk '{f=$NF};END{print f}' > latestfile.tmp
 awk 'BEGIN { RS = "" ; FS = "\n" } ; { print $2 ",changeme," $4 }' *.csv > result.tmp
 latesta=$(/bin/cat latestfile.tmp)
 awk 'BEGIN { RS = "" ; FS = "\n"} ; { print $2 }' $latesta  > mytime.tmp
 latestb=$(/bin/cat mytime.tmp)
 sed -e "s/changeme/$latestb/g" result.tmp > final.tmp
 mv final.tmp $DATE

but it give me an error for sed command:

Code:
sed: -e expression #1, char 17: unknown option to `s'

UPDATE: i just found out that it because i "changeme" with "08/10/2012,4:11 PM"

so what is the proper way to change "changeme" with "08/10/2012,4:11 PM" ?

thank you

Last edited by makan; 08-16-2012 at 12:53 AM..
# 11  
Old 08-16-2012
The variable latestb must be containing "/" characters. This is confusing sed as you have used "/" as the delimiters for s, pattern, replacement and flags. Try:
Code:
sed -e "s:changeme:$latestb:g" result.tmp > final.tmp

This User Gave Thanks to elixir_sinari For This Post:
# 12  
Old 08-16-2012
Quote:
Originally Posted by elixir_sinari
The variable latestb must be containing "/" characters. This is confusing sed as you have used "/" as the delimiters for s, pattern, replacement and flags. Try:
Code:
sed -e "s:changeme:$latestb:g" result.tmp > final.tmp

oh... i see...

thank you Smilie

now my homework is how to modify time format from 12 Hours to 24 Hours
Code:
from : 08/10/2012,4:11 PM
to 08/10/2012,16:11

Smilie
# 13  
Old 08-16-2012
Try
Code:
awk 'BEGIN {FS="[/,: ]"}; $6=="PM" {$4=$4+12; $6=""} {print $1"/"$2"/"$3","$4":"$5}'

There may be better ways to produce the output format...
# 14  
Old 08-16-2012
What about 12 AM/PM? Smilie

Last edited by elixir_sinari; 08-16-2012 at 06:21 AM..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Convert UTC time into current UNIX sever time zone

Hi guys thanks for the help for my previous posts.Now i have a requirement that i download a XMl file which has UTC time stamp.I need to convert UTC time into Unix server timezone. For ex if the time zone of unix server is CDT then i need to convert into CDT.whatever may be the system time... (5 Replies)
Discussion started by: mohanalakshmi
5 Replies

2. Shell Programming and Scripting

Combine multiple unique lines from event log text file into one line, use PERL or AWK?

I can't decide if I should use AWK or PERL after pouring over these forums for hours today I decided I'd post something and see if I couldn't get some advice. I've got a text file full of hundreds of events in this format: Record Number : 1 Records in Seq : ... (3 Replies)
Discussion started by: Mayday22
3 Replies

3. Shell Programming and Scripting

How to combine two files with awk?

Hi, everyone! I have two files, I want to combine them as follows: File1 AAAA 23 45 AAAB 44 56 AAAC 34 65 AAAD 34 87 File2 AAAA 34 54 AAAE 34 56 Combined file AAAA 23 45 34 54 AAAB 44 56 AAAC 34 65 AAAD 34 87 AAAE 34 56 (13 Replies)
Discussion started by: xshang
13 Replies

4. Shell Programming and Scripting

Using awk or nawk to convert epoch time to date format

Looking for some help and usually when I do a search this site comes up. Hopefully someone can give me a little direction as to how to use one of these two commands to achieve what I'm trying to do. What am I trying to do? I need to take the time value in epoch format returned from the... (5 Replies)
Discussion started by: minigts
5 Replies

5. UNIX Desktop Questions & Answers

Convert time with AWK

Hi All, I need your help with the following: My input shows the time in this format 1311547776493 I need to convert it (as part of my AWK script) into this format: 18-08-2011 09:35:11.072 Thanks a lot! Royi (4 Replies)
Discussion started by: royip
4 Replies

6. Shell Programming and Scripting

How can view log messages between two time frame from /var/log/message or any type of log files

How can view log messages between two time frame from /var/log/message or any type of log files. when logfiles are very big and especially many messages with in few minutes, I would like to display log messages between 5 minute interval. Could you pls give me the command? (1 Reply)
Discussion started by: johnveslin
1 Replies

7. Shell Programming and Scripting

Shell script to convert epoch time to real time

Dear experts, I have an epoch time input file such as : - 1302451209564 1302483698948 1302485231072 1302490805383 1302519244700 1302492787481 1302505299145 1302506557022 1302532112140 1302501033105 1302511536485 1302512669550 I need the epoch time above to be converted into real... (4 Replies)
Discussion started by: aismann
4 Replies

8. Shell Programming and Scripting

Find and Convert UTC Time to PST Time

Hello All - I have a script that grabs data from the net and outputs the following data 46029 46.144 -124.510 2010 07 26 22 50 320 4.0 6.0 2.2 9 6.8 311 1012.1 -0.9 13.3 13.5 13.3 - - 46041 47.353 -124.731 2010 07 26 22 50 250 2.0 3.0 1.6 8 6.4 - 1011.6 - ... (0 Replies)
Discussion started by: drexnefex
0 Replies

9. Shell Programming and Scripting

Convert Epoch Time to Standard Date and Time & Vice Versa

Hi guys, I know that this topic has been discuss numerous times, and I have search the net and this forum for it. However, non able to address the problem I faced so far. I am on Solaris Platform and unable to install additional packages like the GNU date and gawk to make use of their... (5 Replies)
Discussion started by: DrivesMeCrazy
5 Replies

10. Shell Programming and Scripting

awk convert seconds to time of day

Does anyone know of a way to convert "seconds" to time of day in "hh:mm:ss" ? Trying to do in awk with strftime but with no luck. Thanks (2 Replies)
Discussion started by: timj123
2 Replies
Login or Register to Ask a Question