Format log file


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Format log file
# 1  
Old 10-07-2010
Format log file

Hi,

I need help to format log file that look like this :

Code:
FILE='/BD_TOTO/MMX_RNX/MMX_RNX_2009_282_0001.TGZ
                                                                                                      ';;
 SIZE(Ko)='32528 '
 ARC_DATE='2009-10-13'
;;
FILE='/BD_TOTO/MMX_RNX/MMX_RNX_2009_283_0001.TGZ
                                                                                                      ';;
 SIZE(Ko)='34229 '
 ARC_DATE='2009-10-13'
;;

I am looking to make it like this if it's possible:

Code:
MMX_RNX_2009_282_0001.TGZ ; 32528 ; 2009-10-13
MMX_RNX_2009_283_0001.TGZ ; 34229 ; 2009-10-13

thanks for your help

---------- Post updated 10-07-10 at 02:56 AM ---------- Previous update was 10-06-10 at 04:49 AM ----------

Hello,

I still need help on this. I hope someone will be able to help me. I hope this can be done on one command line. I did try with nawk or sed .... but the result wasn't good enough.

Thanks.

Last edited by Aswex; 10-06-2010 at 09:46 AM..
# 2  
Old 10-07-2010
Show what you done so far then

---------- Post updated at 10:34 ---------- Previous update was at 10:32 ----------

It is difficult to understand the sample you gave without more explanation: For instance is it trailing blanks the issue? (what is the format of one record...)
# 3  
Old 10-07-2010
Hello VBE,

thanks for your quick reply.

I have to format a log file to only keep information that I need to be able to play with the result on csv file.

I only need to keep data name ; size ; archive date on one line.

here is what I tried do far :

Code:
A=\'; nawk -v s=$A '/^FILE/ {FS="[/ ]"; a=$4} /SIZE/ {FS=s; print a,$2} /ARC_DATE/ {FS=s; print $2}'

here is the result :

Code:
MMX_RNX_2009_282_0001.TGZ 32528
2009-10-13
MMX_RNX_2009_283_0001.TGZ 34229
2009-10-13

as you can see it's not close enough what i need ...

here is exacltly what I need :

Code:
MMX_RNX_2009_282_0001.TGZ ; 32528 ; 2009-10-13
MMX_RNX_2009_283_0001.TGZ ; 34229 ; 2009-10-13

thanks for your help
# 4  
Old 10-07-2010
Code:
$ ruby -00 -ne '$_.gsub!(/\s{2,}/,"").gsub!(/.*\/|;SIZE.[^=]*=|;;\n+|\047/,"").gsub!(/ARC.*[^=]=/,";");print $_' file
MMX_RNX_2009_282_0001.TGZ;32528 ;2009-10-13
MMX_RNX_2009_283_0001.TGZ;34229 ;2009-10-13

# 5  
Old 10-07-2010
Hello kurumi,

thanks for your reply but I am solaris 9 (ksh) and I do not have acces to ruby. I can only have acces to awk, cut, sed ... usual unix tool.

Thnaks
# 6  
Old 10-08-2010
The below command may help.....

Code:
egrep -v ";;" Log_file| tr "\n" "\t" | tr "FILE" "\nFILE" | awk -F/ '{ print $NF }' |\
 awk -F"\t" '{ print $1";"$2";"$3}'| sed s/";.*)='"/";"/ | sed s/"';.*='"/";"/ | awk -F"'" '{ print $1}'


Last edited by vbe; 10-08-2010 at 10:04 AM..
# 7  
Old 10-11-2010
Hi siba.s.nayak,

thanks for your reply. Is there a way to make it shorter ?

Thanks
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Format a log file using sed

I am looking to extract something like this from the below sample log file. 10.28.76.15 SSLC=Z42 71.19.175.130 10.28.76.15 SSLC=Z42 71.19.175.130 10.28.76.15 SSLC=Z42 71.19.175.130 for that I tried something like below and I have no clue how to extract the IP address marked red in the log... (6 Replies)
Discussion started by: Tuxidow
6 Replies

2. Shell Programming and Scripting

format log file

Hello, I am on solaris here is what I have *****LIST OF ATTRIBUTS FROM FILES***** FILE='/N1B/2002/05/ACL1B_2002_05_01_B_00.TAR ... (5 Replies)
Discussion started by: Aswex
5 Replies

3. Shell Programming and Scripting

Format LOG File

Hello, I just need help to format log file that contain huge amont of lines: Here is what I am getting : STAS022 RC = 0 I Suppression de /OPERATIONNEL/SATURNE/PGN/HD/SATURNE_1DAV_20100415_20110415_ISI_R20110430.NC effectuee STAS034 RC = 0 I Deroulement correct STAF067 RC = 9 E... (7 Replies)
Discussion started by: Aswex
7 Replies

4. Shell Programming and Scripting

Format log file - SED

Hello, I need help to format a log file...again ; )) Here is what I have : FILE='/OPERATIONNEL/SATURNE/MASTER/SATURNE_MASTER_PRE_R20110119.TAR.GZ ... (5 Replies)
Discussion started by: Aswex
5 Replies

5. Shell Programming and Scripting

Format log file

Hello, I need help to format log file. I am looking for the most short way to to it here is what I have : /data_val/SATURNE/MASTER/PRE/SATURNE_1dAV_20110301_20110302_T3D_T_FCST_R20110216.nc 3581376 here is what I need : SATURNE_1dAV_20110301_20110302_T3D_T_FCST_R20110216.nc 3581376... (8 Replies)
Discussion started by: Aswex
8 Replies

6. Shell Programming and Scripting

Log File - Format

Dear all, I need help to format a log file : Here is the output (Go to the end of the Wrap Code to see caracter at the end of line): FILE='/OPERATIONNEL/SATURNE/PHYS_MOD/NOWMOD/SATURNE_1DAV_20110201_20110202_ICEMOD_R20110202.NC ... (5 Replies)
Discussion started by: Aswex
5 Replies

7. UNIX for Dummies Questions & Answers

Log file format!

DO log files have 1 universal format. And if any body know how to depict the $1 to $10 arguments of this file. (4 Replies)
Discussion started by: nixhead
4 Replies

8. Shell Programming and Scripting

SED - log file format

Hello everyone, I have a log file : \data\file\script\command_0001 \data\file\script\command_0002 \data\file\script\command_0003 I need to make all lines on this way \data\file\script\command_0001 \data\file\script\command_0002 \data\file\script\command_0003 I know this could be done... (11 Replies)
Discussion started by: Aswex
11 Replies

9. Shell Programming and Scripting

convert date format to mysql date format in log file

I have a comma delimited log file which has the date as MM/DD/YY in the 2nd column, and HH:MM:SS in the 3rd column. I need to change the date format to YYYY-MM-DD and merge it with the the time HH:MM:SS. How will I got about this? Sample input 02/27/09,23:52:31 02/27/09,23:52:52... (3 Replies)
Discussion started by: hazno
3 Replies

10. UNIX for Advanced & Expert Users

Correct format in a log file

I'm trying to read the output of a .sql script (simple insert and commit oracle pl/slq script) to a log file using a shell script. My problem is I end up with a log file that looks like this: sd12@phenix97:/detain/sd12/logs > cat 20071205_detain_20071206.log 12320496 rows created. Commit... (11 Replies)
Discussion started by: sd12
11 Replies
Login or Register to Ask a Question