Script to manipulate logfile text


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Script to manipulate logfile text
# 1  
Old 12-02-2008
Script to manipulate logfile text

Hi guys, I was wandering if a Shell guru could give me some advice on tackling a problem.

I have used a mixture of grep, cut and awk to get data from a log file in the following format:

Code:
14/11/08 10:39:      Checking currenly    :  Enabled
14/11/08 10:39:      Records allocated    :  221
14/11/08 10:39:      Records Freed         :  0
14/11/08 10:39:      Records Aged          :  56

list continues in same format etc.......

What I would now like to do is pipe it into another bit of script which would leave it in a comma delimited format with date timestamp so i can throw it into a sql data base, format like so.

14/11/08 , 10:39 , Enabled , 221 , 0 , 56

I have come a little stuck and am not sure how I would do this so any advice would be much appreciated.

Last edited by Franklin52; 12-02-2008 at 03:06 PM.. Reason: adding code tags
# 2  
Old 12-02-2008
Just to add a quick note the formatting has slightly messed after posting to the forum, everything is in straight clear cut colums with set character positions
# 3  
Old 12-02-2008
Question Question

How do you know how far to carry the
Enabled , 221 , 0 , 56 ?

Are you grouping things with the same date/time, or until some other message comes up?
# 4  
Old 12-02-2008
Those values are taken from the last column until the end of the file, the date time stamp is the same due to earlier text processing. thats why I just want to end up with

14/11/08 , 10:39 , Enabled , 221 , 0 , 56
# 5  
Old 12-02-2008
Try this:

Code:
awk '{
s=$1" , "substr($2,1,5)" , "$6
for(i=1;i<4;i++) {
  getline;s=s" , "$6
}
print s}' file

Regards
# 6  
Old 12-02-2008
Could you possibly run me through what each line of the code is doing so i can alter it if need be regards ross
# 7  
Old 12-02-2008
And thanks works great on the text I provided above
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Manipulate condition to send mail based on output text in file

Hi All, I have a working script as below. echo "Files loaded with $(cat /var/tmp/script.X1.out)" | mail -s "Files loaded with return code" mailid This script takes the output from script.X1.out file and appends the text "Files loaded with return code" and sends the email. Now what I want... (5 Replies)
Discussion started by: midhun3108
5 Replies

2. UNIX for Beginners Questions & Answers

How to manipulate a text file and store each version for every changes in a directory?

I attached both picturehttps://1drv.ms/t/s!Aoomvi55MLAQh1jODfUxa-xurns_ and *.txt file of a sample work file. In this file Reactions which only start with "r1f", "r2f", "r3f"......and so on. And for each reaction the reaction rates is situated couple of lines later with a "+" sign. For each... (1 Reply)
Discussion started by: Atta
1 Replies

3. Shell Programming and Scripting

A better way to manipulate text

Good morning everyone, I'm currently trying to convert an environment variable into a string and then attach it at the end of a command and launch it. I have the following right now, but it's very ugly: AMI_TAGS="env=test,country=XX,city=blah,galaxy=blahblah" aws ec2 create-tags... (8 Replies)
Discussion started by: da1
8 Replies

4. UNIX for Beginners Questions & Answers

How can I remove partial duplicates and manipulate text?

Hello, How can I remove partial duplicates and manipulate text in bash using either awk, grep or sed? Thanks. Input: ted,"foo,bar,zoo" john-son,"foot,ben,zoo" bob,"bar,foot" Expected Output: foo,ted bar,ted zoo,ted foot,john-son ben,john-son (4 Replies)
Discussion started by: tara123
4 Replies

5. Shell Programming and Scripting

Manipulate the text file in UNIX

Hi All, I have a file like below and i have 2 questions on this (They are 3 lines starts with 01 , 02 and 03. but is 01abc333644554 234 2334535 34534535355353 sfsdf345455 353 4543 jgkg tty 7676 02cdesdfsdfsdf 234 wesdfsdf 345345 234234 234234 2342342 dfgdfg sdfgg dgdgdg fgvfs... (6 Replies)
Discussion started by: siva.pitchai
6 Replies

6. Shell Programming and Scripting

Logfile monitoring with logfile replacement

Bonjour, I've wrote a script to monitor a logfile in realtime. It is working almost perfeclty except for two things. The script use the following technique : tail -fn0 $logfile | \ while read line ; do ... some stuff done First one, I'd like a way to end the monitoring script if a... (3 Replies)
Discussion started by: Warluck
3 Replies

7. Shell Programming and Scripting

Need help to manipulate data using script

Hi i want to manipulate my data to convert row to column name 600 Slno vlan 1 600 2 609 3 700 name 700 Slno vlan 1 600 2 609 3 700 (8 Replies)
Discussion started by: nith_anandan
8 Replies

8. UNIX for Dummies Questions & Answers

Question on how to manipulate a SIMPLE text file (using awk?)

I have a simple txt files that looks something like this (The title is a part of the text file) Student Grades --------------- 1 Tim Purser 89 2 John Wayne 56 3 Jenn Hawkins 95 4 Harry Potter 75 Here are my questions: How would I ONLY print the names of students... (2 Replies)
Discussion started by: ninjagod123
2 Replies

9. Shell Programming and Scripting

manipulate text for openldap import/export question.

Hey guys.. I am not sure if this is the right place to post this - but here goes. I need to manipulate an openldap export to match a different schema so that I can import into that system. Basically - its just text manipulation. I have gotten alot of it done just by using simple sed, but I am sorta... (0 Replies)
Discussion started by: i2ambler
0 Replies

10. UNIX for Dummies Questions & Answers

using sed to manipulate text in files

Hi, I have a slight problem in trying to manipulate the text within a file using the "sed" command in that the text i need changed has "/" slashes in. I have a .sh script that scans the "/db/sybbackup/" directories for any .dmp file older than 2 days and then to >> the information to a file called... (3 Replies)
Discussion started by: Jefferson333
3 Replies
Login or Register to Ask a Question