Retrieving Information From A Syslog File


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Retrieving Information From A Syslog File
# 1  
Old 06-06-2010
Retrieving Information From A Syslog File

Hi,

I have a number of firewalls that send there traffic logs to a syslog server.
Each log entry takes up about 3 lines and the text within the log entry is delimited by a space. There are parts of the three lines that I need from every traffic log entry. I have been using a combination of sed, grep, cut, and sort and uniqe to data mine the information I need.
Up until this point I have been searching for information contained within one line of the three line log entry. How do I pull information from the 1st and 3rd lines of the one log entry??

My understanding is that sed s/ and grep search line by line? Can I configure sed and or grep to search the three lines of each log entry? if this makes sense.

Any advise would be appreciated.

Thanks

Andy
# 2  
Old 06-06-2010
awk - since you must already have a regex to find line1:
Code:
awk '/regex goes here/ {ok=1}
       ok==1 || ok==3 {print}
       {ok++;next} ' /path/to/syslog | paste - - | [your data mining code here]

# 3  
Old 06-06-2010
Thanks Jim,

I will give it a shot.

Andy
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Retrieving sequence data from other file

Hello experts :cool:, I am new to programming and will need your help.. I have 2 very large files with the following format: FILE1: >MLP1019 PL4 >MLP7456 PL3 >MLP9268 PL9 >MLP6245 PL1 FILE2: >MLP1019 STNAPLQTSNTWVSYQPSMMMSLQ >MLP7456 PPYWYWNSAVMIFYVQPLSLLAVLLA >MLP9268... (2 Replies)
Discussion started by: narachaid
2 Replies

2. Shell Programming and Scripting

Retrieving File name

Hi All.. I have a Filename as FAB1_600015_CONRAD.A0_7XYZ12345.000_LT-SWET.01_LTPA25L_20110622-161429_07_WFR12345_20110622-161429_20110712-125228.data.dis I want to get the result as... (5 Replies)
Discussion started by: asheshrocky
5 Replies

3. UNIX and Linux Applications

Retrieving symbol information from crash dump on Mac OS X

I am initiating the discussion.Hope everyone will add on to this. Whenever any application crashes the system's crash reporter(/System/Library/CoreServices/Crash Reporter.app) creates a crash dump.A crash dump is the image of the state of the kernel that was in physical memory when the system... (0 Replies)
Discussion started by: elizas
0 Replies

4. UNIX for Advanced & Expert Users

Retrieving accurate file timestamp

Hi Gurus, The requirement is to collect the timestamp of soft links and collect it in a file in the following pattern: This is the expected output: Pattern: MM/DD/YYYY hh:mi:ss filename Example: 12/26/2008 10:31:09 <Filename>.zip The closest way I could get was this: ls... (8 Replies)
Discussion started by: jidsh
8 Replies

5. UNIX for Dummies Questions & Answers

Retrieving particular row from a dat file

Hi.. I have a dat file containing both column names and data. Now I want to get only Particular row along with the column names. My dat fiel is as below EmpName Dept Salary Shally Admin 20000 Swati HR 15000 Deepali IT 45000 Preetika EEE 60000 Now I want to display only row 3rd along... (5 Replies)
Discussion started by: Mayuri P R
5 Replies

6. Shell Programming and Scripting

Retrieving File's Mime-type

Alright, so I am trying to use perl (or any other shell scripting language, awk/sed/bash for instance), to retrieve the mime-type of a file. I want to keep it in one file, and most of the modules that are on cpan that check for mime types (Magic), aren't installed on these boxes. Anyone have... (2 Replies)
Discussion started by: Rhije
2 Replies

7. UNIX for Dummies Questions & Answers

Retrieving random numbers out of a text file

Hi one and all, I'm working on a Bash script that is designed to calculate how much IP traffic has passed through a port to determine traffic volume over a given amount of time. I've currently been able to use the netstat -s command coupled with grep to write to a file the total packets... (13 Replies)
Discussion started by: nistleloy
13 Replies

8. UNIX for Dummies Questions & Answers

Retrieving PID from a file

Hello I need to retrieve the content of a file in the shell script file(.sh file). I store the Process ID of the a process in file.Only the PID is available in that file. Inside the shell script i want to retireve the content(PID) and need to check for the existence of the Process.Basically... (5 Replies)
Discussion started by: appleforme1415
5 Replies

9. Shell Programming and Scripting

Automating Rlogin and File Retrieving

Hi, I'm a begginer in Unix Scripting and i'm trying to write a script that performs this functions.. 1. Rlogin to a system 2. Copy a Perl script inTO the system 3. Run the Perl Script 4. Retrieve the result(file) of the Perl Script 5. Copy the result file to a single system 6. Logout of... (3 Replies)
Discussion started by: vicesjr
3 Replies

10. UNIX for Advanced & Expert Users

retrieving a deleted file

hi!, is there any way to retrieve a file that I have deleted few minutes back?? I am using Solaris- 5.6.. :rolleyes: (2 Replies)
Discussion started by: jyotipg
2 Replies
Login or Register to Ask a Question