Sponsored Content
Top Forums Shell Programming and Scripting extracting part of a text file Post 302336169 by alinaqvi90 on Tuesday 21st of July 2009 11:20:23 AM
Old 07-21-2009
Bug extracting part of a text file

Hi guys

So I have a very large log file where each event is logged along with the time that it occurred.

So for e.g. The contents of the file look like:
Code:
...
12:00:07 event 0 happened.
12:01:01 event 1 happened.
12:01:05 event 2 happened.
12:01:30 event 3 happened.
12:02:01 event 4 happened.
12:02:40 event 5 happened.
12:03:40 event 6 happened.
12:04:06 event 6 happened.
...

I want to extract every thing in that file listed between a given start time and an end time.

so some thing like all events between
the first entry of 12:01:00 and the last entry of 12:03:59
and store them in a random text file. Note time stamps can be repeated and therefore I mentioned the first and the last entries.

And not all lines in the log file start with a time stamp. Some lines are just random information about the server etc. But I want to extract those lines as well.

Hope I have clarified my question.

And thanks in advance every one Smilie

ali

Use CODE tags when posting code, data or logs for better readability and to preserve formatting like indention etc., ty.

Last edited by zaxxon; 07-21-2009 at 12:25 PM.. Reason: code tags, what else
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Extracting data from text file based on configuration set in config file

Hi , a:) i have configuration file with pattren <Range start no>,<Range end no>,<type of records to be extracted from the data file>,<name of the file to store output> eg: myfile.confg 9899000000,9899999999,DATA,b.dat 9899000000,9899999999,SMS,a.dat b:) Stucture of my data file is... (3 Replies)
Discussion started by: suparnbector
3 Replies

2. Shell Programming and Scripting

Extracting a line in a text file

If my file looks like this…. 10 20 30 and I want to take each line individually and put it in a variable so it can be read later in it's on individual test statement, how can I do that? I guess what I'm asking is how can I extract each line individually. Thanks (5 Replies)
Discussion started by: terryporter51
5 Replies

3. Shell Programming and Scripting

Extracting specific text from a file

Dear All, I have to extract a a few lines from a log file and I know the starting String and end string(WHich is same ). Is there any simplere way using sed - awk. e.g. from the following file -------------------------------------- Some text Date: 21 Oct 2008 Text to be extracted... (8 Replies)
Discussion started by: rahulkav
8 Replies

4. Shell Programming and Scripting

Extracting a part of XML File

Hi Guys, I have a very large XML feed (2.7 MB) which crashes the server at the time of parsing. Now to reduce the load on the server I have a cron job running every 5 min.'s. This job will get the file from the feed host and keep it in the local machine. This does not solve the problem as... (9 Replies)
Discussion started by: shridhard
9 Replies

5. UNIX for Dummies Questions & Answers

extracting text and reusing the text to rename file

Hi, I have some ps files where I want to ectract/copy a certain number from and use that number to rename the ps file. eg: 'file.ps' contains following text: 14 (09 01 932688 0)t the text can be variable, the only fixed element is the '14 ('. The problem is that the fixed element can appear... (7 Replies)
Discussion started by: JohnDS
7 Replies

6. UNIX for Dummies Questions & Answers

Extracting the last column of a text file

I would like to extract the last column of a text file but different rows of the text file have different numbers of columns. How do I go about doing that? Thanks! (1 Reply)
Discussion started by: evelibertine
1 Replies

7. Shell Programming and Scripting

help extracting text from file

Hello I have a large file with lines beginning with 552, 553, 554, below is a small sample, I need to extract the data you can see below highlighted in bold from this file on the same location on every line and output it to a new file. Thank you in advance for any help 55201KL... (2 Replies)
Discussion started by: firefox2k2
2 Replies

8. UNIX for Dummies Questions & Answers

Extracting lines from a text file based on another text file with line numbers

Hi, I am trying to extract lines from a text file given a text file containing line numbers to be extracted from the first file. How do I go about doing this? Thanks! (1 Reply)
Discussion started by: evelibertine
1 Replies

9. Shell Programming and Scripting

Extracting the column containing URL from a text file

I have the file like this: Timestamp URL Text 1331635241000 http://example.com Peoples footage at www.test.com,http://example4.com 1331635231000 http://example1.net crack the nuts http://example6.com 1331635280000 http://example2.net ... (0 Replies)
Discussion started by: csim_mohan
0 Replies

10. Shell Programming and Scripting

Extracting and copying text from one file to another

Helooo, So I have a .fasta file (a text file with sequence data) which looks like this, with just over 3 million lines of data. >TCONS_00000001 gene=XLOC_000001 AATTGTGGTGAAATGACTTCTGTTAACGGAGACATCGATGATTGTTGTTACTATTTGTTCTCAGGATTCA... (8 Replies)
Discussion started by: 4galaxy7
8 Replies
ds.log(4)							   File Formats 							 ds.log(4)

NAME
ds.log - Availability Suite data services log file DESCRIPTION
The /var/adm/ds.log file contains the Availability Suite data services command log. The administration commands log activities to the file in the format: date time product: message Note that when the size of the log file exceeds 10 Mbytes, ds.log is renamed /var/adm/ds.log.bak and a new /var/adm/ds.log file is cre- ated. The ds.log fields are: date The date format is mmm nn, where mmm is the local three-character abbreviation for the month and nn is the day of the month on which the event occurred. time The time of the event, in hh:mm:ss format. product A product code that identifies which component of the data services produced the event. The code is separated from the message that follows by a colon (:) and a space. message A message that can extend over more than one line describing the event that occurred. The second or following lines are not pre- fixed by the date, time, and product code strings. EXAMPLES
The example below shows sample ds.log file content: Jan 25 05:26:17 ii: iiboot suspend cluster tag <none> Jan 25 05:32:02 ii: iiboot resume cluster tag <none> Jan 25 05:32:04 sv: svboot: resume /dev/vx/rdsk/bigmaster Jan 25 05:32:04 sv: svboot: resume /dev/vx/rdsk/bigshadow Jan 25 05:32:04 sv: svboot: resume /dev/vx/rdsk/mstvxfs Jan 25 05:32:04 sv: svboot: resume /dev/vx/rdsk/master01 ATTRIBUTES
See attributes(5) for descriptions of the following attributes: +---------------------+---------------------------------------------------------+ | ATTRIBUTE TYPE | ATTRIBUTE VALUE | +---------------------+---------------------------------------------------------+ |Architecture | x86 | +---------------------+---------------------------------------------------------+ |Availability | SUNWscmu | +---------------------+---------------------------------------------------------+ |Interface Stability | Committed | +---------------------+---------------------------------------------------------+ SEE ALSO
iiadm(1M), sndradm(1M), svadm(1M), attributes(5) SunOS 5.11 08 Jun 2007 ds.log(4)
All times are GMT -4. The time now is 03:36 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy