How to extract start/end times from log file to CSV file?
Hi,
I have a log file (log.txt) that which contains lines of date/time.
I need to create a script to extract a CSV file (out.csv) that gets all the sequential times (with only 1 minute difference) together by stating the start time and end time of this period.
Sample log file (log.txt)
The CSV out file should look something like the below:
The first column of each line is the start time, the second column is the end time, and the third column is the number of minutes between the start and end times.
Thanks a lot for your replies. I really appreciate your help.
However, unfortunately, I still have problems trying both ways...
@Igal Malka, I tried the script you provided, but it only checks for days (not times)... meaning that it doesn't capture the case when there is non-sequential times in the same day.
When I tired the script, the result was the below:
It checked only for the date and assumed that those are only 3 minutes (on 23-11-2014), where it is actually 1 minute at 03:00, and 2 minutes from 05:24 to 05:25.
@RudiC, I tried the script you provided, but unfortunately it gave me some error related to printf:
Note:
OS:
Thanks,
Zizo
As I said, it needs a recent shell that has the %(datefmt)T format for printf. You still can try to use the date command to convert epoch seconds to your preferred date format.
Modification of RudiC script (I unrolled the pipeline just to make it clearer to myself) that doesn't use the %(datefmt)T format of printf
See the manpage if your version of date doesn't support -d @seconds.
Testing with a larger dataset:
yielded:
(thanks to RudiC for giving me a starting point)
These 2 Users Gave Thanks to derekludwig For This Post:
I have a file which looks something as following, I would like to split to several files, The start and end of each file is 'FILE' and end with 'ASCII... ' .
At the same time for each file in the first column add 100 and also second column add 100 the rest of the column as it is , see example of... (2 Replies)
Hi friend i have input as following XML file
<?xml version="1.0"?>
<Document xmlns="urn:iso:std:iso:20022:tech:xsd:camt.054.001.02">
<BkToCstmrDbtCdtNtfctn>
<GrpHdr><MsgId>LBP-RDJ-TE000000-130042430010001001</MsgId><CreDtTm>2013-01-04T03:21:30</CreDtTm></GrpHdr>... (3 Replies)
Hi, I have a file1 of many long sequences, each preceded by a unique header line. file2 is 3-columns list: headers name, start position, end position. I'd like to extract the sequence region of file1 specified in file2.
Based on a post elsewhere, I found the code:
awk... (2 Replies)
I'd like to copy strings from a log file and put them into a CSV.
The strings could be on different line numbers, depending on size of log.
Example Log File:
File = foo.bat
Date = 11/11/11
User = Foo Bar
Size = 1024
...
CSV should look like:
"foo.bat","11/11/11","Foo Bar","1024" (7 Replies)
Hi All,
I am having an XML tag like:
<detail sim_ser_no_1="898407109001000090"
imsi_1="452070001000090">
<security>ADM1=????</security>
<security>PIN1=????</security>
<security>PIN2=????</security>
... (2 Replies)
Hi
I have a ksh script which fetches data from a db using a number of .arc files and creates CSV files for them and puts them on the server.
Question is, how can I specifiy the start and stop times specifically so that data is fetched for a certain period?
# Get the current time as the... (1 Reply)
Hi
I have a ksh script which fetches data from a db using a number of .arc files and creates CSV files for them and puts them on the server.
Question is, can I specifiy the start and stop times manually and run the script manually to fetch data for a certain period?
# Get the current... (0 Replies)
Hello People,
I have the following contents in an XML file
...........
...........
..........
...........
<Details = "Sample Details">
<Name>Bob</Name>
<Age>34</Age>
<Address>CA</Address>
<ContactNumber>1234</ContactNumber>
</Details>
...........
.............
.............. (4 Replies)
hi
In the foll example the whole text in a single line....
i want to extract text from IPTel to RTCPBase.h.
want to use this acrooss the whole file
Updated: IPTel\platform\core\include\RTCPBase.h \main\MWS2051_Sablime_Int\1... (7 Replies)
Hi
I'm running 4 jobs in the background and I need to write the start and end times to a log file. I know there's probably a simple way to do this but, I can't think of it. I've used nohup <script name> & but, that doesn't record the times. Is there a way to get the start and end times of a... (2 Replies)