Shell Programming and Scripting

My guess would be that you are getting the wrong results because the data format has changed, but we can't know what went wrong if you do not show us an example of in input line for which my last suggestion gave you the wrong results.

Don,

Can send me a Private Message so that I can share things with you in private?

Mark

Mark,
Forum rules prohibit hiding technical discussions in private e-mail. Hiding technical conversations in private e-mail hides details about this public conversation from everyone else reading this thread and keeps you from getting input from others on this forum who may be able to provide you with a working solution. In addition to that, I am obviously unable to speak in a language you understand. Maybe someone else seeing our continued discussion will be able to help you much better than I have been able to do.

The request is very simple: Show us sample input for which the script I suggested (or the script Scrutinizer suggested) does not produce the correct output.

Don,

The reason is that we use some information in our logs that is not to be made visible to the public. I will try to obfuscate the data so that the content is valid but the data itself is still private.

---------- Post updated at 07:15 PM ---------- Previous update was at 07:13 PM ----------

Don,

Here is the data:

Code:

2016-09-17 10:30:36  INFO: [D3B4AEB3] id: 4562079193, time: 2016-09-17 10:30:35, lat: 51.00000, lon: -112.00000, speed: 64.3, course: 130.0
2016-09-17 10:30:57  INFO: [D3B4AEB3] id: 4562079216, time: 2016-09-17 07:30:55, lat: 51.00000, lon: -112.00000, speed: 0.0, course: 0.0
2016-09-17 10:30:57  INFO: [D3B4AEB3] id: 4562079216, time: 2016-09-17 10:30:55, lat: 51.00000, lon: -112.00000, speed: 0.0, course: 0.0
2016-09-17 10:31:16  INFO: [D3B4AEB3] id: 4562079193, time: 2016-09-17 10:31:15, lat: 51.00000, lon: -112.00000, speed: 64.3, course: 130.0

---------- Post updated at 07:18 PM ---------- Previous update was at 07:15 PM ----------

I did not want to undermine the great benefits of this forum nor to make anyone feel that there was a language difference. I wanted to protect some data that contained sensitive information.

Mark

Hi Mark,
You should not be sending company private data outside of your company to this forum or to me. Obfuscated data is fine, but we do need to see the actual format of your data. If the data you showed us in earlier posts was not representative of your actual data, there is a very low chance that the code we provided to work on your sample data will work on your actual data.

Don

Don,

I thought that any other data on the line would not be an issue. I would never provide any of the sensitive data, but wanted to try to keep as much of it out of public scrutiny.

I deeply apologize for these actions.

I provided obfuscated data above this post and probably when you were responding.

See above.

Mark

In your earlier samples, the timestamps were in the 2nd field on a line and on the last field on a line. With your new data, the starting timestamp is not even close to being in the last field on the input line. If the timestamps are in the 2nd and 9th fields (with fields separated by sequences of one or more space or tab characters), the following should work:

Code:

awk '
{	split($2, t, ":")
	e = t[1] * 3600 + t[2] * 60 + t[3]
	split($9, t, ":")
	s = t[1] * 3600 + t[2] * 60 + t[3]
}
e - s > 10
' Example2

producing the output:

Code:

2016-09-17 10:30:57  INFO: [D3B4AEB3] id: 4562079216, time: 2016-09-17 07:30:55, lat: 51.00000, lon: -112.00000, speed: 0.0, course: 0.0

with your new sample data.

And, please go back and look at that tutorial on how to post threads in the UNIX & Linux Forums and how to use CODE tags. There is absolutely nothing in there about using UNIX commands; only about how to format posts submitted to this forum in a manner that will allow people reading your posts to see leading spaces and tabs in the sample input, output, and code you show us and to see the difference between single spaces and sequences of spaces and tabs in the sample input, output, and code that you show us.

Don