Using awk with the date command and escape characters
I have a file that is a log file for web traffic. I would like to convert the timestamp in it to unix time or epoch time.
I am using the date command in conjunction with awk to try to do this. Just
myfile:
I can run the date command like this:
And I get the intended result:
(809593230 seconds since Jan 1, 1970)
So myfile above, the expected output should be:
I'm close but I'm getting an error.
I run the following command:
The error I get is:
I've tried various combinations of this but with no success. I think it could be because 1) commands like date may not work inside an awk statement and 2) I need to properly escape the '+' and the '%' inside an awk statement so it can be passed on to the date command correctly. Any help is much appreciated.
Thanks!
Last edited by Scott; 06-19-2010 at 11:10 PM..
Reason: Please use code tags
Both the perl and the while read solution worked great! I'll let you know if one runs faster than the other as I will be running this on approximately 1 million lines.
---------- Post updated at 01:02 PM ---------- Previous update was at 08:49 AM ----------
Ok, so I ran both the Perl and the "while read" code blocks on a 309MB log file that had 6,397,194 lines. While both code blocks performed the same end result, the Perl block of code performed exponentially faster, so I had to use that instead of the while read. I waited about 10 minutes on the "while read" block and it was still going. The Perl block finished under 3 minutes. So I ended up using the Perl block in my script.
Debian 9 64x - LXDE
How can i disable escape sequences in a variable?
#!/bin/bash
#mainscript
. "./links.bash"
echo "$red_start This text should be red $color_end"#!/bin/bash
#links.bash
#colors
red_start="\eOutput that i get:
\e
Output expected:
This text should be... (5 Replies)
I have an application which I am integrating with that accepts the password via a CLI. I am running in to issues with passwords that contain special characters. I tried to escape them all, but I ran in to an issue where I cannot escape the characters
'
]
My attempt is as follows:
$... (2 Replies)
i am executing script from A server which will execute the script in B server , as below.
ssh A 'ssh B echo 'select * from testing where name ='test''
i am getting the below output.
select * from testing where name=test
but i need the output where clause with quotes , tried with... (3 Replies)
i need to replace the any special characters with escape characters like below.
test!=123-> test\!\=123
!@#$%^&*()-= to be replaced by
\!\@\#\$\%\^\&\*\(\)\-\= (8 Replies)
I'm using awk '{print $1}' and it works most of the time to print the contents of a mysql query loop, but occationally I get a field with some special character in it, is there a way to tell awk to ignore all special characters between my FS? I have >186K records, so building a list of ALL special... (6 Replies)
Hi,
I want to know if escape charaters work on all the popular UNIX shells. More specifically I want to know if echo "\c" will work on most of the UNIX shells and are there any specific shells on which \c won't work.
Please help.
Thanks,
Vineet (2 Replies)
Hi all
I have been trying to write a script to look for a set of specific escape characters in a file. On viewing the file via vi it shows this :
^ I understand this means no end of line.
I have tried a vary of grep parameters such as grep ^\^. filename grep --binary-file=binary without... (8 Replies)
hey
i want to know the unix commands to replace all the character escape sequences with their "C" values in a string...
thanks in advance..!
Regards,
Sharanya (9 Replies)
Hi,
I am trying to execute the following command from a batch script, but no matter how many escape characters I put in it doesn't execute properly. It works fine from the command line with quotes around the -exec part.
#!/bin/sh
/usr/local/bin/sudo /usr/atria/bin/cleartool setview -exec... (0 Replies)
I'm trying to modify the /usr/lib/lp/model/netstandard file to generate a header for all the print jobs that are sent, but there is no formfeed defined so the the job prints right after the header with no page break. What is the sequence I need in order to generate a formfeed? Or, do you have... (4 Replies)