07-31-2007
grep a log file to filter previous dates
Hi,
I have problem of filtering a log file from my perl script.
#cat /data/pinpe.csv_20070731 | nawk -v FS=, '{print $1','$18','$22','$26}' | grep -w 100 | grep -w 1 | nawk '{print $4}'
Below is the output:
2009-06-16
2009-01-29
2009-06-02
2008-03-05
2007-08-05
2007-09-24
2007-07-10
2007-10-27
2007-10-14
2008-08-02
2007-11-10
2007-10-16
2008-09-15
2008-01-30
2008-12-08
2007-09-26
2007-11-29
2008-04-01
2007-11-21
2007-12-18
2007-10-04
2007-06-29
2008-01-13
2007-10-28
2007-10-20
2007-09-13
2008-11-05
2008-08-05
2008-04-10
2007-09-10
2008-10-12
2007-11-29
2008-04-02
2009-03-05
2009-07-18
2007-11-16
2007-10-13
Now my dilemma is I want to filter this ouput by my preferred dates. I wanted it to output the date from yesterday and backwards. In other words I want to filter all the dates less than today's date (i.e. 2007-07-30, 2007-07-29, 2007-07-28, etc. and below). And finally count the number of lines for the final output.
Tnx in advance.
Br, Pete
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Im tyring to create a script that will show me any lines in a file with todays date and yesterdays, the date format in the file is as follows
----- amqxfdcx.c : 728 --------------------------------------------------------
07/12/05 09:53:20
AMQ6109: An internal WebSphere MQ error has... (3 Replies)
Discussion started by: csaunders
3 Replies
2. UNIX for Dummies Questions & Answers
Is there any way to use date with previous dates such as "2 23 2000" in order to see what day of the week it was? I tried changing the current date to "date 022300452000"
but then it told me that I could not do this because I was "Not the owner". Any other ways of getting the day result? (2 Replies)
Discussion started by: terms5
2 Replies
3. Shell Programming and Scripting
Hi
Currently I can grep a log file with the following command:
$results = `grep -A 2 '^$date.$time.*' $log`;
and the following arguments:
$date = 2007/04/25
$time = 16:07
Log example:
2007/04/25 16:07:12.145701
2007/05/25 14:07:12.145701
2007/05/25 17:07:12.145701
2007/06/25... (37 Replies)
Discussion started by: Epiphone
37 Replies
4. UNIX for Dummies Questions & Answers
I am familiar with using the 'date' command to get the current date but I have a situation where I need to get the previous day's date as well as the date two days prior. Theoretically I could use 'expr' to compute these values but I need it to work in instances where the previous month's dates... (2 Replies)
Discussion started by: slant-40
2 Replies
5. Shell Programming and Scripting
Hi,
I need something like,
if the input date is 24/Aug/2008 and the inputvalue is +8 then the result should be 1/Sep/2008 (8 days after the input date)
if the input date is 24/Aug/2008 and the inputvalue is -8 then the result should be 16/Aug/2008 (8 days before the input date)
is there any... (5 Replies)
Discussion started by: Sharmila_P
5 Replies
6. Shell Programming and Scripting
Hi All,
I have a log File and i have to make a report in desired format.can anybody help me.........
log file
------
<<<<< BESI14 >>>>>
<RLGAP:CELL=ALL;
CELL CHANNEL GROUP ALLOCATION DATA
CELL CHGR SAS ODPDCHLIMIT
BUNYM18 0 MULTI 100
--------
desired format... (1 Reply)
Discussion started by: dattatraya
1 Replies
7. Shell Programming and Scripting
I have files called printfile.log.1121, printfile.log.1122, etc where 1121 and 1122 are the date of the file creation.
The file contents are like:
================================================================================
User = d_prod
Env = d_prod
Dir =... (3 Replies)
Discussion started by: Daniel Gate
3 Replies
8. Linux
I have a weird requirement where I have to get the files from a FTP(Lets say FTP1) location and place it on my current FTP(Lets say FTP2) location. The issue is, these are daily files (in a pattern Sales_YYYYMMDD_report.csv) and are placed every day on FTP1 and my process usually runs on Monday(eg.... (2 Replies)
Discussion started by: dhruuv369
2 Replies
9. Shell Programming and Scripting
---------- Post updated at 03:42 AM ---------- Previous update was at 03:38 AM ----------
Sorry for a duplicate post, my post at the first place could not appear due to some net issue on my machine. Here is what i posted earlier:
Hi, i am using ksh in Solaris, i wanted to assign today's,... (5 Replies)
Discussion started by: pr5439
5 Replies
10. What is on Your Mind?
How to grep a file containing dates to only last 30 days then move to another folder (7 Replies)
Discussion started by: kmarcus
7 Replies
LEARN ABOUT LINUX
unbuffer
UNBUFFER(1) General Commands Manual UNBUFFER(1)
NAME
unbuffer - unbuffer output
SYNOPSIS
unbuffer program [ args ]
INTRODUCTION
unbuffer disables the output buffering that occurs when program output is redirected from non-interactive programs. For example, suppose
you are watching the output from a fifo by running it through od and then more.
od -c /tmp/fifo | more
You will not see anything until a full page of output has been produced.
You can disable this automatic buffering as follows:
unbuffer od -c /tmp/fifo | more
Normally, unbuffer does not read from stdin. This simplifies use of unbuffer in some situations. To use unbuffer in a pipeline, use the
-p flag. Example:
process1 | unbuffer -p process2 | process3
CAVEATS
unbuffer -p may appear to work incorrectly if a process feeding input to unbuffer exits. Consider:
process1 | unbuffer -p process2 | process3
If process1 exits, process2 may not yet have finished. It is impossible for unbuffer to know long to wait for process2 and process2 may
not ever finish, for example, if it is a filter. For expediency, unbuffer simply exits when it encounters an EOF from either its input or
process2.
In order to have a version of unbuffer that worked in all situations, an oracle would be necessary. If you want an application-specific
solution, workarounds or hand-coded Expect may be more suitable. For example, the following example shows how to allow grep to finish pro-
cessing when the cat before it finishes first. Using cat to feed grep would never require unbuffer in real life. It is merely a place-
holder for some imaginary process that may or may not finish. Similarly, the final cat at the end of the pipeline is also a placeholder
for another process.
$ cat /tmp/abcdef.log | grep abc | cat
abcdef
xxxabc defxxx
$ cat /tmp/abcdef.log | unbuffer grep abc | cat
$ (cat /tmp/abcdef.log ; sleep 1) | unbuffer grep abc | cat
abcdef
xxxabc defxxx
$
BUGS
The man page is longer than the program.
SEE ALSO
"Exploring Expect: A Tcl-Based Toolkit for Automating Interactive Programs" by Don Libes, O'Reilly and Associates, January 1995.
AUTHOR
Don Libes, National Institute of Standards and Technology
1 June 1994 UNBUFFER(1)