Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: removing rows from text file older than certain date
Top Forums Shell Programming and Scripting removing rows from text file older than certain date Post 302596831 by firefox2k2 on Wednesday 8th of February 2012 11:30:55 AM
Old 02-08-2012
Hi balajesuri,

Thank you for the help, your code works on smaller files but when trying it on one of the bigger files I get the following error.

Code:
./test.sh: line 7: [: too many arguments

Any ideas?

Thanks again

---------- Post updated at 11:30 AM ---------- Previous update was at 11:28 AM ----------

Quote:
Originally Posted by ahamed101
Try this...
Code:
awk -F, '{split($2,a,"/");sec=mktime(a[3]" "a[2]" "a[1]" 00 00 00");diff=(systime()-sec)/(60*60*24)} diff<=30' infile

--ahamed

Thanks for the help but I get the following errors:
Code:
awk: line 2: function systime never defined
awk: line 2: function mktime never defined

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Removing rows from a file based on date comparison

I have a '|' delimited file and want to remove all the records from the file if the date is greater than a year from sysdate. The layout of the file is as below - xxxxxxxxxxxxxx|yyyyyy|zzzzzz|2009-12-27-00:00| 000000000|N xxxxxxxxxxxxxx|yyyyyy|zzzzzz|2010-01-03-00:00| 000000000|N... (4 Replies)
Discussion started by: Max_2503
4 Replies

2. Shell Programming and Scripting

Removing rows from a file

I have a file like below and want to use awk to solve this problem. The record separator is ">". I want to look at each record section enclosed within ">". Find the row with the 2nd and 3rd columns being 0, such as 10 0 0 I need to take the first number which in this case is 10. Then... (15 Replies)
Discussion started by: kristinu
15 Replies

3. Shell Programming and Scripting

Removing rows based on a another file

Hi, I am not sure if this has already been asked (I tried the search but the search was too broad). Basically I want to remove rows based on another file. So file1 looks like this (tab seperated): HHN 3 5 5 HUJ 2 2 1 JJJ 3 1 1 JUN 2 1 3 I have another file (file2)... (2 Replies)
Discussion started by: kylle345
2 Replies

4. UNIX for Dummies Questions & Answers

Removing duplicate rows & selecting only latest date

Gurus, From a file I need to remove duplicate rows based on the first column data but also we need to consider a date column where we need to keep the latest date (13th column). Ex: Input File: Output File: I know how to take out the duplicates but I couldn't figure out... (5 Replies)
Discussion started by: shash
5 Replies

5. Shell Programming and Scripting

Move file older date

hlow all i have folder with name like this 20110512 20110601 20110602 so i want move the last 1 day to other directory for example this date 20110602 so i want move folder older 1 day from this date 20110512 -----> this folder will move to other dir 20110601-----> this folder will move... (2 Replies)
Discussion started by: zvtral
2 Replies

6. Shell Programming and Scripting

Removing rows and chars from text file

Dear community, maybe I'm asking the moon :rolleyes:, but I'm scratching my head to find a solution for it. :wall: I have a file called query.out (coming from Oracle query), the file is like this: ADDR TOTAL -------------------- ---------- TGROUPAGGR... (16 Replies)
Discussion started by: Lord Spectre
16 Replies

7. Shell Programming and Scripting

Delete log files content older than 30 days and append the lastest date log file date

To delete log files content older than 30 days and append the lastest date log file date in the respective logs I want to write a shell script that deletes all log files content older than 30 days and append the lastest log file date in the respective logs This is my script cd... (2 Replies)
Discussion started by: sreekumarhari
2 Replies

8. Shell Programming and Scripting

Bash script help - removing certain rows from .csv file

Hello Everyone, I am trying to find a way to take a .csv file with 7 columns and a ton of rows (over 600,000) and remove the entire row if the cell in forth column is blank. Just to give you a little background on why I am doing this (just in case there is an easier way), I am pulling... (3 Replies)
Discussion started by: MrTuxor
3 Replies

9. Shell Programming and Scripting

Removing Duplicate Rows in a file

Hello I have a file with contents like this... Part1 Field2 Field3 Field4 (line1) Part2 Field2 Field3 Field4 (line2) Part3 Field2 Field3 Field4 (line3) Part1 Field2 Field3 Field4 (line4) Part4 Field2 Field3 Field4 (line5) Part5 Field2 Field3 Field4 (line6) Part2 Field2 Field3 Field4... (7 Replies)
Discussion started by: ekbaazigar
7 Replies

10. Shell Programming and Scripting

Removing top few and bottom few rows in a file

Hi, I have a requirement where I need to delete given number of top and bottom rows in a flat file which has new line as its delimiter. For ex: if top_rows=2 & bottom_rows=1 Then in a given file which looks like: New York DC LA London Tokyo Prague Paris Bombay Sydney... (7 Replies)
Discussion started by: calredd
7 Replies

LEARN ABOUT SUNOS

bdiff

bdiff(1)							   User Commands							  bdiff(1)

NAME

       bdiff - big diff

SYNOPSIS

       bdiff filename1 filename2 [n] [-s]

DESCRIPTION

       bdiff  is  used in a manner analogous to diff to find which lines in filename1 and filename2 must be changed to bring the files into agree-
       ment. Its purpose is to allow processing of files too large for diff. If filename1 (filename2) is -, the standard input is read.

       bdiff ignores lines common to the beginning of both files, splits the remainder of each file into n-line segments, and invokes diff on cor-
       responding segments. If both optional arguments are specified, they must appear in the order indicated above.

       The  output  of	bdiff  is exactly that of diff, with line numbers adjusted to account for the segmenting of the files (that is, to make it
       look as if the files had been processed whole). Note:  Because of the segmenting of the files, bdiff does not necessarily find  a  smallest
       sufficient set of file differences.

OPTIONS

       n	The  number  of line segments. The value of n is 3500 by default. If the optional third argument is given and it is numeric, it is
		used as the value for n. This is useful in those cases in which 3500-line segments are too large for diff, causing it to fail.

       -s	Specifies that no diagnostics are to be printed by bdiff (silent option). Note:  However, this does not suppress possible diagnos-
		tic messages from diff, which bdiff calls.

USAGE

       See largefile(5) for the description of the behavior of bdiff when encountering files greater than or equal to 2 Gbyte ( 2**31 bytes).

FILES

       /tmp/bd?????

ATTRIBUTES

       See attributes(5) for descriptions of the following attributes:

       +-----------------------------+-----------------------------+
       |      ATTRIBUTE TYPE	     |	    ATTRIBUTE VALUE	   |
       +-----------------------------+-----------------------------+
       |Availability		     |SUNWesu			   |
       +-----------------------------+-----------------------------+
       |CSI			     |enabled			   |
       +-----------------------------+-----------------------------+

SEE ALSO

       diff(1), attributes(5), largefile(5)

DIAGNOSTICS

       Use help for explanations.

SunOS 5.10							    14 Sep 1992 							  bdiff(1)
All times are GMT -4. The time now is 05:48 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy