How to delete row in csv file on date range?


 
Thread Tools Search this Thread
Top Forums UNIX for Beginners Questions & Answers How to delete row in csv file on date range?
# 1  
Old 04-17-2018
How to delete row in csv file on date range?

I want to delete row in csv file , which row value from 2009-10-01 to 2011-06-03 using script.my csv row data look like:
Code:
2009-10-01
2011-03-30 
                  2011-03-31
2011-04-01 
                  2011-06-03
2011-06-30 
                  2011-07-01 
                  2011-09-28                   
2011-09-29

Moderator's Comments:
Mod Comment Please use CODE tags as required by forum rules!

Last edited by RudiC; 04-17-2018 at 03:24 AM.. Reason: Added CODE tags; moved from "How to Post in the The UNIX and Linux Forums"
# 2  
Old 04-17-2018
Welcome to the forum.

Please make sure to comply to our rules, esp. posting in an adequate forum, and using (CODE) tags.

After having added the tags, it can be seen that the data belong to different fields (= columns) separated by spaces. It's usually best to post comprehensive, representative samples along with OS and shell versions and preferred tools - if any.
# 3  
Old 04-17-2018
How far would
Code:
awk -vDTMN="2009-10-01" -vDTMX="2011-06-03" '
BEGIN                   {gsub (/-/, _, DTMN)
                         gsub (/-/, _, DTMX)
                        }
                        {T = $1
                         gsub (/-/, _, T)
                        }
T < DTMN || T > DTMX
' file
2011-06-30
2011-07-01
2011-09-28
2011-09-29

get you?

Last edited by RudiC; 04-17-2018 at 03:41 AM.. Reason: ... got the conditions wrong...
# 4  
Old 04-18-2018
Dear RudiC, It works fine but i have too many date rows like 1048576 rows.In this case it's not working when i save file to the new file it remains same.

Last edited by rakibul639; 04-18-2018 at 02:19 AM..
# 5  
Old 04-18-2018
Difficult to believe. Post data / samples.
# 6  
Old 04-18-2018
@RudiC ,here is my data file assss.csv.tar.gz
# 7  
Old 04-18-2018
Works perfectly for me. Where exactly is your problem?
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Row Count in .csv file

Hi, I have to find the count of rows starting with "E," in given a.csv file . Sample Data File. E,2333AED,A,MC3,25,31-MAY-18 E,2333AED,A,MC3,25,31-MAY-18 CYMC3 25AED 0000 E,2333CZK,A,MC3,25,31-MAY-18 CYMC3 25CZK 0000 E,2333EUR,A,MC3,25,31-MAY-18... (3 Replies)
Discussion started by: Prabhakar Y
3 Replies

2. Shell Programming and Scripting

Bash - delete from csv all the row if the first column is length >

Hi guys, i have a csv file like: USERID;COG;DESCR;FIL;OFF user001;user;test1;001;A01 user002;user;test2;002;A02 user0003;user;test3;003;A03 user004;user;test4;004;A04 user0005;user;test5;005;A05 etc.. I need to read line for line and, if value of first column is > 7 char (in this example... (4 Replies)
Discussion started by: kamose
4 Replies

3. Shell Programming and Scripting

Append data to new row in CSV file every day

Hi All I will run the same script every day in corn and output should go to same CSV file but in different row with dates on it. Below is my example in attached format. Script i am using to collect switch port online DATE=`date '+%d-%m-%y'` for f in `cat... (1 Reply)
Discussion started by: ranjancom2000
1 Replies

4. Shell Programming and Scripting

Copying down first row in to all the below blank rows in a .csv file

Hi All, I have many of files(.csv) of the format given below. Date,Name,Location 04/02/2012,A,India ,B,China ,C,USA Like this I have 1000's of rows and many columns in all my files. I need a shell script to copy down the Date(in this example column1) to the next 2 rows below(in the... (8 Replies)
Discussion started by: ks_reddy
8 Replies

5. Shell Programming and Scripting

delete a row in csv file based on the date

Hi, I have a csv file with old data..i need to have only last 30 days from the current dateof data in the file.The fourth field in the file is a date field.i need to write a script to delete the old data by comparing the the fourth field with the (current date -30).I need to delete the rows in... (2 Replies)
Discussion started by: pals70423
2 Replies

6. UNIX for Dummies Questions & Answers

Delete a row from a file if one column containing a date is greater than the current system date

Hello gurus, I am hoping someone can help me with the required code/script to make this work. I have the following file with records starting at line 4: NETW~US60~000000000013220694~002~~IT~USD~2.24~20110201~99991231~01~01~20101104~... (4 Replies)
Discussion started by: chumsky
4 Replies

7. UNIX for Dummies Questions & Answers

Date range command (and delete)

Hello. Newbie here.... I basically have a directory with tens of thousands (literally) subdirectories and need to delete those that are older than 2008 (hundreds) with all their contents. I've looked through all the RM parameters and still can't quite figure out how to specify the data range... (7 Replies)
Discussion started by: pqmomba8
7 Replies

8. UNIX for Dummies Questions & Answers

How to delete a row in a file

hi team, i have a file txt1 , in that file there r 10 lines . my aim is to cut 2nd and 6th line of the file . what command we can use for this scenario. (8 Replies)
Discussion started by: natraj005
8 Replies

9. Shell Programming and Scripting

How to Delete Last Row from .csv file in perl

Hi , I've a perl script to convert .xls to .csv .After conversion I want to delete first 28 and the last row from .csv file.Is there any efficent way to achive this both together. I'm deleting first 28 rows by using folllowing my perl code: exec " tail -n+28 infile.csv > outfile.csv ... (7 Replies)
Discussion started by: ajaypatil_am
7 Replies

10. UNIX for Dummies Questions & Answers

Delete first row of csv file

I have a csv file, which is > 2 Gigs. I need to BCP that file to Sybase db , but I cant upload that b'caz first row of the file is failing. ( having some errors probably.) I can manually insert the first line into db & then I can upload the rest of the data in file, if i can delete the first row. ... (2 Replies)
Discussion started by: kedar.mehta
2 Replies
Login or Register to Ask a Question