Delete duplicate data and pertain the latest month data.


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Delete duplicate data and pertain the latest month data.
# 8  
Old 04-01-2011
Hi Pravin27
Please can u explain me the logic.
# 9  
Old 04-01-2011
Hi vee_789,

With sort, based on the sample:
Code:
sort -t "$(/bin/echo ",")" -uk10,10 -k10Mr inputfile | sort -t "$(/bin/echo ",")" -uk5,5r
"200","0","","13011","-264","","","","13011","JUL","09"
"200","0","","13011","-263","","","","13011","AGO","09"

Regards
# 10  
Old 04-01-2011
Hi cgkmal, the command isn't working.
# 11  
Old 04-01-2011
Quote:
Originally Posted by vee_789
Hi cgkmal, the command isn't working.
Hi vee_789,

What is the inputfile you are using?

With your last sample:

Code:
"200","0","","13011","-264","","","","13011","JUL","09"
"200","0","","13011","-264","","","","13011","JUL","09"
"200","0","","13011","-264","","","","13011","JUN","09"
"200","0","","13011","-263","","","","13011","JUL","09"
"200","0","","13011","-263","","","","13011","JUL","09"
"200","0","","13011","-263","","","","13011","AUG","09"

and using the code I posted before:
Code:
sort -t "$(/bin/echo ",")" -uk10,10 -k10Mr inputfile | sort -t "$(/bin/echo ",")" -uk5,5r

I get the output you said:
Code:
"200","0","","13011","-264","","","","13011","JUL","09"
"200","0","","13011","-263","","","","13011","AUG","09"


It's desirable a more representative sample to work with and.

Regards
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Take 10 latest line data

Good day for us. I want to ask what is the manner to count total of spesific character or string in 10 latest line. I mean from Latestline - 10 line until Latest line. Example : If the latest line of my file is 455th line, I just want to count total of spesific string from line 446th to 455th.... (5 Replies)
Discussion started by: weslyarfan
5 Replies

2. Shell Programming and Scripting

Help with duplicate column 1 data

Input file Q6GZV8 AY548484>AAT09676.1>YP_031595.1>2947737>CLSP2512393 P0C9E9 AY261366 P0C9K3 AY261361>IPR004848>PF01639 P0C9I4 AY261363>IPR004848 Desired output file Q6GZV8 AY548484 Q6GZV8 AAT09676.1 Q6GZV8 YP_031595.1 Q6GZV8 2947737 Q6GZV8 CLSP2512393 P0C9E9 AY261366... (3 Replies)
Discussion started by: perl_beginner
3 Replies

3. Shell Programming and Scripting

Help with duplicate common data content

Input file: #data_131 0 >content..._* 1 >content..._at_+/97.20% #data_137 0 >content..._* 1 >content..._at_+/97.20% 2 >seq..._* 3 >content..._at_+/97.20% 4 >content..._at_+/97.20% #data_141 0 >content..._* #data_150 0 >content..._* 1 >content..._at_+/97.20% 2 >seq..._* 3... (3 Replies)
Discussion started by: perl_beginner
3 Replies

4. UNIX for Dummies Questions & Answers

Mapping a data in a file and delete line in source file if data does not exist.

Hi Guys, Please help me with my problem here: I have a source file: 1212 23232 343434 ASAS1 4 3212 23232 343434 ASAS2 4 3234 23232 343434 QWQW1 4 1134 23232 343434 QWQW2 4 3212 23232 343434 QWQW3 4 and a mapping... (4 Replies)
Discussion started by: kokoro
4 Replies

5. Linux

How to Keep your core System and personal Data safe while updating to latest distro?

Hi everyone, Almost everything is in the title! Which partitions do you keep? Which partitions do you reformat, while doing a clean install? Personaly, I never format /var and /home partitions when I update to latest linux distribution. It has been working quite ok up to now, but I was... (3 Replies)
Discussion started by: freddie50
3 Replies

6. Web Development

Remove duplicate data in php

helllo there.. I really need your help.. I have my sample program like this.. <?php // db connection $db = "mds_reports"; if($connect = mysql_connect("172.16.8.32", "mds_reports", "password")) $connect = mysql_select_db($db); else... (2 Replies)
Discussion started by: Jeneca
2 Replies

7. Shell Programming and Scripting

How to extract log data based on current date and month ?

Hi Gurus, I'm using HP-UX B.11.23 operating system. I've been trying to extract this log info based on the current date and month, but was having some issues as the date column which on the 4th column has a comma and the 5th column has a dot tied to it. Here is the output from my shut... (5 Replies)
Discussion started by: superHonda123
5 Replies

8. Shell Programming and Scripting

Extract data based on match against one column data from a long list data

My input file: data_5 Ali 422 2.00E-45 102/253 140/253 24 data_3 Abu 202 60.00E-45 12/23 140/23 28 data_1 Ahmad 256 7.00E-45 120/235 140/235 22 data_4 Aman 365 8.00E-45 15/65 140/65 20 data_10 Jones 869 9.00E-45 65/253 140/253 18... (12 Replies)
Discussion started by: patrick87
12 Replies

9. UNIX for Dummies Questions & Answers

To check if the latest version of given GDG base has data

Hi All , I am trying to run a shell script through a JCL . The requirement is I have a gdg base name and I need to create a script that will just check if the latest version of that gdg has data or not . If it doesnt have data RC 4 need to be returned . One more thing which is bothering me is i... (1 Reply)
Discussion started by: mavesum
1 Replies

10. Shell Programming and Scripting

To check if the latest version of given GDG base has data

Hi All , I am trying to run a shell script through a JCL . The requirement is I have a gdg base name and I need to create a script that will just check if the latest version of that gdg has data or not . If it doesnt have data RC 4 need to be returned . One more thing which is bothering me is i... (3 Replies)
Discussion started by: mavesum
3 Replies
Login or Register to Ask a Question