deletion of multiple occurring files


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting deletion of multiple occurring files
# 8  
Old 10-20-2012
Quote:
Originally Posted by pamu
one small correction..

Code:
sort -nrk5 < file | awk -F_ '!x[$3]++'

With the given input, $3 (when using _ as the field separator) is always 0 in the sample input. I think changing $3 to $2 will yield what emily requested, i.e.,
Code:
sort -nrk5 file | awk -F_ '!x[$2]++'

assuming, of course, that the filenames in the list will always have the same format.
# 9  
Old 10-20-2012
Quote:
Originally Posted by Don Cragun
With the given input, $3 (when using _ as the field separator) is always 0 in the sample input. I think changing $3 to $2 will yield what emily requested, i.e.,
Code:
sort -nrk5 file | awk -F_ '!x[$2]++'

assuming, of course, that the filenames in the list will always have the same format.
As OP's input file

Quote:
Originally Posted by emily
Code:
-rw-r--r-- 1 emily04 us_cms   8 Oct 20 05:07 vgtree_518_0_LHB.root
-rw-r--r-- 1 emily04 us_cms   8 Oct 20 05:08 vgtree_518_0_YTs.root

$3 only give numeric digits on which OP is trying to get desired output...Smilie
# 10  
Old 10-20-2012
Quote:
Originally Posted by pamu
Quote:
Originally Posted by Don Cragun
With the given input, $3 (when using _ as the field separator) is always 0 in the sample input. I think changing $3 to $2 will yield what emily requested, i.e.,
Code:
sort -nrk5 file | awk -F_ '!x[$2]++'

assuming, of course, that the filenames in the list will always have the same format.
As OP's input file
Quote:
Originally Posted by emily
Code:
-rw-r--r-- 1 emily04 us_cms   8 Oct 20 05:07 vgtree_518_0_LHB.root
-rw-r--r-- 1 emily04 us_cms   8 Oct 20 05:08 vgtree_518_0_YTs.root

$3 only give numeric digits on which OP is trying to get desired output...Smilie
Yes. Sorry. I missed the underscore in the group name. Smilie

Note, however, that the input you quoted from emily's original post is not just the output of an ls -l command. In the original post, the input specified was:
Code:
518t-rw-r--r-- 1 emily us_cms 101348458 Oct  8 16:43 vgtree_518_0_LHB.root
518t-rw-r--r-- 1 emily us_cms 101348458 Oct  8 17:04 vgtree_518_0_YTs.root
518t-rw-r--r-- 1 emily us_cms 101348200 Oct  8 17:04 vgtree_518_0_YTg.root
519t-rw-r--r-- 1 emily us_cms 101348900 Oct  8 17:04 vgtree_519_0_YTs.root
520t-rw-r--r-- 1 emily us_cms 101788200 Oct  8 17:04 vgtree_520_0_YTs.root

with no indication of how the 518t, 519t, or 520t was prepended to the ls output. I had originally thought we might be able to find a solution matching on the numeric digits at the start of the line instead of on part of the filename and assuming that the group name would be a constant (or at least always contain an underscore). In a later post, emily listed an input file that just looked like ls -loutput, but the nnnt magically appeared at the front of the output she said she got by running your command on that input. So I'm still not sure what the real format is for input lines and I don't know what we can count on being consistent in the log files to be processed. Oh, well! Smilie
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Three month old specific files deletion

Hi, I need to delete 3 month old files in my logpath. This path contains several logs and other important files The file names are be like this sl_details.env tomcatfiles_03062014.log application_zur_03.062014.log I need to delete only tomcatfiles logs. I wrote this command. can... (7 Replies)
Discussion started by: nag_sathi
7 Replies

2. Debian

Problem with files/dirs deletion

Hi, The other day i installed a PHP based CMS (modx) on my shell account and noticed that i couldn't delete any of files/dirs it created after. Also, i noticed that all that stuff is owned by username-www instead of username. I tried chown, chmod and using a PHP script to do the same wti... (4 Replies)
Discussion started by: pentago
4 Replies

3. UNIX for Dummies Questions & Answers

Periodical Deletion of files and folders

Hi All, how can Periodical Delete files and folders using shell script. I.e after 1 min i want to delete files and folderns from my home directory. Thanks, Arun (9 Replies)
Discussion started by: arun508.gatike
9 Replies

4. Shell Programming and Scripting

Comparison and deletion of lines between two files

Hi i need an help. I have two files list1 and list2, both contains the server names i want to delete the servers in list2 which were also found in list1. for an eg list2 list1 oradg1 oradg4 oradg2 oradg2 oradg3 ... (5 Replies)
Discussion started by: sudharson
5 Replies

5. Shell Programming and Scripting

Files Deletion After 20 Minutes

Hi, everyone. Could you help me with deletion of files, which are 20 minutes old. I found out how to make deletion for files in that way : find <dir> -mtime n -exec rm -rf "{}" Could you offer your suggestions. Many thanks in advance. (5 Replies)
Discussion started by: KReoN
5 Replies

6. Shell Programming and Scripting

Fake deletion of files

Hi, This is possibly an odd request to do with permissions as I seem to have tied myself up with these! I have the following directory (see below) that contains files that the 'usergrp' user needs to be able to 'delete' files from. drwxr-s--- 2 usergrp usergrp 512 16 Feb 14:37... (2 Replies)
Discussion started by: Peejay
2 Replies

7. Shell Programming and Scripting

Multiple Files deletion in perl

Hello Friends, I want to delete all the "*.trg" files in a directory but i don't want to do it by system("rm -r *.trg"); Can i do it thru unlink or by any other mean Thanks, Pulkit (1 Reply)
Discussion started by: pulkit
1 Replies

8. Shell Programming and Scripting

Script for automatic deletion of old files

Hi, I have a folder with limited space. I do not have provisions to increase the space for this folder. So i have to delete files which are more than 1 month old automatically. But, i need to maintain the files created by 4 users and delete all the other files automatically which is more than 1... (4 Replies)
Discussion started by: vivek_scv
4 Replies

9. UNIX for Dummies Questions & Answers

Deletion of log files.

We have log files dating back to 2004. I need to write an interative script that will request the user for how many months he needs to keep the log files and remove all the remaing log files after that month. Supposing we are now in June 2006 , if teh user request to keep log file for the last 3... (1 Reply)
Discussion started by: Geeta
1 Replies

10. Shell Programming and Scripting

Regarding deletion of old files

Hi, I have a list of directories which contain old files that are to be deleted. I put the list of all directories in a txt file and it is being read by a script Iam searching for the files older than 60 days using mtime and then deleting it But all the files are getting deleted... (3 Replies)
Discussion started by: Chidvilas
3 Replies
Login or Register to Ask a Question