Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Need to delete large set of files (i.e) close to 100K from a directory based on the input file
Top Forums Shell Programming and Scripting Need to delete large set of files (i.e) close to 100K from a directory based on the input file Post 302689561 by prash358 on Wednesday 22nd of August 2012 11:41:42 AM
Old 08-22-2012
Quote:
Originally Posted by Corona688
Odd. I think that's supposed to be valid syntax, but Solaris does have a really old and noncompliant shell...

Try putting the ! inside the [ ]

Code:
if [ ! -f $LIST ]

Thank you for the quick response. It worked like a GEM!!Smilie

---------- Post updated 08-22-12 at 10:41 AM ---------- Previous update was 08-21-12 at 03:02 PM ----------

Quote:
Originally Posted by prash358
Thank you for the quick response. It worked like a GEM!!Smilie
I have a similar type of files that needs to be removed from the below directory and sub-directory

Code:
cd /photos

find . -name "*12345678*" -ls
156040   58 -rw-r--r--   1 nobody   nobody      58389 Jul 27  2011 ./12345678.jpg
703506    2 -rw-r--r--   1 nobody   nobody       1309 Jul 27  2011 ./thumbnail/12345678-tn.jpg

So by providing the unique content in both files into a input file (i.e) 12345678 , how can we add a line to this script to take care of this operation. There are more than 100k records in the photos directory and as well as thumbnail directory which is the sub directory under photos.

Bottom line i only want to provide 8 digit number and that should delete the files under photos directory and its sub directory (i.e) thumbnails


Thanks
Last edited by Franklin52; 08-23-2012 at 04:39 AM.. Reason: Please use code tags for data and code samples
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

i want to delete a file based on existing file in a directory

hi i am having four files in a directory.like 1)sampleRej 2)exampleRej 3)samplemain 4)examplemain my requirement is i have to search for the rejected files (sampleRej,exampleRej) in a directory.if these files in that directory then i have to delete the main files... (3 Replies)
Discussion started by: srivsn
3 Replies

2. Shell Programming and Scripting

Sheel script to Delete a set of files from a given directory

I have a file <filestodelete> containing names of files to to be deleted from a directory <filesstore>. I want a script file which accptes the <filestodelete> and also the location of the directory(<filestore>) and deletes all files matching. Thanks in Advance.. (3 Replies)
Discussion started by: VardhiniVenkat
3 Replies

3. Shell Programming and Scripting

Split a file into multiple files based on the input pattern

I have a file with lines something like. ...... 123_start ...... ....... 123_end .... ..... 456_start ...... ..... 456_end .... ..... 789_start .... .... 789_end (6 Replies)
Discussion started by: abinash
6 Replies

4. Shell Programming and Scripting

Splitting large file into multiple files in unix based on pattern

I need to write a shell script for below scenario My input file has data in format: qwerty0101TWE 12345 01022005 01022005 datainala alanfernanded 26 qwerty0101mXZ 12349 01022005 06022008 datainalb johngalilo 28 qwerty0101TWE 12342 01022005 07022009 datainalc hitalbert 43 qwerty0101CFG 12345... (19 Replies)
Discussion started by: jimmy12
19 Replies

5. Shell Programming and Scripting

Script to delete files with an input for directories and an input for path/file

Hello, I'm trying to figure out how best to approach this script, and I have very little experience, so I could use all the help I can get. :wall: I regularly need to delete files from many directories. A file with the same name may exist any number of times in different subdirectories.... (3 Replies)
Discussion started by: *ShadowCat*
3 Replies

6. Shell Programming and Scripting

Help needed - Split large file into smaller files based on pattern match

Help needed urgently please. I have a large file - a few hundred thousand lines. Sample CP START ACCOUNT 1234556 name 1 CP END ACCOUNT CP START ACCOUNT 2224444 name 1 CP END ACCOUNT CP START ACCOUNT 333344444 name 1 CP END ACCOUNT I need to split this file each time "CP START... (7 Replies)
Discussion started by: frustrated1
7 Replies

7. Shell Programming and Scripting

Sed: Splitting A large File into smaller files based on recursive Regular Expression match

I will simplify the explaination a bit, I need to parse through a 87m file - I have a single text file in the form of : <NAME>house........ SOMETEXT SOMETEXT SOMETEXT . . . . </script> MORETEXT MORETEXT . . . (6 Replies)
Discussion started by: sumguy
6 Replies

8. Shell Programming and Scripting

Script needed to delete to the list of files in a directory based on last created & delete them

Hi My directory structure is as below. dir1, dir2, dir3 I have the list of files to be deleted in the below path as below. /staging/retain_for_2years/Cleanup/log $ ls -lrt total 0 drwxr-xr-x 2 nobody nobody 256 Mar 01 16:15 01-MAR-2015_SPDBS2 drwxr-xr-x 2 root ... (2 Replies)
Discussion started by: prasadn
2 Replies

9. Shell Programming and Scripting

If no input then set directory to current

Hi GUys I have a script where i am counting the number of files that the user has read permissions to in a folder . They are asked for this folder at the start if they dont enter anything then i want to be able to do the search on the current directory, can you help me with that part please... (25 Replies)
Discussion started by: johnnybananas
25 Replies

10. Shell Programming and Scripting

Script to compare files in 2 folders and delete the large file

Hello, my first thread here. I've been searching and fiddling around for about a week and I cannot find a solution.:confused: I have been converting all of my home videos to HEVC and sometimes the files end up smaller and sometimes they don't. I am currently comparing all the video files... (5 Replies)
Discussion started by: Josh52180
5 Replies

LEARN ABOUT DEBIAN

pilot-foto

pilot-foto(1)							    PILOT-LINK							     pilot-foto(1)

NAME

       pilot-foto - Palm 'Foto' Image Installer/Remover/Fetcher/Converter

SECTION

       pilot-link: Userland conduits

SYNOPSIS

	pilot-foto  [-p|--port	<port>]  [--version]  [-?|--help]  [-q|--quiet]  [--usage] [-d|--delete] [--delete-all] [-i|--install] [-l|--list]
       [-f|--fetch] [-F|--fetch-all] [-c|--convert]

DESCRIPTION

       This is a palm conduit to fetch, install, or remove, Foto files from a Palm. It can also convert *.jpg.pdb files  that  have  already  been
       fetched from the Palm to jpeg files.

       Delete all, or named fotos from handheld.

       Install one, or many jpeg images to handheld.

       List all jpeg files and thumbnails on handheld.

       Fetch all jpeg files, or certain ones by name.

       Tries to detect if a file really is a jpeg and refuses to install it, if it is not.

       pilot-foto allows you to do multiple operations in one sync. For instance, delete test.jpg and install test.jpg.

USAGE

       pilot-foto -p <port> [options] file

OPTIONS

   pilot-foto options
			       -d, --delete

       Delete a jpg file on the handheld

			       --delete-all

       Delete ALL jpg files on the handheld

			       -i, --install

       Install a jpg file

			       -l, --list

       List all photos and thumbnails

			       -f, --fetch

       Fetch files from the Palm

			       -F, --fetch-all

       Fetch ALL jpg files from the Palm

			       -c, --convert

       convert [file].jpg.pdb files to jpg

   Conduit Options
			       -p,
			       --port port

       Use  device  file port to communicate with the Palm handheld. If this is not specified, pilot-foto will look for the $PILOTPORT environment
       variable. If neither are found or supplied,  pilot-foto	will print the usage information.

			       -q,
			       --quiet

       Suppress 'Hit HotSync button' message

			       -v, --version

       Display version of pilot-foto and exit without connecting.

   Help Options
			       -h, --help

       Display the help synopsis for pilot-foto and exit without connecting.

			       --usage

       Display a brief usage message and exit without connecting.

EXAMPLES

		   Examples:
		   pilot-foto -p /dev/pilot -f pilot-foto -d MyImage.jpg
		   pilot-foto -i MyImage.jpg
		   pilot-foto -i *.jpg
		   pilot-foto -f MyImage
		   pilot-foto -c MyImage.jpg.pdb

PROBLEMS

       Palm has not published their database format for the thumbnails. So, pilot-foto puts a generic penguin thumbnail for every image  uploaded.
       Fotos can be accessed by a named list on the handheld as well as the thumbnails. This has been tried on a couple of handhelds. It is possi-
       ble that a foreign palm or different model will not like it.

       To get a thumbnail image you can copy the jpegs to the memory card. If you copy them back to the handheld they will have  a  new  thumbnail
       that matches the jpeg.

AUTHOR

       This manual page was converted to XML by Neil Williams <linux@codehelp.co.uk>

BUGS

       If  a  jpeg  is	installed with the same name as one already on the palm you will have 2 thumbnails pointing to the same jpeg. The new jpeg
       will overwrite the old jpeg.

       If the thumbnail fails to install then the jpeg should be removed. It is not.

       We have an online bug tracker. Using this is the only way to ensure that your bugs are recorded and that we can track them until  they  are
       resolved  or  closed.  Reporting  bugs  via  email, while easy, is not very useful in terms of accountability. Please point your browser to
       http://bugs.pilot-link.org: http://bugs.pilot-link.org and report your bugs and issues there.

COPYRIGHT

       This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as  published	by
       the Free Software Foundation; either version 2 of the License, or (at your option) any later version.

       This  program  is  distributed  in  the	hope  that  it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MER-
       CHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

       You should have received a copy of the GNU General Public License along with this program; if not, write to the Free  Software  Foundation,
       Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301, USA.

SEE ALSO

	pilot-link(7)

0.12.5							      Copyright 1996-2007 FSF						     pilot-foto(1)
All times are GMT -4. The time now is 12:48 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy