Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Recursive folder search faster than find?
Top Forums Shell Programming and Scripting Recursive folder search faster than find? Post 302944111 by Michael Stora on Friday 15th of May 2015 01:57:19 PM
Old 05-15-2015
Recursive folder search faster than find?
I'm trying to find folders created by a propritary data aquisition software with the .aps ending--yes, I have never encountered folder with a suffix before (some files also end in .aps) and sort them by date. I need the whole path

ls -dt "$dataDir"*".aps"does exactly what I want except for the recursion. find "$dataDir" -type d -name '*.aps' does everyting but is excruciatingly slow on windows remote shares. It takes about 45 seconds to find 27 folders. 8 are one subdirectory below $dataDir and one is 2 subdirectories lower. There are a few hundred files and each .aps folder has 7 subfolders with a bunch of files (many called setup.aps which seems to be slowing the find). I know I can get use the printf inside find to get a date column and sort and cut it but it would be even slower.

ls -dt does everything I want except the recursion. the -R option in ls is a completely different animal and does not do the kind of recursion I'm looking for. -1R is sometimes useful but in the above command it does nothing.
Last edited by Michael Stora; 05-15-2015 at 03:10 PM..
 

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

find file with date and recursive search for a text

Hey Guyz I have a requirement something like this.. a part of file name, date of modification of that file and a text is entered as input. like Date : 080206 (MMDDYY format.) filename : hotel_rates text : Jim now the file hotel_rates.ZZZ.123 (creation date is Aug 02 2006) should be... (10 Replies)
Discussion started by: rosh0623
10 Replies

2. UNIX for Dummies Questions & Answers

Zip recursive content of folder when (not current directory=

Hi, Is there a way to zip the content (recursively) of a folder other then the current directory, and keep the directory structure intact? Example: /var/tmp/myfolder ----------------- file1 ----------------- file2 ----------------- folder1 ------------------------ file3 Now I want... (3 Replies)
Discussion started by: jimih
3 Replies

3. UNIX for Dummies Questions & Answers

recursive search and ftp

Could someone help me in recursive search and ftp'ing the files to remote server? The host machine will have /dir1/dira/list_of_files1 /dir1/dirb/list_of_files2 /dir1/dirc/list_of_files3 . . . so., I need to search from dir1 recursively (only one level down) and find all the files that... (1 Reply)
Discussion started by: brahmi
1 Replies

4. UNIX for Advanced & Expert Users

Recursive directory search using ls instead of find

I was working on a shell script and found that the find command took too long, especially when I had to execute it multiple times. After some thought and research I came up with two functions. fileScan() filescan will cd into a directory and perform any operations you would like from within... (8 Replies)
Discussion started by: newreverie
8 Replies

5. UNIX for Advanced & Expert Users

Recursive search for filenames containing ..

Hi all, Since my gopher server doesn't like filenames containing 2 or more consecutive dots in a filename, I'd like to do a search for them and replace them with... well, let's say underscores... I've tried a oneliner or 2 from other posts, but they don't seem to work well with locating dots.... (3 Replies)
Discussion started by: Evert
3 Replies

6. Shell Programming and Scripting

recursive search and copy

Hello again. Well, I need help again sooner as I thought. Now I want to search for files with a known name within all subdirs, and copy the to differently named files in the same directory. For example if I had only one file to copy, I would just usecp fileName newFileNamebut to do this... (1 Reply)
Discussion started by: cabaciucia
1 Replies

7. Shell Programming and Scripting

Faster search needed

Hope you guys out there can help. I have 2 files as below: file 1: 111,222,333,444,555,666 777,888,999,000,111,222 111,222,333,444,555,888 file 2: 666,AAA 222,BBB 888,CCC I want to get the 6th column from file 1 (example, 666) and check in file 2 for the value in the 2nd column... (9 Replies)
Discussion started by: daytripper1021
9 Replies

8. UNIX for Dummies Questions & Answers

Help needed - find command for recursive search

Hi All I have a requirement to find the file that are most latest to be modified in each directory. Can somebody help with the command please? E.g of the problem. The directory A is having sub directory which are having subdirectory an so on. I need a command which will find the... (2 Replies)
Discussion started by: sudeep.id
2 Replies

9. OS X (Apple)

Search recursive

before posting, I have tried to find my answer elsewhere. no luck. I need to find a file buried in a folder somewhere. Master folder has 10 sub folders. each sub folder has folders too. I found this but it does nothing I am on Mac and use Applescript. do shell script "find... (2 Replies)
Discussion started by: sbrady
2 Replies

10. Shell Programming and Scripting

A faster way to read and search

I have a simple script that reads in data from fileA.txt and searches line by line for that data in multiple files (*multfiles.txt). It only prints the data when there is more than 1 instance of it. The problem is that its really slow (3+ hours) to complete the entire process. There are nearly 1500... (10 Replies)
Discussion started by: ncwxpanther
10 Replies

LEARN ABOUT DEBIAN

unseen

NEW(1)								     [nmh-1.5]								    NEW(1)

NAME

       new - report on folders with new messages

       fnext - set current folder to next folder with new messages

       fprev - set current folder to previous folder with new messages

       unseen - scan new messages in all folders with new messages

SYNOPSIS

       new [sequences] [-mode mode] [-folders foldersfile] [-version] [-help]

       fnext is equivalent to new -mode fnext

       fprev is equivalent to new -mode fprev

       unseen is equivalent to new -mode unseen

DESCRIPTION

       New  in	its  default  mode  produces  a  one-line-per-folder  listing of all folders containing messages in the listed sequences or in the
       sequences listed in the profile entry "Unseen-Sequence".  Each line contains the folder, the number of messages in the  desired	sequences,
       and the message lists from the .mh_sequences file.  For example:

	    foo     11.* 40-50
	    bar    380.  760-772 824-828
	     total    391.

       The `*' on foo indicates that it is the current folder.	The last line shows the total number of messages in the desired sequences.

       New crawls the folder hierarchy recursively to find all folders, and prints them in lexicographic order.  Override this behavior by provid-
       ing foldersfile containing the pre-sorted list of folders new should check, one per line.

       In fnext and fprev modes, new instead changes to the next or previous matching folder, respectively.

       In unseen mode, new executes scan sequences for each matching folder.

FILES

       $HOME/.mh_profile	  The user profile

PROFILE COMPONENTS

       Path:		    To determine the user's nmh directory
       Current-Folder:	    To find the default current folder
       Unseen-Sequence:     The name of the unseen message sequence

SEE ALSO

       scan(1), mh-format(5)

HISTORY

       Based on Luke Mewburn's new (http://www.mewburn.net/luke/src/new).

MH.6.8								   11 June 2012 							    NEW(1)
All times are GMT -4. The time now is 01:27 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy