Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Increase the performance of find command.
Top Forums Shell Programming and Scripting Increase the performance of find command. Post 303041925 by mohtashims on Saturday 7th of December 2019 06:52:51 AM
Old 12-07-2019
Increase the performance of find command.
I'm trying to exclude 'BACKUP', 'STORE', 'LOGGER' folders while searching for all files under a directory "/tmp/moht"

Once a file is found I wish to display the filename, the size of the file & the cksum value.

Below is the command, I'm using:

Code:
/opt/freeware/bin/find /tmp/moht -type d -name 'BACKUP' -prune -o -type d -name 'STORE' -prune -o -type d -name 'LOGGER' -prune -o -type f -exec cksum {} \;

Output:
Code:
  701567198 47034 /tmp/moht/UPLOAD_DATA_OLD/WINTER/CORE14_46000.txt
  1165791713 39019 /tmp/moht/UPLOAD_DATA_OLD/CORE14_530000.txt
  3448997243 35258 /tmp/moht/UPLOAD_DATA_OLD/CORE14_487300.txt
  .......
  .......
+ 4294967295 0 /tmp/moht/UPLOAD_DATA_OLD/TEST/CORE14_613500.txt
  2875732103 46516 /tmp/moht/NEW/CORE14_753200.txt
  1525766291 46064 /tmp/moht/UPLOAD_DATA_OLD/CORE14_849300.txt
  2315828286 46532 /tmp/moht/UPLOAD_DATA_OLD/CORE14_902400.txt

Although the performce i.e time taken by the above command is reasonable; I wish to understand if there is any scope of performce improvement.

One thing I guess may help somewhat is:

Code:
cd /tmp/moht; /opt/freeware/bin/find . -type d -name "BACKUP" -prune -o -type d -name "STORE" -prune -o -type f -exec cksum {} \;

I'm on AiX 6.1

Suggestions / recommendations are appreciated.
Last edited by Scrutinizer; 12-07-2019 at 08:33 AM.. Reason: quote tags -> code tags
 

9 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

improve performance by using ls better than find

Hi , i'm searching for files over many Aix servers with rsh command using this request : find /dir1 -name '*.' -exec ls {} \; and then count them with "wc" but i would improve this search because it's too long and replace directly find with ls command but "ls *. " doesn't work. and... (3 Replies)
Discussion started by: Nicol
3 Replies

2. Solaris

What is the command to increase filesystem on solaris

I wanted to know what is the process or command to increase a filesystem on solaris. For example the /tmp directory. (3 Replies)
Discussion started by: strikelit
3 Replies

3. Shell Programming and Scripting

Increase Performance

I have written a code using AWK & sed to compare two files. The structure of the files is like this" Format is this: <bit code> <file code> <string> Follwoed by any numbers of properties lines whic start with a "space" 10101010101111101 XX abcd a AS sasa BS kkk 1110000101010110 XX... (1 Reply)
Discussion started by: sandeep_hi
1 Replies

4. Shell Programming and Scripting

Increase sed performance

I'm using sed to do find and replace. But since the file is huge and i have more than 1000 files to be searched, the script is taking a lot of time. Can somebody help me with a better sed command. Below is the details. Input: 1 1 2 3 3 4 5 5 Here I know the file is sorted. ... (4 Replies)
Discussion started by: gpaulose
4 Replies

5. Shell Programming and Scripting

SLEEP command performance

Hi, I wanted to run a particlar script for every 20 minutes. I dont have crontab in my server. Hence i ran this script in a loop by providing the command sleep 1200 Now i wanted to know is there any performance issue if this job keeps on execute in the server. Thanks, Puni (1 Reply)
Discussion started by: puni
1 Replies

6. Shell Programming and Scripting

Awk : find progressive increase in numbers

NR_037575 -0.155613339079513 -0.952655362767482 -1.42096466949375 -0.797042023687969 -1.26535133041424 -0.468309306726272 NR_037576 0.59124585320226 0.408702582537126 0.888885242203586 -0.182543270665134 0.297639389001326 0.480182659666459... (4 Replies)
Discussion started by: quincyjones
4 Replies

7. Shell Programming and Scripting

Performance issue while using find command

Hi, I have created a shell script for Server Log Automation Process. I have used find xargs grep command to search the string. for Example, find -name | xargs grep "816995225" > test.txt . Here my problem is, We have lot of records and we want to grep the string... (4 Replies)
Discussion started by: nanthagopal
4 Replies

8. Solaris

8 character limit for ipcs command , any way to increase # of chars ?

Hello All, We have a working script which identifies and kills ipcs resources which havent been correctly killed during normal shutdowns. It is working fine and dandy however there are some issues now. Environment: SunOS 5.10 Generic_148888-03 sun4u sparc SUNW,SPARC-Enterprise ... (4 Replies)
Discussion started by: icalderus
4 Replies

9. Shell Programming and Scripting

Increase command length for ksh shell on Redhat Linux

I have a ksh shell script and i need to pass arguments which are generated by data pulled from a database. When the argument to the shell script is too long (about 4000 charecters) the below is the issue observed. I copy the command which is 4000 charecters long from the logs and paste it... (7 Replies)
Discussion started by: mohtashims
7 Replies

LEARN ABOUT DEBIAN

xclip-copyfile

XCLIP-COPYFILE(1)					      General Commands Manual						 XCLIP-COPYFILE(1)

NAME

       xclip-copyfile, xclip-cutfile, xclip-pastefile - copy and move files via the X clipboard

SYNOPSIS

       xclip-copyfile [-p] FILES...

       xclip-cutfile [-p] FILES...

       xclip-pastefile

DESCRIPTION

       xclip-copyfile copies files into the X clipboard, recursing into directories.

       xclip-cutfile copies the files, but also deletes them afterwards.

       -p     preserve path formation

       xclip-pastefile pastes the files out of the clipboard

EXAMPLES

       Copying a file to a remote host

       [maggie.lkpg.cendio.se ~]$ echo "A file created on ${HOSTNAME}" > file1
       [maggie.lkpg.cendio.se ~]$ xclip-copyfile file1
       [sofie.homeip.net ~/doc]$ xclip-pastefile
       file1
       [sofie.homeip.net ~/doc]$ cat file1
       A file created on maggie.lkpg.cendio.se

       Copying an entire tree structure

       [sofie.homeip.net ~]$ xclip-copyfile doc
       [maggie.lkpg.cendio.se ~/tmp]$ xclip-pastefile
       doc/
       doc/letter-mom-april.txt
       doc/file1
       doc/letter-dad-march.txt

       Copying files with preserved path information

       [maggie.lkpg.cendio.se ~]$ xclip-copyfile -p /etc/sysconfig/grub
       tar: Removing leading `/' from member names
       [sofie.homeip.net ~/tmp]$ xclip-pastefile
       etc/sysconfig/grub
       [sofie.homeip.net ~/tmp]$ ls etc/sysconfig/grub
       etc/sysconfig/grub

       Moving files

       [sofie.homeip.net ~]$ ls letter-brother-may.txt
       letter-brother-may.txt
       [sofie.homeip.net ~]$ xclip-cutfile letter-brother-may.txt
       [sofie.homeip.net ~]$ ls letter-brother-may.txt
       ls: cannot access letter-brother-may.txt: No such file or directory
       [sofie.homeip.net ~]$ cd doc
       [sofie.homeip.net ~/doc]$ xclip-pastefile
       letter-brother-may.txt

AUTHORS

       This  manual  page  was written by Maximilian Gass <mxey@cloudconnected.org> for the Debian project. It may be used for everything else, of
       course.

																 XCLIP-COPYFILE(1)
All times are GMT -4. The time now is 03:47 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy