Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Script execution is very slow when trying to find all files and their owners on HP-UX box
Operating Systems HP-UX Script execution is very slow when trying to find all files and their owners on HP-UX box Post 302952187 by Adyan Faruqi on Friday 14th of August 2015 03:48:58 PM
Old 08-14-2015
Script execution is very slow when trying to find all files and their owners on HP-UX box
Hi,

I have a HP-UX server were I need to list all the files in the entire file system, their directory path, last modified date, owner and group. I do not need to search the file contents. I created the script given below and I am excluding directories and files of type tmp, temp and log. The issue I am facing is the script runs very fast for some minutes but slows down and adds only 1 or 2 records per second. Is that normal or can this be expedited by some script tweeking? My server is supposed to have more than 500000 files and with this speed, script execution is taking too much time. I believe since I am not searching the file contents and only fetching the file name and some of its attributes, it should be very fast.

Code:
root_dir="/"

for dir in $(ls -d $root_dir*)
do

	for file in $(find $dir -type d \( -name '*tmp*' -o -name '*temp*' -o -name '*log*' \) -prune  -o -type f \( ! -name '*.log*' ! -name '*.LOG*' ! -name '*temp*' \) -print)
		 do
			last_modified_date=`ls -l $file | awk '{print $6, "", $7, "", $8}'`
			fileowner=`ls -l $file | awk '{print $3}'`
			filegroupowner=`ls -l $file | awk '{print $4}'`
			echo $(hostname),$(basename $file),$(dirname $file),$last_modified_date,$fileowner,$filegroupowner
		 done
done

I tried removing the print option but still the script execution is slow.
Last edited by Adyan Faruqi; 08-14-2015 at 04:51 PM.. Reason: spell check
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Painfully Slow SSH login on Solaris box

Running open solaris on a e420 that I recently picked up. Having issues sshing to it from either of my Linux boxes as its very slow to login (from the solaris box to the linux box it connects just fine. Here is the output of ssh -vvv. I have hightlighted where it seems the slowdown is. Does... (0 Replies)
Discussion started by: creedog
0 Replies

2. UNIX for Advanced & Expert Users

Access files from prev box after SSH to another box

i'm not much of an advanced unix programmer but I'm trying to write a script to access files on box1 after ssh from box 1 to box2. when ssh is invoked in the script i'm getting logged into box2 and losing complete touch with box1 which is normal i guess. but my main aim with my script is when i... (3 Replies)
Discussion started by: pharos467
3 Replies

3. Shell Programming and Scripting

Command/script to find size of Unix Box ?

Please could anyone provide me the Command/script to find the size and usage of Unix box ASAP ? (6 Replies)
Discussion started by: sakthifire
6 Replies

4. UNIX for Advanced & Expert Users

why will a unix box become slow... ???

Hi ! Can somebody tell me why -or- when will a unix box will become slow in processing .... where to go and chk the stats... for this ??? Pls help.. Thanks in advance... (2 Replies)
Discussion started by: dashok.83
2 Replies

5. Shell Programming and Scripting

slow command execution?

Dear World, I just wrote a script, which puzzled me somewhat. The siginficant code was: for file in `ls splits*`; # splits* came from a split command executed earlier do tail -$SomeNumber $file | cut -d" " -f6 > $file; done; The interesting thing is this: A few of the $files were... (2 Replies)
Discussion started by: BandGap
2 Replies

6. Shell Programming and Scripting

Slow Script Execution.

Basically my requirement is to know the total number of free anonymous ports. anonymous port range is 32768- 65535. i wrote a script for that ********************************************** for i in {32768..65535} do netstat -an | grep $i > /dev/null if ... (21 Replies)
Discussion started by: mohtashims
21 Replies

7. Shell Programming and Scripting

Find only files/directories with different permissions/owners

My git post-update has the following lines in it to make sure the permissions are set right: find /usr/local/apache/htdocs -type d -print0 | xargs -0 chmod 755 find /usr/local/apache/htdocs -type f -print0 | xargs -0 chmod 644 chown -R apache:apache /usr/local/apache/htdocsThe only problem is... (5 Replies)
Discussion started by: dheian
5 Replies

8. Shell Programming and Scripting

Find execution time of script

i am using bash START=$(date +%s) END=$(date +%s) DIFF=$(echo "$END - $START" ) this code is not working (14 Replies)
Discussion started by: rafa_fed2
14 Replies

9. UNIX for Dummies Questions & Answers

Awk/script to list the owners of files

I have to list the files in a directory and along with that, list the owner of each of those files. Can someone please help me with a way to get this info please? Gayathri (2 Replies)
Discussion started by: ggayathri
2 Replies

10. Shell Programming and Scripting

Improve script - slow process with big files

Gents, Please can u help me to improve this script to be more faster, it works perfectly but for big files take a lot time to end the job.. I see the problem is in the step (while) and in this part the script takes a lot time.. Please if you can find a best way to do will be great. ... (13 Replies)
Discussion started by: jiam912
13 Replies

LEARN ABOUT DEBIAN

dpns-chown

DPNS-CHOWN(1)							DPNS User Commands						     DPNS-CHOWN(1)

NAME

       dpns-chown - change owner and group of a DPNS directory/file in the name server

SYNOPSIS

       dpns-chown [-h] [-R] owner[:group] path...

       dpns-chown [-h] [-R] :group path...

DESCRIPTION

       dpns-chown sets the owner and/or the group of a DPNS directory/file in the name server to the values in owner and group respectively.

       To change the owner ID, if the group ID does not change and if the caller and the new owner ID belong to that group, GRP_ADMIN privilege is
       needed, otherwise the caller must have ADMIN privilege in the Cupv database.  To change the group ID, the effective user ID of the  process
       must  match  the  owner	ID  of the file and the new group must be in the list of groups the caller belong to or the caller must have ADMIN
       privilege in the Cupv database.

       owner  is either a valid username or a valid numeric ID.

       group  is either a valid group name or a valid numeric ID.

       path   specifies the DPNS pathname.  If path does not start with /, it is prefixed by the content of the DPNS_HOME environment variable.

OPTIONS

       The following options are supported:

       -h     If path is a symbolic link, changes the ownership of the link itself.

       -R     Recursive mode.

EXIT STATUS

       This program returns 0 if the operation was successful or >0 if the operation failed.

SEE ALSO

       Castor_limits(4), dpns_chown(3), Cupvlist(1)

AUTHOR

       LCG Grid Deployment Team

DPNS
							   $Date: 2007/01/15 08:05:17 $ 					     DPNS-CHOWN(1)
All times are GMT -4. The time now is 05:03 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy