Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Assistance pls - pipe error: Too many open files in system
Top Forums Shell Programming and Scripting Assistance pls - pipe error: Too many open files in system Post 302399622 by vidhyamirra on Monday 1st of March 2010 04:29:27 AM
Old 03-01-2010
script scans all the files in a specific directory and checks whether they are unzippable. all the monitoring information like how many files are scanned /corrupted are logged in a log file. I dint get any problem when I tested in my lab.

---------- Post updated at 02:59 PM ---------- Previous update was at 02:54 PM ----------

this is my code

Code:
for i in /store/archive/TP_* ; do
# Checks for the errors in compressed bitfiles.
      for j in `find $i -name "L2*" -type d`; do
           n=$(( n + $(find $j -type f | wc -l) ))
            unzip -qT $j/\* 2>>/dev/null;
                if [ $? -ne 0 ]; then
                     for k in `find $j -type f`; do
                               unzip -qT $k 2>>/dev/null;
                               if [ $? -ne 0 ]; then
                                       echo `date -r $k` $k >> $bfile;
                                     corruptedBitfiles=`expr $corruptedBitfiles + 1`;
                               fi
                                # Counting bitfiles in each subdirectory
                                bitfileCounter=`expr $bitfileCounter + 1`;
     # Keeping track of the progress of every 5k files in each sub-directory
    let batchCount=$bitfileCounter%$increment
    if [ $bitfileCounter -ge $increment -a $batchCount -eq 0 ]; then
    fi
   done
   bitfileCounter=0;
   corruptedTPDirCount=`expr $corruptedTPDirCount + $corruptedBitfiles`;
   corruptedBitfiles=0;
   fi
#Summing up the count of all sub-directories under main TP directory
  tpDirCount=`expr $tpDirCount + $n`;
  n=0;
  done
  tpDirCount=0;
  corruptedTPDirCount=0;

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Assistance with regex and config files

I am trying to write a shell script that will such in data from a config file. The script should mount device nodes that are contained in a config file in the following format: # filesystem type # read/write #device # Mount Point xfs w ... (1 Reply)
Discussion started by: pryker
1 Replies

2. Programming

Is there a system call other than 'open' for opening very large files?

Dear all, Inside a C program, I want to open a very big file (about 12 GB) in order to read its content. Here is the code: /* argv contains the path to the file. */ inputFileDescriptor = open(argv, O_RDONLY); if (inputFileDescriptor < 0) { ... (6 Replies)
Discussion started by: dariyoosh
6 Replies

3. Shell Programming and Scripting

C, sh, perl, system(): Can't transfer a return code appropriately: help, pls

I am using a perl-script from C-code, executing it by the 'system(..)' comand. The problem is to return the perl-return code to the C correctly. Default the 'system()' shell is Bourne: sh My try: (perl_src.c_pl - the perl script; t_sys - C-program with system() call (I will show it... (7 Replies)
Discussion started by: alex_5161
7 Replies

4. Shell Programming and Scripting

Need Assistance with gzipping files with same names

Hello, I have an issue on a webserver where I have a perl script rotating and moving the logs to an archive directory where they are gzipped. This is working fine. The problem is when there is tracing enabled on my webserver where the tracelogs are rotated whenenver they reach 100Meg and they... (2 Replies)
Discussion started by: techwiz45
2 Replies

5. Shell Programming and Scripting

Assistance for sorting files

Hi there, I have tried using the "find" command to do this but to no avail as the "find -mtime" command I used descend to the directories from my current working directory. Say in "directoryA" has multiple files and those files are created on a daily basis. Under "directoryB", there are... (4 Replies)
Discussion started by: chewku
4 Replies

6. Shell Programming and Scripting

Cannot make pipe for process substitution: Too many open files

Hi, I've came across an issue with a script I've been writing to check DHCP addresses on an Solaris system, the script has been running reasonably well, until it hit the following problem: ./sub_mon_v2: redirection error: cannot duplicate fd: Too many open files ./sub_mon_v2: cannot make... (3 Replies)
Discussion started by: CiCa
3 Replies

7. Shell Programming and Scripting

Capture output of open pipe to a file in perl

Hi, I am trying to capture the output of the an open pipe in perl. but I am not sure how to do this. can some one please help me do that? Below is the script I am using (2 Replies)
Discussion started by: ahmedwaseem2000
2 Replies

8. UNIX for Dummies Questions & Answers

Error when using vim to open files

Hi all, 1st post here. I'm on Solaris and currently, I get the following error if I try to use vim to edit anything: Error detected while processing function <SNR>6_initialize: line 2: E697: Missing end of List ']': E116: Invalid arguments for function <SNR>6_defineOption line 3: E10:... (6 Replies)
Discussion started by: fred2028
6 Replies

9. Shell Programming and Scripting

How can we overcome Broken pipe error during scp,SFTP,Rsync while transferring big files.?

Hello All, Hope all are doing well. We use scp (some times sftp and rsync also) for transferring big files (around 2GB each ) from 1 Network to another Network. The Issues which we face :- During transfer some times( Once in 1 week (or twice)) , the speed of transfer gets down to 30 kb/s,... (2 Replies)
Discussion started by: Upendra Bhushan
2 Replies

10. UNIX for Beginners Questions & Answers

awk assistance - Comparing 2 csv files

Hello all, I have searched high and low for a solution to this, many have come really close but not quite what I'm after. I have 2 files. One contains GUID's, for example: 8121E002-96FE-4C9C-BC5A-6AFF20DACECD 84468F30-F3B7-418B-81F0-0908E80792BF A second file, contains a path to the... (8 Replies)
Discussion started by: tirmUK
8 Replies

LEARN ABOUT OSF1

uudemon

uudemon(4)						     Kernel Interfaces Manual							uudemon(4)

NAME

       uudemon.admin,  uudemon.cleanu,	uudemon.hour,  uudemon.poll  -	Administrative shell scripts for polling remote systems, cleaning up spool
       directories, reporting status to the system administrator, and routine invocations of the uuxqt and uusched daemons

SYNOPSIS

       These shell scripts reside in the following directory:
	  /usr/lib/uucp

DESCRIPTION

       All the scripts can be run from the command line or can be run automatically by the cron daemon. To automatically run the  scripts,  remove
       the comment character (#) from the beginning of the relevant line in the /var/spool/cron/crontabs/uucp file.

       This  script  reports  status  to  the system administrator. It issues the uustat command to find out the status of uucp jobs. It mails the
       results to the uucp login ID. The script may be modified to send mail to any login ID such as the uucp administrative login ID  (uucpa)	or
       root.  This script cleans up the /var/spool/uucp and /var/spool/uucppublic directories by running the uucleanup command. The uucleanup com-
       mand is run with the following parameters: -C7, -D7, X2, -o2, -W1.  This script runs the uusched and uuxqt daemons in the background.  This
       script  polls  the  systems  listed  in	the  /usr/lib/uucp/Poll file.  The uudemon.poll script should be scheduled before the uudemon.hour
       script. This allows uudemon.poll to create any command files before cron runs the uudemon.hour script.

FILES

       Contains the uudemon.admin, uudemon.cleanu, uudemon.hour and uudemon.poll files.  Contains the uucp file.

RELATED INFORMATION

       Commands: cron(8), uucleanup(8), uusched(8), uuxqt(1)

       Files: /usr/lib/uucp delim off

																	uudemon(4)
All times are GMT -4. The time now is 10:10 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy