Fork resource unavailable error, max # filehandles open?


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Fork resource unavailable error, max # filehandles open?
# 1  
Old 02-25-2013
Fork resource unavailable error, max # filehandles open?

I wrote a perl program that simultaneously reads in data from 691 tar.gz files using zcat. I can run one instance of the program without any issues and the memory and swap sizes are negligible. However, when I attempt to run more than 1 I start to get fork: resource unavailable messages. Are there too many programs running? Am I maxed out on the number of open file handles? Other?

Thanks for any advice.
# 2  
Old 02-25-2013
No, max filehandles limit is per process.
But max processes limit is per user.
Check in bash with ulimit -a.
This User Gave Thanks to MadeInGermany For This Post:
# 3  
Old 02-25-2013
If it were out of file handles, it'd be complaining about open, not fork.

Perhaps there's a perl module you can use, instead of creating thousands of individual separate zcat processes? Or just give tar the -z flag instead of using zcat?
# 4  
Old 02-25-2013
max user processes (-u) 1024

----


so I assume I'm hitting this limit with all the zcat processes. Is that correct?
# 5  
Old 02-25-2013
Probably all the tar ones, too,
# 6  
Old 02-25-2013
I initially tried using the Perl::Gzip module (or something like that), but it was problematic for reasons that I no longer recall.
# 7  
Old 02-25-2013
Yes, and a big thanks to your system admin or OS vendor for putting this limit.
You are trying to employ 691 CPU cores, that means the system load jumps to 691 / CPUcores.
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Fork: Resource temporarily unavailable

Hi friends, Working on a linux X86-64 bit system, I suddenly started getting this error (mentioned in subject) from various scripts. I googled, found that there are couple of reason which causes this issue. - less memory I am pretty sure, memory seems to be stable on my system and at the... (15 Replies)
Discussion started by: clx
15 Replies

2. Programming

[ERROR:Resource temporarily unavailable!] Serial writing by termios library

Hello, I am using the termios library to write data that I get from a Bluetooth device to a modem via serial. The data arrive from the Bluetooth device correctly every 50ms and I have to bypass them on the serial ttyUSB3 where it is connected to a modem connected to a socket with static IP. The... (10 Replies)
Discussion started by: enaud
10 Replies

3. UNIX for Dummies Questions & Answers

Fork: Resource Temporarily Unavailable

I wrote a script that works most of the time but gave me fork: resource temporarily unavailable some of the time. I restarted my computer and now it runs fine but googling "fork: resource temporarily unavailable" and looking on the forums has not actually helped me figure out what exactly I... (3 Replies)
Discussion started by: monstrousturtle
3 Replies

4. UNIX for Advanced & Expert Users

fork: Resource temporarily unavailable , server unexpectedly unavailable network connection

Solaris 10 Server refuse to connect :wall: fork: Resource temporarily unavailable , server unexpectedly unavailable network connection , refuse error, disconnect message, fatal error type2, (protocol error type2) Issue has been resolved after taken few steps :b: First of all need to check... (1 Reply)
Discussion started by: taherahmed
1 Replies

5. Red Hat

cannot set user id: Resource temporarily unavailable (not open file/open process related)

First post, sorry to be a bother but this one has been dogging me. I have a process user (java application server) that trips a resource limit every couple weeks and need help finding what limit we're hitting. First, this is what's running: This is the error when jobs are run or the... (0 Replies)
Discussion started by: Katahdin
0 Replies

6. UNIX for Dummies Questions & Answers

Resource temporarily unavailable Error In Socket

Hi, Now I am programming to communicate with some network printer through TCP Socket program.By sending command "\033E 1\r" to printer,causes, check the port for error normally. In my case i used following code bytesSent = send( sockfd, "\033E 1\r",sizeof("\033E 1\r"), 0); ... (1 Reply)
Discussion started by: kavinsivakumar
1 Replies

7. UNIX for Dummies Questions & Answers

error message when use fork with open file

I get this message when I write myshell.c program "VM pagefault:SIGSEGV bad add 0x0 err 0x4 nopage read myshell PM: ciredump signal 11 for 1725 /myshell memory fault (core dumped)" /* RCS information: $Id: myshell.c,v 1.2 2006/04/05 22:46:33 elm Exp $ */ #include <stdio.h> #include <unistd.h>... (1 Reply)
Discussion started by: rosecomp
1 Replies

8. Solaris

Mmap with fork : Resource unavaialable temporarily

installed 64bit 16GB VM on 64bit ESX server. Written small C code to map the 2GB of memory by mmap after creating 3 child and map getting failed by throwing "resource unavailable temporarily" after mapping 1.6 GB of memory out of 2GB. But same 1.5Gb memory mapping works fine. I checked... (0 Replies)
Discussion started by: siddharoodh
0 Replies

9. UNIX for Advanced & Expert Users

Fork:resource unavailable

Hello. I have code which create processes with fork(). I set a limit for processes by typing ulimit -u 20. Then I run my code who should create 100 processes. Unfortunately, I have a mistake there and I forgot to quit all of my forked processes when fork gave me return value -1. So I am trapped in... (5 Replies)
Discussion started by: samos
5 Replies

10. Solaris

fork: Resource temporarily unavailable - What can I check ?

Hi everybody, I have an Unix box running Solaris and every day for 1 hour or 2 the box is stuck and I can only get this error message when trying to type a command : bash-3.00$ vmstat 5 bash: fork: Resource temporarily unavailable How can I trace what's is going wrong with this box ?... (5 Replies)
Discussion started by: unclefab
5 Replies
Login or Register to Ask a Question