nawk - file limits


Login or Register for Dates, Times and to Reply

 
Thread Tools Search this Thread
# 1  
nawk - file limits

Hi,
I want to search particular pattern and splitting the file in to multiple files. (Splitted files may be more than 150). It got splitted upto 20 files after that, I got some error.
nawk: filename.21 makes too many open files.
input record number 654, file xxxxxxx

Can u guide me to fix thie issue.
# 2  
After each write to a certain output file, you simply have to close the output file before writing to the next file. Otherwise, you will encounter the limit you said. For example:

Code:
echo | nawk '{
   print("test1") > "file1";
   close("file1");

   print("test2") > "file2";
   close("file2");

   print("test3") > "file3";
   close("file3");

   .....

   print("testN") > "fileN";
   close("fileN");
}'

Login or Register for Dates, Times and to Reply

Previous Thread | Next Thread
Thread Tools Search this Thread
Search this Thread:
Advanced Search

Test Your Knowledge in Computers #657
Difficulty: Easy
The last retail version of MS-DOS was MS-DOS 7.
True or False?

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Soft and hard limits for nproc value in /etc/security/limits.conf file (Linux )

OS version : RHEL 6.5 Below is an excerpt from /etc/security/limits.conf file for OS User named appusr in our server appusr soft nproc 2047 appusr hard nproc 16384 What will happen if appusr has already spawned 2047 processes and wants to spawn 2048th process ? I just want to know... (3 Replies)
Discussion started by: kraljic
3 Replies

2. Shell Programming and Scripting

Nawk Problem - nawk out of space in tostring on

Hi.. i am running nawk scripts on solaris system to get records of file1 not in file2 and find duplicate records in a while with the following scripts -compare nawk 'NR==FNR{a++;next;} !a {print"line"FNR $0}' file1 file2duplicate - nawk '{a++}END{for(i in a){if(a-1)print i,a}}' file1in the middle... (12 Replies)
Discussion started by: Abhiraj Singh
12 Replies

3. Linux

Determining Values for NIce and Priority items in limits.conf file

I've been looking online trying to find the correct value nice and priority can take in the limits.conf file. ON the man page it says; Does this mean priority can be any negative number and any positive? Then Does this mean any number between -20 and 19 also what does the definition of nice... (13 Replies)
Discussion started by: matthewfs
13 Replies

4. Shell Programming and Scripting

file manipulation using nawk

Legends, I have two files (f1, f2) with below output. file f1 contains: TSCparser14 irons1 1 NORD_BALT_02 -- 0 gaps (0 missing messages), 0 seq no resets TSCparser15 irons1 1 NORD_BALT_05 -- 0 gaps (0 missing messages), 0 seq no resets TSCparser21 irons1 ... (11 Replies)
Discussion started by: sdosanjh
11 Replies

5. HP-UX

HP-UX 10.20 file size limits?

Hi, I'm running HP-UX 10.20. Is there a 2GB file size limit? if so, can i change it? (3 Replies)
Discussion started by: gabriel.560
3 Replies

6. UNIX Desktop Questions & Answers

File size limits

I want to increase the file size, I am trying to store the output but it's not storing the whole output in to the file (7 Replies)
Discussion started by: navintsm
7 Replies

7. Shell Programming and Scripting

Limits of FOR loop to go to end of File

Hi ALL:), I have a file for e.g. ajdflkj|dkj|djfj|go|123|4||||||||||||||89|101||||||||||||||| The length of file is not fixed. So wat the limits should be given in for loop to access till end of file???? Thanks in advance..... (2 Replies)
Discussion started by: rohiiit.sharma
2 Replies

8. UNIX for Dummies Questions & Answers

ulimit and /etc/security/limits file permission

Hi there, I am working on AIX and i dont have permission for /etc/security/limits file. In the man page of ulimit it is mentioned that it will get the limitations for me from /etc/security/limits file. the file permission for ulimit command is -r-xr-xr-x 15 bin bin ... (6 Replies)
Discussion started by: quintet
6 Replies

9. UNIX for Dummies Questions & Answers

file number limits in Solaris 8

What is the kernel parameter ( or other) that sets the maximum number of open files by the o/s (3 Replies)
Discussion started by: blp001
3 Replies

10. UNIX for Dummies Questions & Answers

File Limits on Solaris 2.6

%ulimit -a nofiles(descriptors) 1024 This means that I can open up to 1024 file per process? But wonder if there is any hardlimit imposed by Solaris 2.6 (eg 255) ? By the way, is there any tool that can trace which files (or sockets) are opened by a process? Thanks DY (5 Replies)
Discussion started by: deaniyoer
5 Replies

Featured Tech Videos