Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Applying the same awk over a directory of files with individual file output
Top Forums Shell Programming and Scripting Applying the same awk over a directory of files with individual file output Post 302959999 by owwow14 on Monday 9th of November 2015 10:32:19 AM
Old 11-09-2015
Hi again, R. Singh,

It seems to be working better, except I keep getting the error
Code:
"awk: cannot open "file1021.pp" for output (Too many open files)
"

I tried to modify the one-liner as follows to make sure that the files were closed:
See here:

Code:
awk '{print $1 OFS $2 >> "file"++i".pp";close("file"++i".pp")}' FS="\t" OFS="\t" *

However, I am still getting the same error, just with a file with a higher N, i.e.
Code:
awk: cannot open "file2041.pp" for output (Too many open files)

Any ideas where the leak is coming from?
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Applying diff output to create new script

I believe I read somewhere that you can do a diff of two ksh scripts and use the output to create a new script with the differences. :p Could someone please show me the command(s) I'd need to use to get this accomplished? Or perhaps point me to a thread that explains this in detail. Thanks... (1 Reply)
Discussion started by: BCarlson
1 Replies

2. Shell Programming and Scripting

batch shell script to zip individual files in directory - help

help trying to figure out a batch shell script to zip each file in a directory into its own zip file using this code but it does not work tryed this also nothing seems to work , just ends without zipping any files i have over 3000 files i need to zip up individualy ... (7 Replies)
Discussion started by: wingchun22
7 Replies

3. AIX

missing blank spaces while cutting the file to individual files

$ indicates blank space file1.txt: 001_AHaris$$$$$020$$$$$$$$$ 001_ATony$$$$$$030$$$$$$$$$ 002_AChris$$$$$090$$$$$$$$$ 002_ASmit$$$$$$060$$$$$$$$$ 003_AJhon$$$$$$001$$$$$$$$$ $ indicates blank space code while read "LINE"; do echo "$LINE" | cut -c6- >> $(echo "$LINE" | cut... (1 Reply)
Discussion started by: techmoris
1 Replies

4. Shell Programming and Scripting

Apply 'awk' to all files in a directory or individual files from a command line

Hi All, I am using the awk command to replace ',' by '\t' (tabs) in a csv file. I would like to apply this to all .csv files in a directory and create .txt files with the tabs. How would I do this in a script? I have the following script called "csvtabs": awk 'BEGIN { FS... (4 Replies)
Discussion started by: ScKaSx
4 Replies

5. Shell Programming and Scripting

Splitting a file in to multiple files and passing each individual file to a command

I have an input file with contents like: MainFile.dat: 12247689|7896|77698080 16768900|hh78|78959390 12247689|7896|77698080 16768900|hh78|78959390 12247689|7896|77698080 16768900|hh78|78959390 12247689|7896|77698080 16768900|hh78|78959390 12247689|7896|77698080 16768900|hh78|78959390 ... (4 Replies)
Discussion started by: rkrish
4 Replies

6. Shell Programming and Scripting

awk command to compare a file with set of files in a directory using 'awk'

Hi, I have a situation to compare one file, say file1.txt with a set of files in directory.The directory contains more than 100 files. To be more precise, the requirement is to compare the first field of file1.txt with the first field in all the files in the directory.The files in the... (10 Replies)
Discussion started by: anandek
10 Replies

7. Shell Programming and Scripting

Awk based script to find the median of all individual columns in a data file

Hi All, I have some data like below. Step1,Param1,Param2,Param3 1,2,3,4 2,3,4,5 2,4,5,6 3,0,1,2 3,0,0,0 3,2,1,3 ........ so on Where I need to find the median(arithmetic) of each column from Param1...to..Param3 for each set of Step1 values. (Sort each specific column, if the... (5 Replies)
Discussion started by: ks_reddy
5 Replies

8. Shell Programming and Scripting

Grep multiple terms and output to individual files

Hi all, I'll like to search a list of tems in a huge file and then output each of the terms to individual files. I know I can use grep -f list main.file to search them but how can I split the output into individual files? Thank you. (6 Replies)
Discussion started by: ivpz
6 Replies

9. Shell Programming and Scripting

Using a single "find" cmd to search for multiple file types and output individual files

Hi All, I am new here but I have a scripting question that I can't seem to figure out with the "find" cmd. What I am trying to do is to only have to run a single find cmd parsing the directories and output the different file types to induvidual files and I have been running into problems.... (3 Replies)
Discussion started by: swaters
3 Replies

10. Shell Programming and Scripting

How to list files names and sizes in a directory and output result to the file?

Hi , I'm trying to list the files and output is written to a file. But when I execute the command , the output file is being listed. How to exclude it ? /tmp file1.txt file2.txt ls -ltr |grep -v '-' | awk print {$9, $5} > output.txt cat output.txt file1.txt file2.txt output.txt (8 Replies)
Discussion started by: etldeveloper
8 Replies

LEARN ABOUT REDHAT

tzselect

TZSELECT(8)						      System Manager's Manual						       TZSELECT(8)

NAME

       tzselect - select a time zone

SYNOPSIS

       tzselect

DESCRIPTION

       The  tzselect program asks the user for information about the current location, and outputs the resulting time zone description to standard
       output.	The output is suitable as a value for the TZ environment variable.

       All interaction with the user is done via standard input and standard error.

ENVIRONMENT VARIABLES

       AWK    Name of a Posix-compliant awk program (default: awk).

       TZDIR  Name of the directory containing time zone data files (default: /usr/local/etc/zoneinfo).

FILES

       TZDIR/iso3166.tab
	      Table of ISO 3166 2-letter country codes and country names.

       TZDIR/zone.tab
	      Table of country codes, latitude and longitude, TZ values, and descriptive comments.

       TZDIR/TZ
	      Time zone data file for time zone TZ.

EXIT STATUS

       The exit status is zero if a time zone was successfully obtained from the user, nonzero otherwise.

SEE ALSO

       newctime(3), tzfile(5), zdump(8), zic(8)

																       TZSELECT(8)
All times are GMT -4. The time now is 11:46 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy