awk, multiple files input and multiple files output Post: 302647899

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Splitting input files into multiple files through AWK command

Hi, I needs to split *.txt files from single directory depends on the some mutltiple input values. i have wrote the code like below for file in *.txt do grep -i -h "value1|value2" $file > $file; done. My requirment is more input values needs to be given in grep; let us say 50...

2. Shell Programming and Scripting

building output file from multiple input files

Hi there, I am trying to figure out a way to combine multiple sources with different data on a single file, and I am trying to find the best way to do it. I have multiple files, let's say A, B, C and D. A has a field in common with B, B has a field in common with C, and C has a field in...

3. UNIX for Dummies Questions & Answers

Using AWK: Extract data from multiple files and output to multiple new files

Hi, I'd like to process multiple files. For example: file1.txt file2.txt file3.txt Each file contains several lines of data. I want to extract a piece of data and output it to a new file. file1.txt ----> newfile1.txt file2.txt ----> newfile2.txt file3.txt ----> newfile3.txt Here is...

4. Shell Programming and Scripting

how to give multiple csv files as input in awk

Hi All, I am new to shell scripting..My problem is i want to give multiple csv files as input to awk script and process the data into one file.. My input file is File1 File2 File3 Product Location Period SalesPrice A x 8/11/2010 ...

5. UNIX for Dummies Questions & Answers

Use awk to pipe output from one file into multiple files

Hi All. Thanks for your help in advance. I have a requirement to examine the number of delimiters in each record of a file. If the record has the expected number of delimiters it should be passed into a 'good' file. If it does not, the record should be passed into a 'bad' file. I have been able...

6. Shell Programming and Scripting

Split: File into multiple and keeping the same 3 lines from input into all output files

The following code will split the infile into multiple files. However, I need it to insert the same first 3 lines from the original input file into each splitted file. How do I modify my script below to do so: print -n "Enter file name to split? " ; read infile if then echo "Invalid file...

7. Shell Programming and Scripting

FOR loop with multiple files as input and awk

Hi all , i want to pass multiple files as input to a for loop for i in file1 file2 file3 do some awk action < $i >> $i.out done but im getting error in that for loop is the way i use to pass files to awk using for correct and 2.we can directly pass multiple files to awk as...

8. Shell Programming and Scripting

Create Multiple UNIX Files for Multiple SQL Rows output

Dear All, I am trying to write a Unix Script which fires a sql query. The output of the sql query gives multiple rows. Each row should be saved in a separate Unix File. The number of rows of sql output can be variable. I am able save all the rows in one file but in separate files. Any...

9. Shell Programming and Scripting

[Solved] Multiple input files and output files

Hi, I have many test*.ft1 files to which I want to read as input for a script called pipe2txt.tcl and print the output in each separate file. For example, pipe2txt.tcl < test001.ft1 > test001.txt How can I read many files in this maner? thank you very much, Best, Pahuja

10. Shell Programming and Scripting

Grep strings on multiple files and output to multiple files

Hi All, I want to use egrep on multiple files and the results should be output to multiple files. I am using the below code in my shell script(working in Ksh shell). However with this code I am not attaining the desired results. #!/bin/ksh ( a="/path/file1" b="path/file2" for file in...

LEARN ABOUT NETBSD

sleep

SLEEP(1)						    BSD General Commands Manual 						  SLEEP(1)

NAME

     sleep -- suspend execution for an interval of time

SYNOPSIS

     sleep seconds

DESCRIPTION

     The sleep utility suspends execution for a minimum of seconds.  It is usually used to schedule the execution of other commands (see EXAMPLES
     below).

     Note: The NetBSD sleep command will accept and honor a non-integer number of specified seconds.  This is a non-portable extension, and its
     use will nearly guarantee that a shell script will not execute properly on another system.

     When the SIGINFO signal is received, the estimate of the amount of seconds left to sleep is printed on the standard output.

EXIT STATUS

     The sleep utility exits with one of the following values:

     0	   On successful completion, or if the signal SIGALRM was received.

     >0    An error occurred.

EXAMPLES

     To schedule the execution of a command for 1800 seconds later:

	   (sleep 1800; sh command_file >& errors)&

     This incantation would wait half an hour before running the script command_file.  (See the at(1) utility.)

     To reiteratively run a command (with csh(1)):

	   while (1)
		   if (! -r zzz.rawdata) then
			   sleep 300
		   else
			   foreach i (*.rawdata)
				   sleep 70
				   awk -f collapse_data $i >> results
			   end
			   break
		   endif
	   end

     The scenario for a script such as this might be: a program currently running is taking longer than expected to process a series of files, and
     it would be nice to have another program start processing the files created by the first program as soon as it is finished (when zzz.rawdata
     is created).  The script checks every five minutes for the file zzz.rawdata, when the file is found, then another portion processing is done
     courteously by sleeping for 70 seconds in between each awk job.

SEE ALSO

     at(1), nanosleep(2), sleep(3)

STANDARDS

     The sleep command is expected to be IEEE Std 1003.2 (``POSIX.2'') compatible.

BSD
								  August 13, 2011							       BSD

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Splitting input files into multiple files through AWK command

Discussion started by: arund_01

2. Shell Programming and Scripting

building output file from multiple input files

Discussion started by: ppucci

3. UNIX for Dummies Questions & Answers

Using AWK: Extract data from multiple files and output to multiple new files

Discussion started by: Liverpaul09

4. Shell Programming and Scripting

how to give multiple csv files as input in awk

Discussion started by: kvth