Sponsored Content
Top Forums Shell Programming and Scripting Use while loop to read file and use ${file} for both filename input into awk and as string to print Post 302997587 by rovf on Wednesday 17th of May 2017 03:18:54 AM
Old 05-17-2017
You didn't say which awk you are using. If your awk is linked to nawk or gawk, there is also an alternative to the solution posted by Don Cragun, in that you could export your shell variable (so that it becomes an environment variable) and use awk's built-in ENVIRON array to access it. If you follow this route, I strongly recommend to write the variable in all-uppercase.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Awk+Grep Input file needs to match a column and print the entire line

I'm having problems since few days ago, and i'm not able to make it works with a simple awk+grep script (or other way to do this). For example, i have a input file1.txt: cat inputfile1.txt 218299910417 1172051195 1172070231 1172073514 1183135117 1183135118 1183135119 1281440202 ... (3 Replies)
Discussion started by: poliver
3 Replies

2. Shell Programming and Scripting

Awk to print on condition in input file

I need only those records which has $2 equal to "DEF" independent of case (i.e upper or lower) nawk -F"," '$2 ~ //{print $0}' file This returns 3rd record also which i dont want I tried this but this doesnt work as expected. nawk -F"," '$2 == ""{print $0}' file i dont... (3 Replies)
Discussion started by: pinnacle
3 Replies

3. Shell Programming and Scripting

Print only Filename based on given String on file name

Hi, I am new to this unix world. Any ways, I would like to write a shell script that can print the file name. Ex : directory will have 5 files with different name.No matter what are contents are. Now I need to find the file which will have particular name (sub string ).Please do not... (5 Replies)
Discussion started by: akb2010
5 Replies

4. Shell Programming and Scripting

Take input from read and place it a string in another file

Hi, This is most likely a dumb question but I could not find answer to it elsewhere. I'm building a simple menu with case /esac and want to read user's input: Please enter XYZ ; read XYZ How do I take the value of XYZ and insert it as a variable $XYZ in file file.txt ? I may need to... (9 Replies)
Discussion started by: svetoslav_sj
9 Replies

5. Shell Programming and Scripting

Using awk instead of while loop to read file

Hello, I have a huge file, I am currently using while loop to read and do some calculation on it, but it is taking a lot of time. I want to use AWK to read and do those calculations. Please suggest. currently doing: cat input2 | while read var1 do num=`echo $var1 | awk... (6 Replies)
Discussion started by: anand2308
6 Replies

6. Shell Programming and Scripting

For loop inside awk to read and print contents of files

Hello, I have a set of files Xfile0001 - Xfile0021, and the content of this files (one at a time) needs to be printed between some line (lines start with word "Generated") that I am extracting from another file called file7.txt and all the output goes into output.txt. First I tried creating a for... (5 Replies)
Discussion started by: jaldo0805
5 Replies

7. Shell Programming and Scripting

Read input file with in awk script not through command line

Hi All, Do we know how to read input file within awk script and send output toanother log file. All this needs to be in awk script, not in command line. I am running this awk through crontab. Cat my.awk #!/bin/awk -f function test(var){ some code} { } END { print"test code" } (5 Replies)
Discussion started by: random_thoughts
5 Replies

8. Shell Programming and Scripting

Failure using regex with awk in 'while read file' loop

I have a file1.txt with several 100k lines, each of which has a column 9 containing one of 60 "label" identifiers. Using an labels.txt file containing a list of labels, I'd like to extract 200 random lines from file1.txt for each of the labels in index.txt. Using a contrived mini-example: $ cat... (8 Replies)
Discussion started by: pathunkathunk
8 Replies

9. UNIX for Beginners Questions & Answers

How to make a loop to read the input from a file part by part?

Hi All, We've a VDI infrastructure in AWS (AWS workspaces) and we're planning to automate the process of provisioning workspaces. Instead of going to GUI console, and launching workspaces by selecting individual users is little time consuming. Thus, I want to create them in bunches from AWS CLI... (6 Replies)
Discussion started by: arun_adm
6 Replies

10. Shell Programming and Scripting

Read file input in while loop does not work on AIX system

I'm working on Aix 6.1 and using ksh shell. The below works fine on Linux bash or ksh shell . while IFS= read -r dirpath ; do echo "Hi" done <<<"$var" However, any such while loop that reads the input from file or variable using <<< fails on Aix system with the below error: Below... (2 Replies)
Discussion started by: mohtashims
2 Replies
awk(1)							      General Commands Manual							    awk(1)

Name
       awk - pattern scanning and processing language

Syntax
       awk [-Fc] [-f prog] [-] [file...]

Description
       The  command scans each input file for lines that match any of a set of patterns specified in prog.  With each pattern in prog there can be
       an associated action that will be performed when a line of a file matches the pattern.  The set of patterns may appear literally  as  prog,
       or in a file specified as -f prog.

       Files  are  read  in  order;  if there are no files, the standard input is read.  The file name `-' means the standard input.  Each line is
       matched against the pattern portion of every pattern-action statement; the associated action is performed for each matched pattern.

       An input line is made up of fields separated by white space.  (This default can be changed by using FS, as described  below.)   The  fields
       are denoted $1, $2, ... ; $0 refers to the entire line.

       A pattern-action statement has the form

	    pattern { action }

       A missing { action } means print the line; a missing pattern always matches.

       An action is a sequence of statements.  A statement can be one of the following:

	    if ( conditional ) statement [ else statement ]
	    while ( conditional ) statement
	    for ( expression ; conditional ; expression ) statement
	    break
	    continue
	    { [ statement ] ... }
	    variable = expression
	    print [ expression-list ] [ >expression ]
	    printf format [ , expression-list ] [ >expression ]
	    next # skip remaining patterns on this input line
	    exit # skip the rest of the input

       Statements  are terminated by semicolons, new lines or right braces.  An empty expression-list stands for the whole line.  Expressions take
       on string or numeric values as appropriate, and are built using the operators +, -, *, /, %,  and concatenation	(indicated  by	a  blank).
       The  C operators ++, --, +=, -=, *=, /=, and %= are also available in expressions.  Variables may be scalars, array elements (denoted x[i])
       or fields.  Variables are initialized to the null string.  Array subscripts may be any string, not necessarily numeric; this allows  for  a
       form of associative memory.  String constants are quoted "...".

       The  print  statement prints its arguments on the standard output (or on a file if >file is present), separated by the current output field
       separator, and terminated by the output record separator.  The statement formats its expression list according to the format.  For  further
       information, see

       The  built-in  function	length	returns the length of its argument taken as a string, or of the whole line if no argument.  There are also
       built-in functions exp, log, sqrt, and int.  The last truncates its argument to an integer.  substr(s, m, n) returns the  n-character  sub-
       string  of  s that begins at position m.  The function sprintf(fmt, expr, expr, ...)  formats the expressions according to the format given
       by fmt and returns the resulting string.

       Patterns are arbitrary Boolean combinations (!, ||, &&, and parentheses)  of  regular  expressions  and	relational  expressions.   Regular
       expressions  must be surrounded by slashes and are as in egrep.	Isolated regular expressions in a pattern apply to the entire line.  Regu-
       lar expressions may also occur in relational expressions.

       A pattern may consist of two patterns separated by a comma; in this case, the action is performed for all lines between	an  occurrence	of
       the first pattern and the next occurrence of the second.

       A relational expression is one of the following:

	    expression matchop regular-expression
	    expression relop expression

       where a relop is any of the six relational operators in C, and a matchop is either ~ (for contains) or !~ (for does not contain).  A condi-
       tional is an arithmetic expression, a relational expression, or a Boolean combination of these.

       The special patterns BEGIN and END may be used to capture control before the first input line is read and after the last.   BEGIN  must	be
       the first pattern, END the last.

       A single character c may be used to separate the fields by starting the program with

	    BEGIN { FS = "c" }

       or by using the -Fc option.

       Other  variable	names  with special meanings include NF, the number of fields in the current record; NR, the ordinal number of the current
       record; FILENAME, the name of the current input file; OFS, the output field separator (default blank); ORS,  the  output  record  separator
       (default new line); and OFMT, the output format for numbers (default "%.6g").

Options
       -	 Used for standard input file.

       -Fc	 Sets interfield separator to named character.

       -fprog	 Uses prog file for patterns and actions.

Examples
       Print lines longer than 72 characters:
	    length > 72

       Print first two fields in opposite order:
	    { print $2, $1 }

       Add up first column, print sum and average:
		 { s += $1 }
	    END  { print "sum is", s, " average is", s/NR }

       Print fields in reverse order:
	    { for (i = NF; i > 0; --i) print $i }

       Print all lines between start/stop pairs:
	    /start/, /stop/

       Print all lines whose first field is different from previous one:
	    $1 != prev { print; prev = $1 }

Restrictions
       There  are  no explicit conversions between numbers and strings.  To force an expression to be treated as a number add 0 to it; to force it
       to be treated as a string concatenate "" to it.

See Also
       lex(1), sed(1)
       "Awk - A Pattern Scanning and Processing Language" ULTRIX Supplementary Documents Vol. II: Programmer

																	    awk(1)
All times are GMT -4. The time now is 04:26 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy