Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: run awk on one file for each line in a second file
Top Forums Shell Programming and Scripting run awk on one file for each line in a second file Post 302246901 by erichpowell on Tuesday 14th of October 2008 04:52:26 PM
Old 10-14-2008
Hmmm. I take it from your response that fgrep would have provided a much easier way to perform the task, but after looking it up I don't see how. (I found this definition: "use fgrep to find all the lines of a file that contain a particular word.")
Seems that I would have just been doing the same 'for' loop except to fgrep instead of gawk. In fact, there would have been an extra step because that would have just given me the lines, but I'd still need to parse out the first field from the rest of the line.
Am I missing something?
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Awk not working due to missing new line character at last line of file

Hi, My awk program is failing. I figured out using command od -c filename that the last line of the file doesnt end with a new line character. Mine is an automated process because of this data is missing. How do i handle this? I want to append new line character at the end of last... (2 Replies)
Discussion started by: pinnacle
2 Replies

2. Shell Programming and Scripting

reading a file inside awk and processing line by line

Hi Sorry to multipost. I am opening the new thread because the earlier threads head was misleading to my current doubt. and i am stuck. list=`cat /u/Test/programs`; psg "ServTest" | awk -v listawk=$list '{ cmd_name=($5 ~ /^/)? $9:$8 for(pgmname in listawk) ... (6 Replies)
Discussion started by: Anteus
6 Replies

3. Shell Programming and Scripting

awk concatenate every line of a file in a single line

I have several hundreds of tiny files which need to be concatenated into one single line and all those in a single file. Some files have several blank lines. Tried to use this script but failed on it. awk 'END { print r } r && !/^/ { print FILENAME, r; r = "" }{ r = r ? r $0 : $0 }' *.txt... (8 Replies)
Discussion started by: sdf
8 Replies

4. Shell Programming and Scripting

[awk] line by line processing the same file

Hey, not too good at this, so I only managed a clumsy and SLOW solution to my problem that needs a drastic speed up. Any ideas how I write the following in awk only? Code is supposed to do... For every line read column values $6, $7, $8 and do a calculation with the same column values of every... (6 Replies)
Discussion started by: origamisven
6 Replies

5. Shell Programming and Scripting

Run a command on each line of a text file

Say I have a text file, with several lines. Each line may contain spaces or the # symbol. For each line, I want to pass that line as the path of a file, in order to add it to a tar file. I've tried this but doesn't work: cat contents.txt | xargs -0 `tar -uvf contents.tar $1`Any ideas? ... (3 Replies)
Discussion started by: Tribe
3 Replies

6. Shell Programming and Scripting

Honey, I broke awk! (duplicate line removal in 30M line 3.7GB csv file)

I have a script that builds a database ~30 million lines, ~3.7 GB .cvs file. After multiple optimzations It takes about 62 min to bring in and parse all the files and used to take 10 min to remove duplicates until I was requested to add another column. I am using the highly optimized awk code: awk... (34 Replies)
Discussion started by: Michael Stora
34 Replies

7. Shell Programming and Scripting

Read in txt file and run a different command for each line

hi, i'm trying to write a tcsh script that reads in a text file (one column) and the runs a different command for each line of text. i've found lots of example commands for bash, but not for tcsh. can anyone give me a hint? thanks, jill (8 Replies)
Discussion started by: giuinha
8 Replies

8. UNIX for Beginners Questions & Answers

Use strings from nth field from one file to match strings in entire line in another file, awk

I cannot seem to get what should be a simple awk one-liner to work correctly and cannot figure out why. I would like to use patterns from a specific field in one file as regex to search for matching strings in the entire line ($0) of another file. I would like to output the lines of File2 which... (1 Reply)
Discussion started by: jvoot
1 Replies

9. Shell Programming and Scripting

Printing string from last field of the nth line of file to start (or end) of each line (awk I think)

My file (the output of an experiment) starts off looking like this, _____________________________________________________________ Subjects incorporated to date: 001 Data file started on machine PKSHS260-05CP ********************************************************************** Subject 1,... (9 Replies)
Discussion started by: samonl
9 Replies

10. UNIX for Beginners Questions & Answers

awk to update file with partial matching line in another file and append text

In the awk below I am trying to cp and paste each matching line in f2 to $3 in f1 if $2 of f1 is in the line in f2 somewhere. There will always be a match (usually more then 1) and my actual data is much larger (several hundreds of lines) in both f1 and f2. When the line in f2 is pasted to $3 in... (4 Replies)
Discussion started by: cmccabe
4 Replies

LEARN ABOUT CENTOS

gsl-randist

GSL-RANDIST(1)						      General Commands Manual						    GSL-RANDIST(1)

NAME

       gsl-randist - generate random samples from various distributions

SYNOPSYS

       gsl-randist seed n DIST param1 param2 [..]

DESCRIPTION

       gsl-randist  is a demonstration program for the GNU Scientific Library.	It generates n random samples from the distribution DIST using the
       distribution parameters param1, param2, ...

EXAMPLE

       Here is an example.  We generate 10000 random samples from a Cauchy distribution with a width of 30 and histogram them over the range  -100
       to 100, using 200 bins.

	    gsl-randist 0 10000 cauchy 30 | gsl-histogram -100 100 200 > histogram.dat

       A  plot	of  the  resulting histogram will show the familiar shape of the Cauchy distribution with fluctuations caused by the finite sample
       size.

	    awk '{print $1, $3 ; print $2, $3}' histogram.dat | graph -T X

SEE ALSO

       gsl(3), gsl-histogram(1).

AUTHOR

       gsl-randist was written by James Theiler and Brian Gough.  Copyright 1996-2000; for copying conditions see the GNU General Public Licence.

       This manual page was added by the Dirk Eddelbuettel <edd@debian.org>, the Debian GNU/Linux maintainer for GSL.

GNU
																    GSL-RANDIST(1)
All times are GMT -4. The time now is 07:37 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy