Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: awk, multiple files input and multiple files output
Top Forums Shell Programming and Scripting awk, multiple files input and multiple files output Post 302647661 by gabrysfe on Monday 28th of May 2012 01:09:52 PM
Old 05-28-2012
the 'something' is the elimination of duplicates considering only the first column (i try '!_[$1]++' and works good for me).
I want to eliminate the duplicates (as written above) from each input file in the folder and I want an ouput file (one for each input file) that should have the same name of the input file with added something. For example: input file name is "333.e" and I would like an output file name like "333_mod.e".
The input files have two columns and I need to eliminate duplicates agreeing with the elements of the first column.
They are like:

pb_04 0,1
pb_05 0.3
pb_05 0.2
pb_12 0.85
... ...

in this case i need to eliminate one row with pb_05.

thanks!
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Splitting input files into multiple files through AWK command

Hi, I needs to split *.txt files from single directory depends on the some mutltiple input values. i have wrote the code like below for file in *.txt do grep -i -h "value1|value2" $file > $file; done. My requirment is more input values needs to be given in grep; let us say 50... (3 Replies)
Discussion started by: arund_01
3 Replies

2. Shell Programming and Scripting

building output file from multiple input files

Hi there, I am trying to figure out a way to combine multiple sources with different data on a single file, and I am trying to find the best way to do it. I have multiple files, let's say A, B, C and D. A has a field in common with B, B has a field in common with C, and C has a field in... (2 Replies)
Discussion started by: ppucci
2 Replies

3. UNIX for Dummies Questions & Answers

Using AWK: Extract data from multiple files and output to multiple new files

Hi, I'd like to process multiple files. For example: file1.txt file2.txt file3.txt Each file contains several lines of data. I want to extract a piece of data and output it to a new file. file1.txt ----> newfile1.txt file2.txt ----> newfile2.txt file3.txt ----> newfile3.txt Here is... (3 Replies)
Discussion started by: Liverpaul09
3 Replies

4. Shell Programming and Scripting

how to give multiple csv files as input in awk

Hi All, I am new to shell scripting..My problem is i want to give multiple csv files as input to awk script and process the data into one file.. My input file is File1 File2 File3 Product Location Period SalesPrice A x 8/11/2010 ... (7 Replies)
Discussion started by: kvth
7 Replies

5. UNIX for Dummies Questions & Answers

Use awk to pipe output from one file into multiple files

Hi All. Thanks for your help in advance. I have a requirement to examine the number of delimiters in each record of a file. If the record has the expected number of delimiters it should be passed into a 'good' file. If it does not, the record should be passed into a 'bad' file. I have been able... (8 Replies)
Discussion started by: codestar1
8 Replies

6. Shell Programming and Scripting

Split: File into multiple and keeping the same 3 lines from input into all output files

The following code will split the infile into multiple files. However, I need it to insert the same first 3 lines from the original input file into each splitted file. How do I modify my script below to do so: print -n "Enter file name to split? " ; read infile if then echo "Invalid file... (4 Replies)
Discussion started by: mrn6430
4 Replies

7. Shell Programming and Scripting

FOR loop with multiple files as input and awk

Hi all , i want to pass multiple files as input to a for loop for i in file1 file2 file3 do some awk action < $i >> $i.out done but im getting error in that for loop is the way i use to pass files to awk using for correct and 2.we can directly pass multiple files to awk as... (7 Replies)
Discussion started by: zozoo
7 Replies

8. Shell Programming and Scripting

Create Multiple UNIX Files for Multiple SQL Rows output

Dear All, I am trying to write a Unix Script which fires a sql query. The output of the sql query gives multiple rows. Each row should be saved in a separate Unix File. The number of rows of sql output can be variable. I am able save all the rows in one file but in separate files. Any... (14 Replies)
Discussion started by: Rahul_Bhasin
14 Replies

9. Shell Programming and Scripting

[Solved] Multiple input files and output files

Hi, I have many test*.ft1 files to which I want to read as input for a script called pipe2txt.tcl and print the output in each separate file. For example, pipe2txt.tcl < test001.ft1 > test001.txt How can I read many files in this maner? thank you very much, Best, Pahuja (5 Replies)
Discussion started by: Pahuja
5 Replies

10. Shell Programming and Scripting

Grep strings on multiple files and output to multiple files

Hi All, I want to use egrep on multiple files and the results should be output to multiple files. I am using the below code in my shell script(working in Ksh shell). However with this code I am not attaining the desired results. #!/bin/ksh ( a="/path/file1" b="path/file2" for file in... (4 Replies)
Discussion started by: am24
4 Replies

LEARN ABOUT REDHAT

sgeequ

SGEEQU(l)								 )								 SGEEQU(l)

NAME

       SGEEQU - compute row and column scalings intended to equilibrate an M-by-N matrix A and reduce its condition number

SYNOPSIS

       SUBROUTINE SGEEQU( M, N, A, LDA, R, C, ROWCND, COLCND, AMAX, INFO )

	   INTEGER	  INFO, LDA, M, N

	   REAL 	  AMAX, COLCND, ROWCND

	   REAL 	  A( LDA, * ), C( * ), R( * )

PURPOSE

       SGEEQU computes row and column scalings intended to equilibrate an M-by-N matrix A and reduce its condition number. R returns the row scale
       factors and C the column scale factors, chosen to try to make the largest element in each row and column of  the  matrix  B  with  elements
       B(i,j)=R(i)*A(i,j)*C(j) have absolute value 1.

       R(i) and C(j) are restricted to be between SMLNUM = smallest safe number and BIGNUM = largest safe number.  Use of these scaling factors is
       not guaranteed to reduce the condition number of A but works well in practice.

ARGUMENTS

       M       (input) INTEGER
	       The number of rows of the matrix A.  M >= 0.

       N       (input) INTEGER
	       The number of columns of the matrix A.  N >= 0.

       A       (input) REAL array, dimension (LDA,N)
	       The M-by-N matrix whose equilibration factors are to be computed.

       LDA     (input) INTEGER
	       The leading dimension of the array A.  LDA >= max(1,M).

       R       (output) REAL array, dimension (M)
	       If INFO = 0 or INFO > M, R contains the row scale factors for A.

       C       (output) REAL array, dimension (N)
	       If INFO = 0,  C contains the column scale factors for A.

       ROWCND  (output) REAL
	       If INFO = 0 or INFO > M, ROWCND contains the ratio of the smallest R(i) to the largest R(i).  If ROWCND >= 0.1 and AMAX is  neither
	       too large nor too small, it is not worth scaling by R.

       COLCND  (output) REAL
	       If INFO = 0, COLCND contains the ratio of the smallest C(i) to the largest C(i).  If COLCND >= 0.1, it is not worth scaling by C.

       AMAX    (output) REAL
	       Absolute  value	of  largest  matrix  element.	If AMAX is very close to overflow or very close to underflow, the matrix should be
	       scaled.

       INFO    (output) INTEGER
	       = 0:  successful exit
	       < 0:  if INFO = -i, the i-th argument had an illegal value
	       > 0:  if INFO = i,  and i is
	       <= M:  the i-th row of A is exactly zero
	       >  M:  the (i-M)-th column of A is exactly zero

LAPACK version 3.0						   15 June 2000 							 SGEEQU(l)
All times are GMT -4. The time now is 01:40 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy