Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Extract CSV records using NAWK?
Top Forums Shell Programming and Scripting Extract CSV records using NAWK? Post 302394701 by Franklin52 on Friday 12th of February 2010 08:58:55 AM
Old 02-12-2010
Something like this? This is an example with one column:
Code:
awk 'NR==2 {
  for(i=1;i<=NF;i++) {
    if($i=="EXAMPLE_COLUMN") }
      EXAMPLE_COLUMN=i
    }
  }
  next
}
$EXAMPLE_COLUMN=="X" 
' file

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Compare Records between to files and extract it

I am not an expert in awk, SED, etc... but I really hope there is a way to do this, because I don't want to have to right a program. I am using C shell. FILE 1 FILE 2 H0000000 H0000000 MA1 MA1 CA1DDDDDD CA1AAAAAA MA2 ... (2 Replies)
Discussion started by: jclanc8
2 Replies

2. Shell Programming and Scripting

Replace a particular field in all records in a csv file

hi, i have various csv files, the file format is as follows Entry: "1",4,2010/08/15-10-00-00.01,,"E",,,,,,,,,120,0,"M4_","C","KEW-011-5337140-20100916163456-540097","1234567890","N N 0 ",,,"NUK 800100200",,,"NN",,,,,,,,,,,,"0000000001|0001|20150401... (2 Replies)
Discussion started by: niteesh_!7
2 Replies

3. Shell Programming and Scripting

nawk -- separation of records on basis of number of fields

A file file1.txt exists having records like The delimiter being "|" X|_|Y|_|Z|_| (number of fields 7) A|_|B|_| (number of fields 5) X|_|Z|_|H|_| (number of fields 7) A|_|D|_|S|_| (number of... (4 Replies)
Discussion started by: centurion_13
4 Replies

4. Shell Programming and Scripting

Nawk, creating a variable total from multiple lines(records)

Good Morning/Afternoon All, I am having some trouble creating a variable called "total" to display the sum of the values in a specific field, $6 for example. The data I am working on is in the following form: John Doe:(555) 555-5555:1:2:3 Jane Doe:(544) 444-5556:4:5:6 Moe Doe:(654)... (2 Replies)
Discussion started by: SEinT
2 Replies

5. Shell Programming and Scripting

Nawk script to compare records of a file based on a particular column.

Hi Gurus, I am struggling with nawk command where i am processing a file based on columns. Here is the sample data file. UM113570248|24-AUG-11|4|man1|RR211 Alert: Master Process failure |24-AUG-11 UM113570624|24-AUG-11|4|man1| Alert: Pattern 'E_DCLeDAOException' found |24-AUG-11... (7 Replies)
Discussion started by: usha rao
7 Replies

6. Shell Programming and Scripting

problem in redirecting records using nawk

I am trying to redirect record to two files using nawk if-else. #Identify good and bad records and redirect records using if-then-else nawk -F"|" '{if(NF!=14){printf("%s\n",$0) >> "$fn"_bad_data}else{printf("%s\n",$0) >> $fn}}' "$fn".orig "$fn".orig is the source file name bad... (7 Replies)
Discussion started by: siteregsam
7 Replies

7. Shell Programming and Scripting

removing duplicate records comparing 2 csv files

Hi All, I want to remove the rows from File1.csv by comparing a column/field in the File2.csv. If both columns matches then I want that row to be deleted from File1 using shell script(awk). Here is an example on what I need. File1.csv: RAJAK,ACTIVE,1 VIJAY,ACTIVE,2 TAHA,ACTIVE,3... (6 Replies)
Discussion started by: rajak.net
6 Replies

8. Shell Programming and Scripting

Extract records from list

Hi Gents, I have a file 1 like this 1 1000 20 2 2000 30 3 1000 40 5 1000 50 And I have other file 1 like 2 1 I would like to get from the file 1 the complete line which are in file 2, the key to compare is the column 2 then output should be. 2 2000 30. I was trying to get it... (5 Replies)
Discussion started by: jiam912
5 Replies

9. UNIX for Beginners Questions & Answers

Filtering records of a csv file based on a value of a column

Hi, I tried filtering the records in a csv file using "awk" command listed below. awk -F"~" '$4 ~ /Active/{print }' inputfile > outputfile The output always has all the entries. The same command worked for different users from one of the forum links. content of file I was... (3 Replies)
Discussion started by: sunilmudikonda
3 Replies

10. UNIX for Beginners Questions & Answers

1. This will insert the records into db table by reading from ta csv file

I have this code with me but the condition is If any of the mandatory columns are null then entire file will be rejected. LOAD DATA infile ' ' #specifies the name of a datafile containing data that you want to load BADFILE ' ' #specifies the name of... (1 Reply)
Discussion started by: raka123
1 Replies

LEARN ABOUT REDHAT

dlags2

DLAGS2(l)								 )								 DLAGS2(l)

NAME

       DLAGS2 - compute 2-by-2 orthogonal matrices U, V and Q, such that if ( UPPER ) then  U'*A*Q = U'*( A1 A2 )*Q = ( x 0 ) ( 0 A3 ) ( x x ) and
       V'*B*Q = V'*( B1 B2 )*Q = ( x 0 ) ( 0 B3 ) ( x x )  or if ( .NOT.UPPER ) then  U'*A*Q = U'*( A1 0 )*Q = ( x x ) ( A2 A3	)  (  0  x  )  and
       V'*B*Q = V'*( B1 0 )*Q = ( x x ) ( B2 B3 ) ( 0 x )  The rows of the transformed A and B are parallel, where  U = ( CSU SNU ), V = ( CSV SNV
       ), Q = ( CSQ SNQ ) ( -SNU CSU ) ( -SNV CSV ) ( -SNQ CSQ )  Z' denotes the transpose of Z

SYNOPSIS

       SUBROUTINE DLAGS2( UPPER, A1, A2, A3, B1, B2, B3, CSU, SNU, CSV, SNV, CSQ, SNQ )

	   LOGICAL	  UPPER

	   DOUBLE	  PRECISION A1, A2, A3, B1, B2, B3, CSQ, CSU, CSV, SNQ, SNU, SNV

PURPOSE

       DLAGS2 computes 2-by-2 orthogonal matrices U, V and Q, such that if ( UPPER ) then U'*A*Q = U'*( A1 A2 )*Q = ( x 0 ) ( 0 A3 ) ( x x  )  and
       V'*B*Q  = V'*( B1 B2 )*Q = ( x 0 ) ( 0 B3 ) ( x x ) or if ( .NOT.UPPER ) then U'*A*Q = U'*( A1 0 )*Q = ( x x ) ( A2 A3 ) ( 0 x ) and V'*B*Q
       = V'*( B1 0 )*Q = ( x x ) ( B2 B3 ) ( 0 x ) The rows of the transformed A and B are parallel, where U = ( CSU SNU ), V = ( CSV SNV ), Q = (
       CSQ SNQ ) ( -SNU CSU ) ( -SNV CSV ) ( -SNQ CSQ ) Z' denotes the transpose of Z.

ARGUMENTS

       UPPER   (input) LOGICAL
	       = .TRUE.: the input matrices A and B are upper triangular.
	       = .FALSE.: the input matrices A and B are lower triangular.

       A1      (input) DOUBLE PRECISION
	       A2	(input)  DOUBLE  PRECISION A3	   (input) DOUBLE PRECISION On entry, A1, A2 and A3 are elements of the input 2-by-2 upper
	       (lower) triangular matrix A.

       B1      (input) DOUBLE PRECISION
	       B2      (input) DOUBLE PRECISION B3	(input) DOUBLE PRECISION On entry, B1, B2 and B3 are elements of the  input  2-by-2  upper
	       (lower) triangular matrix B.

       CSU     (output) DOUBLE PRECISION
	       SNU     (output) DOUBLE PRECISION The desired orthogonal matrix U.

       CSV     (output) DOUBLE PRECISION
	       SNV     (output) DOUBLE PRECISION The desired orthogonal matrix V.

       CSQ     (output) DOUBLE PRECISION
	       SNQ     (output) DOUBLE PRECISION The desired orthogonal matrix Q.

LAPACK version 3.0						   15 June 2000 							 DLAGS2(l)
All times are GMT -4. The time now is 02:20 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy