Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Filtering records of a file based on a value of a column
Top Forums UNIX for Dummies Questions & Answers Filtering records of a file based on a value of a column Post 302239545 by era on Wednesday 24th of September 2008 02:15:30 AM
Old 09-24-2008
Code:
awk -F"~" '$2 ~ /XX|YY/ {print }' inputfile > outputfile

More generally, if you cannot put both conditions in a single regular expression, the syntax of a proper "or" is

Code:
awk '$1 ~ /foo/ || $2 ~ /bar/ { print }'

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

filtering records based on numeric field value in 8th position

I have a ";" delimited file.Whcih conatins a number fileds of length 4 charcters in 8th position But there is a alphanumeric charcters like : space, ";" , "," , "/" , "23-1" , "23 1" , "aqjhdj" , "jun-23" , "APR-04" , "4:00AM" , "-234" , "56784 ", "." , "+" "_" , "&" , "*" , "^" , "%" , "!"... (2 Replies)
Discussion started by: indusri
2 Replies

2. Shell Programming and Scripting

Removing duplicate records in a file based on single column

Hi, I want to remove duplicate records including the first line based on column1. For example inputfile(filer.txt): ------------- 1,3000,5000 1,4000,6000 2,4000,600 2,5000,700 3,60000,4000 4,7000,7777 5,999,8888 expected output: ---------------- 3,60000,4000 4,7000,7777... (5 Replies)
Discussion started by: G.K.K
5 Replies

3. Shell Programming and Scripting

Nawk script to compare records of a file based on a particular column.

Hi Gurus, I am struggling with nawk command where i am processing a file based on columns. Here is the sample data file. UM113570248|24-AUG-11|4|man1|RR211 Alert: Master Process failure |24-AUG-11 UM113570624|24-AUG-11|4|man1| Alert: Pattern 'E_DCLeDAOException' found |24-AUG-11... (7 Replies)
Discussion started by: usha rao
7 Replies

4. Shell Programming and Scripting

Perl: filtering lines based on duplicate values in a column

Hi I have a file like this. I need to eliminate lines with first column having the same value 10 times. 13 18 1 + chromosome 1, 122638287 AGAGTATGGTCGCGGTTG 13 18 1 + chromosome 1, 128904080 AGAGTATGGTCGCGGTTG 13 18 1 - chromosome 14, 13627938 CAACCGCGACCATACTCT 13 18 1 + chromosome 1,... (5 Replies)
Discussion started by: polsum
5 Replies

5. UNIX for Dummies Questions & Answers

Filtering records from 1 file based on some manipulation doen on second file

Hi, I am looking for an awk script which should help me to meet the following requirement: File1 has records in following format INF: FAILEd RECORD AB1234 INF: FAILEd RECORD PQ1145 INF: FAILEd RECORD AB3215 INF: FAILEd RECORD AB6114 ............................ (2 Replies)
Discussion started by: mintu41
2 Replies

6. Shell Programming and Scripting

Filtering lines for column elements based on corresponding counts in another column

Hi, I have a file like this ACC 2 2 21 aaa AC 443 3 22 aaa GCT 76 1 33 xxx TCG 34 2 33 aaa ACGT 33 1 22 ggg TTC 99 3 44 wee CCA 33 2 33 ggg AAC 1 3 55 ddd TTG 10 1 22 ddd TTGC 98 3 22 ddd GCT 23 1 21 sds GTC 23 4 32 sds ACGT 32 2 33 vvv CGT 11 2 33 eee CCC 87 2 44... (1 Reply)
Discussion started by: polsum
1 Replies

7. Shell Programming and Scripting

Removing duplicate records in a file based on single column explanation

I was reading this thread. It looks like a simpler way to say this is to only keep uniq lines based on field or column 1. https://www.unix.com/shell-programming-scripting/165717-removing-duplicate-records-file-based-single-column.html Can someone explain this command please? How are there no... (5 Replies)
Discussion started by: cokedude
5 Replies

8. Shell Programming and Scripting

Filtering first file columns based on second file column

Hi friends, I have one file like below. (.csv type) SNo,data1,data2 1,1,2 2,2,3 3,3,2 and another file like below. Exclude data1 where Exclude should be treated as column name in file2. I want the output shown below. SNo,data2 1,2 2,3 3,2 Where my data1 column got removed from... (2 Replies)
Discussion started by: ks_reddy
2 Replies

9. UNIX for Beginners Questions & Answers

Filtering based on column values

Hi there, I am trying to filter a big file with several columns using values on a column with values like (AC=5;AN=10;SF=341,377,517,643,662;VRT=1). I wont to filter the data based on SF= values that are (bigger than 400) ... (25 Replies)
Discussion started by: daashti
25 Replies

10. UNIX for Beginners Questions & Answers

Filtering records of a csv file based on a value of a column

Hi, I tried filtering the records in a csv file using "awk" command listed below. awk -F"~" '$4 ~ /Active/{print }' inputfile > outputfile The output always has all the entries. The same command worked for different users from one of the forum links. content of file I was... (3 Replies)
Discussion started by: sunilmudikonda
3 Replies

LEARN ABOUT DEBIAN

tcttest

TCTTEST(1)							   Tokyo Cabinet							TCTTEST(1)

NAME

       tcttest - test cases of the table database API

DESCRIPTION

       The command `tcttest' is a utility for facility test and performance test.  This command is used in the following format.  `path' specifies
       the path of a database file.  `rnum' specifies the number of iterations.  `bnum' specifies the number of  buckets.   `apow'  specifies  the
       power of the alignment.	`fpow' specifies the power of the free block pool.

	      tcttest  write  [-mt]  [-tl] [-td|-tb|-tt|-tx] [-rc num] [-lc num] [-nc num] [-xm num] [-df num] [-ip] [-is] [-in] [-it] [-if] [-ix]
	      [-nl|-nb] [-rnd] path rnum [bnum [apow [fpow]]]
		     Store records with columns "str", "num", "type", and "flag".
	      tcttest read [-mt] [-rc num] [-lc num] [-nc num] [-xm num] [-df num] [-nl|-nb] [-rnd] path
		     Retrieve all records of the database above.
	      tcttest remove [-mt] [-rc num] [-lc num] [-nc num] [-xm num] [-df num] [-nl|-nb] [-rnd] path
		     Remove all records of the database above.
	      tcttest rcat [-mt] [-tl] [-td|-tb|-tt|-tx] [-rc num] [-lc num] [-nc num] [-xm num] [-df num] [-ip] [-is]	[-in]  [-it]  [-if]  [-ix]
	      [-nl|-nb] [-pn num] [-dai|-dad|-rl|-ru] path rnum [bnum [apow [fpow]]]
		     Store records with partway duplicated keys using concatenate mode.
	      tcttest misc [-mt] [-tl] [-td|-tb|-tt|-tx] [-nl|-nb] path rnum
		     Perform miscellaneous test of various operations.
	      tcttest wicked [-mt] [-tl] [-td|-tb|-tt|-tx] [-nl|-nb] path rnum
		     Perform updating operations selected at random.

       Options feature the following.

	      -mt : call the function `tctdbsetmutex'.
	      -tl : enable the option `TDBTLARGE'.
	      -td : enable the option `TDBTDEFLATE'.
	      -tb : enable the option `TDBTBZIP'.
	      -tt : enable the option `TDBTTCBS'.
	      -tx : enable the option `TDBTEXCODEC'.
	      -rc num : specify the number of cached records.
	      -lc num : specify the number of cached leaf pages.
	      -nc num : specify the number of cached non-leaf pages.
	      -xm num : specify the size of the extra mapped memory.
	      -df num : specify the unit step number of auto defragmentation.
	      -ip : create the number index for the primary key.
	      -is : create the string index for the column "str".
	      -in : create the number index for the column "num".
	      -it : create the string index for the column "type".
	      -if : create the token inverted index for the column "flag".
	      -ix : create the q-gram inverted index for the column "text".
	      -nl : enable the option `TDBNOLCK'.
	      -nb : enable the option `TDBLCKNB'.
	      -rnd : select keys at random.
	      -pn num : specify the number of patterns.
	      -dai : use the function `tctdbaddint' instead of `tctdbputcat'.
	      -dad : use the function `tctdbadddouble' instead of `tctdbputcat'.
	      -rl : set the length of values at random.
	      -ru : select update operations at random.

       This command returns 0 on success, another on failure.

SEE ALSO

       tctmttest(1), tctmgr(1), tctdb(3), tokyocabinet(3)

Man Page							    2011-02-12								TCTTEST(1)
All times are GMT -4. The time now is 04:01 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy