Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Filtering Data

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Filtering Data
# 1  
Old 08-22-2007
Filtering Data
Hi All,

I have the below input and expected ouput. I need a code which can scan through this input file and if the number in column1 is more than 1 , it will print out the whole line, else it will output "No Re-occurrence". Can anybody help ?

Input:

1 vvvvv 20 7 7 23 0 64
6 zzzzzz 11 5 5 13 0 1
1 uuuuu 17 0 0 24 0 146
5 qqqqq 7 3 3 11 0 199
1 ggggg 11 5 5 13 0 13
1 yyyyy 13 7 7 31 0 252

Expected Output:

6 zzzzzz 11 5 5 13 0 1
5 qqqqq 7 3 3 11 0 199
# 2  
Old 08-22-2007
Try...
Code:
awk '{if ($1>1) print $0; else print "No Re-occurrence"}' file1

# 3  
Old 08-22-2007
Code:
awk '$1>1?1:$0="No occurence"' file

output:
Code:
# ./test.sh
No occurence
6 zzzzzz 11 5 5 13 0 1
No occurence
5 qqqqq 7 3 3 11 0 199
No occurence
No occurence

by the way, try to put in some effort next time.
# 4  
Old 08-23-2007
Hi Ghostdog,

I only want the the below to surface column1 more than 1.


6 zzzzzz 11 5 5 13 0 1
5 qqqqq 7 3 3 11 0 199


If column1 does not contain 1 then output "No occurence"

eg
Input:
1 vvvvv 20 7 7 23 0 64
1 uuuuu 17 0 0 24 0 146
1 ggggg 11 5 5 13 0 13
1 yyyyy 13 7 7 31 0 252

Output:
No occurrence
# 5  
Old 08-23-2007
If you do not want the lines with first column =1 then just remove the else part of the syntaxes recomended above.

Thanks
namish
# 6  
Old 08-23-2007
Try this :
Code:
awk '$1>1 { print; c++ } END { if (c==0) print "No occurrence" }' file

Jean-Pierre.
# 7  
Old 09-05-2007
Thnks Jean it works!!

However, how can i modify the code such that when 2 or more terms are repeated consecutively, it will output the the repeating term, else echo "No consecutive repeating term ?

Input:
vvvvv 20 7 7 23 0 64
uuuuu 17 0 0 24 0 146
uuuuu 17 0 0 24 0 146
uuuuu 17 0 0 24 0 146
ggggg 11 5 5 13 0 13
yyyyy 13 7 7 31 0 252
ggggg 11 5 5 13 0 13

Expected Output:
Consecutive Repeating term = uuuuu 17 0 0 24 0 146
Last edited by Raynon; 09-05-2007 at 02:56 AM..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Need help Filtering Data from an API

Hi Everyone, I need help on figuring out a way to filter some data that I get back from an API. Im able to get all the data that Im looking for but I would like to know a way for me to filter it better. The data that Im getting back is basically 2 rows of data as seen here. Row 1 ... (25 Replies)
Discussion started by: TheStruggle
25 Replies

2. Shell Programming and Scripting

Data filtering and category assigning

Please consider the following file, I have many groups which can be of 3 types, T1 (Serial_Number 1) T2 (Serial_Number 2) and T1*T2 (all other Serial_Number). I want to only consider groups that have both T1 and T2 present and their values are different from each other. In the example file,... (8 Replies)
Discussion started by: jianp83
8 Replies

3. Shell Programming and Scripting

Filtering out the data with dates

Hi, I have some data like seen below. format : apple(hhmm mm/dd).fruit apple(2345 03/25).fruit apple(2345 05/06).fruit orange(0443 05/02).fruit orange(0345 05/05).fruit orange(2134 05/04).fruit grape(0930 04/24).fruit grape(2330 03/30).fruit I need to get the data which are... (1 Reply)
Discussion started by: jayadanabalan
1 Replies

4. Shell Programming and Scripting

Filtering data using uniq and sed

Hello, Does anyone know an easy way to filter this type of file? I want to get everything that has score (column 2) 100.00 and get rid of duplicates (for example gi|332198263|gb|EGK18963.1| below), so I guess uniq can be used for this? gi|3379182634|gb|EGK18561.1| 100.00... (6 Replies)
Discussion started by: narachaid
6 Replies

5. Homework & Coursework Questions

awk - filtering data by if --> into an array

Use and complete the template provided. The entire template must be completed. If you don't, your post may be deleted! 1. The problem statement, all variables and given/known data: my data in csv-format ... ... 13/08/2012,16:30,303.30,5.10,3,2,2,1,9360.0,322... (13 Replies)
Discussion started by: IMPe
13 Replies

6. Shell Programming and Scripting

awk data filtering

I am trying to filter out some data with awk. If someone could help me that would be great. Below is my input file. Date: 10-JUN-12 12:00:00 B 0: 00 00 00 00 10 00 16 28 B 120: 00 00 00 39 53 32 86 29 Date: 10-JUN-12 12:00:10 B 0: 00 00 00 00 10 01 11 22 B 120: 00 00 00 29 23 32 16 29... (5 Replies)
Discussion started by: thibodc
5 Replies

7. Shell Programming and Scripting

Filtering data using AWK

Hi , i have file with delimiter as "|" and data in Double codes for all fields. how to filter data in a column like awk -F"|" '$1="asdf" {print $0}' test. ex : "asdf"|"zxcv" Thanks, Soma (1 Reply)
Discussion started by: challamsomu
1 Replies

8. Shell Programming and Scripting

help need in filtering data

Hello Gurus, Please help me out of the problem. I ve a input file as below input clock; input a; //reset all input b; //input comment output c; output d; output e; input f; //output comment I need the output as follows: \\Inputs (1 Reply)
Discussion started by: user_prady
1 Replies

9. UNIX for Dummies Questions & Answers

Filtering Data

file1 contain: (this just a small sample of data it may have thousand of lines) 1 aaa 1/01/1975 delhi 2 bbb 2/03/1977 mumbai 3 ccc 1/01/1975 mumbai 4 ddd 2/03/1977 chennai 5 aaa 1/01/1975 kolkatta 6 bbb 2/03/1977 bangalore program: nawk '{ idx= $2 SUBSEP $3 arr = (idx in arr) ?... (2 Replies)
Discussion started by: bobo
2 Replies

10. UNIX for Dummies Questions & Answers

Filtering out data ...

I have following command which tells me File size in GBs which are greater than 0.01GBs recursively in a dir structure. ls -l -R | awk '{ if ($5/1073741824 >= 0.01) print $9, $5/1073741824 }' But there are some files whom I dont have enough permissions, after executing this script gives me... (1 Reply)
Discussion started by: videsh77
1 Replies
Login or Register to Ask a Question