Extracting column if above certain values and repeated over a number of times continuously Post: 302455803

Sponsored Content

Top Forums UNIX for Dummies Questions & Answers Extracting column if above certain values and repeated over a number of times continuously Post 302455803 by newbeeuk on Wednesday 22nd of September 2010 12:21:26 PM

09-22-2010

Registered User

Extracting column if above certain values and repeated over a number of times continuously

Hi
I am new to the forum and would like to ask:
i have a file in form with thousands of column

Code:

id.1   A01   A01   A68   A68       
id.2   A5   A5   A3   A3       
1001   0   0   0.136   0.136       
1002   0   0   0.262   0.183       
1003   0   0   0.662   0.662       
1004   0   0   0.758   0.607       
1005   0   0   0.855   0.855       
1006   0   0   0.867   0.867       
1007   0   0   0.872   0.692       
1008   0   0   0.902   0.902       
1009   0   0   0.906   0.906

and thousnds rows.....

Code:

1317   0   0   0.3   1       
1318   0   0   0.3   0.618       
1319   0   0   0.3   1       
1320   0   0   0.3   1

Except for the header 2 rows, i would like to extract the part of the column (together with the header 2 row and first index column)
if
the value of the column is above say 0.35
and is continuous in the same column for say 50 rows

One step further is to see if it is possible to allow for a certain number of interruption, say 50 rows with at most 2 rows have value lower than set

Thanks for suggesting command to solve this

Last edited by vbe; 09-22-2010 at 01:56 PM.. Reason: use code tags, it will keep the format...

newbeeuk

View Public Profile for newbeeuk

Find all posts by newbeeuk

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

how many times does this repeated sequence exist

need a script to determine daily how many times does the below repeated sequence exist in a log file, and if it shows failure to connect in the same file 200 PORT Command successful. 150 Opening BINARY mode data connection for rgr016.daily.0305. 226 Transfer complete. local: rgr016.daily.0306...

2. UNIX for Dummies Questions & Answers

To get the total of how many times the pattern is repeated.

Hi, I need the total of how many times the pattern is being repeated in a particular file. I tried with grep as below, but no go. grep -c best sample Contents of Sample file: ----------------------- This is the best site I have never come across. The best one indeed. Very best...

3. UNIX for Dummies Questions & Answers

Extracting rows from a text file based on numerical values of a column

I have a text file where the second column is a list of numbers going from small to large. I want to extract the rows where the second column is smaller than or equal to 0.0001. My input: rs10082730 9e-08 12 46002702 rs2544081 1e-07 12 46015487 rs1425136 1e-06 7 35396742 rs2712590...

4. UNIX for Dummies Questions & Answers

Extracting rows from a space delimited text file based on the values of a column

I have a space delimited text file. I want to extract rows where the third column has 0 as a value and write those rows into a new space delimited text file. How do I go about doing that? Thanks!

5. Shell Programming and Scripting

Script for extracting data from csv file based on column values.

Hi all, I am new to shell script.I need your help to write a shell script. I need to write a shell script to extract data from a .csv file where columns are ',' separated. The file has 5 columns having values say column 1,column 2.....column 5 as below along with their valuesm....

6. Shell Programming and Scripting

Choosing between repeated entries based on the "absolute values" of a column

Hello, I was looking for a way to select between the repeated entries (column1) based on the values of absolute values of column 3 (larger value). For example if the same gene id has FC value -2 and 1, I should get the output as -2. Kindly help. GeneID Description FC ...

7. Homework & Coursework Questions

Accepting a phrase and counting the number of times that it is repeated in a specific website

1. The problem statement, all variables and given/known data: Develop a shell script that accepts a phrase and counts the number of times that it is repeated in a specific website. Note: Im not sure if it's the whole website, or just a specific page but im guessing its thewhole website. ...

8. Shell Programming and Scripting

Extracting unique values of a column from a feed file

Hi Folks, I have the below feed file named abc1.txt in which you can see there is a title and below is the respective values in the rows and it is completely pipe delimited file ,. ...

9. UNIX for Dummies Questions & Answers

Append no of times a column is repeated at the end

Hi folks, Iam working on a bash script, i need to print how many times column 2 repeated at the end of each line. Input.txt COL1 COL2 COL3 COL4 1 XX 45 N 2 YY 34 y 3 ZZ 44 N 4 XX 89 Y 5 XX 45 N 6 YY 84 D 7 ZZ 22 S Output.txt COL1 COL2 COL3 COL4 COL5 1 XX 45 N 3 2 YY 34...

10. Shell Programming and Scripting

Extracting values based on line-column numbers from multiple text files

Dear All, I have to solve the following problems with multiple tab-separated text file but I don't know how. Any help would be greatly appreciated. I have access to Linux mint (but not as a professional). I have multiple tab-delimited files with the following structure: file1: 1 44 2 ...

LEARN ABOUT PHP

db2_field_scale

DB2_FIELD_SCALE(3)							 1							DB2_FIELD_SCALE(3)

db2_field_scale - Returns the scale of the indicated column in a result set

SYNOPSIS

       int db2_field_scale (resource  $stmt, mixed  $column)

DESCRIPTION

	Returns the scale of the indicated column in a result set.

PARAMETERS

	      o $stmt
		- Specifies a statement resource containing a result set.

	      o $column
		-  Specifies  the  column in the result set. This can either be an integer representing the 0-indexed position of the column, or a
		string containing the name of the column.

RETURN VALUES

	Returns an integer containing the  scale  of  the  specified  column.  If  the	specified  column  does  not  exist  in  the  result  set,
       db2_field_scale(3) returns FALSE.

SEE ALSO

       db2_field_display_size(3), db2_field_name(3), db2_field_num(3), db2_field_precision(3), db2_field_type(3), db2_field_width(3).

PHP Documentation Group 													DB2_FIELD_SCALE(3)