Filtering based on column values


 
Thread Tools Search this Thread
Top Forums UNIX for Beginners Questions & Answers Filtering based on column values
# 22  
Old 05-27-2017
od output:
Code:
0000000   #   C   H   R   O   M  \t   P   O   S  \t   I   D  \t   R   E
         23  43  48  52  4f  4d  09  50  4f  53  09  49  44  09  52  45
0000020   F  \t   A   L   T  \t   Q   U   A   L  \t   F   I   L   T   E
         46  09  41  4c  54  09  51  55  41  4c  09  46  49  4c  54  45
0000040   R  \t   I   N   F   O  \t   F   O   R   M   A   T  \r  \n   c
         52  09  49  4e  46  4f  09  46  4f  52  4d  41  54  0d  0a  63
0000060   h   r   1  \t   6   5   8   7   2  \t   .  \t   T  \t   G  \t
         68  72  31  09  36  35  38  37  32  09  2e  09  54  09  47  09
0000100   2   4   8   0   .   5   1  \t   .  \t   A   C   =   6   5   ;
         32  34  38  30  2e  35  31  09  2e  09  41  43  3d  36  35  3b
0000120   A   N   =   9   2   ;   S   F   =   0   ,   1   ;   V   R   T
         41  4e  3d  39  32  3b  53  46  3d  30  2c  31  3b  56  52  54
0000140   =   1  \t   G   T   :   G   Q   :   D   P   :   A   D   :   P
         3d  31  09  47  54  3a  47  51  3a  44  50  3a  41  44  3a  50
0000160   L  \r  \n   c   h   r   1  \t   6   5   8   9   3  \t   .  \t
         4c  0d  0a  63  68  72  31  09  36  35  38  39  33  09  2e  09
0000200   G  \t   A  \t   4   3   3   .   7   7  \t   .  \t   A   C   =
         47  09  41  09  34  33  33  2e  37  37  09  2e  09  41  43  3d
0000220   3   ;   A   N   =   4   ;   S   F   =   0   ,   1   ;   V   R
         33  3b  41  4e  3d  34  3b  53  46  3d  30  2c  31  3b  56  52
0000240   T   =   1  \t   G   T   :   G   Q   :   P   L   :   A   D   :
         54  3d  31  09  47  54  3a  47  51  3a  50  4c  3a  41  44  3a
0000260   D   P  \r  \n   c   h   r   1  \t   6   5   8   9   8  \t   .
         44  50  0d  0a  63  68  72  31  09  36  35  38  39  38  09  2e
0000300  \t   T  \t   C  \t   2   0   5   5   .   1   1  \t   .  \t   A
         09  54  09  43  09  32  30  35  35  2e  31  31  09  2e  09  41
0000320   C   =   7   ;   A   N   =   1   0   ;   S   F   =   0   ,   1
         43  3d  37  3b  41  4e  3d  31  30  3b  53  46  3d  30  2c  31
0000340   ;   V   R   T   =   1  \t   G   T   :   D   P   :   A   D   :
         3b  56  52  54  3d  31  09  47  54  3a  44  50  3a  41  44  3a
0000360   P   L   :   G   Q  \r  \n   c   h   r   1  \t   6   9   5   1
         50  4c  3a  47  51  0d  0a  63  68  72  31  09  36  39  35  31
0000400   1  \t   r   s   7   5   0   6   2   6   6   1  \t   A  \t   G
         31  09  72  73  37  35  30  36  32  36  36  31  09  41  09  47
0000420  \t   8   2   2   3   3   3  \t   .  \t   A   C   =   8   9   4
         09  38  32  32  33  33  33  09  2e  09  41  43  3d  38  39  34
0000440   ;   A   N   =   9   3   4   ;   S   F   =   0   ,   1   ;   V
         3b  41  4e  3d  39  33  34  3b  53  46  3d  30  2c  31  3b  56
0000460   R   T   =   1  \t   G   T   :   G   Q   :   D   P   :   A   D
         52  54  3d  31  09  47  54  3a  47  51  3a  44  50  3a  41  44
0000500   :   P   L  \r  \n   c   h   r   1  \t   6   9   5   5   2  \t
         3a  50  4c  0d  0a  63  68  72  31  09  36  39  35  35  32  09
0000520   r   s   5   5   8   7   4   1   3   2  \t   G  \t   C  \t   7
         72  73  35  35  38  37  34  31  33  32  09  47  09  43  09  37
0000540   3   .   2   1  \t   .  \t   A   C   =   2   0   ;   A   N   =
         33  2e  32  31  09  2e  09  41  43  3d  32  30  3b  41  4e  3d
0000560   2   2   ;   S   F   =   0   ,   1   ;   V   R   T   =   1  \t
         32  32  3b  53  46  3d  30  2c  31  3b  56  52  54  3d  31  09
0000600   G   T   :   P   L   :   A   D   :   D   P   :   G   Q  \r  \n
         47  54  3a  50  4c  3a  41  44  3a  44  50  3a  47  51  0d  0a
0000620   c   h   r   1  \t   7   2   1   4   5   0  \t   r   s   2   9
         63  68  72  31  09  37  32  31  34  35  30  09  72  73  32  39
0000640   7   7   6   7   5  \t   G  \t   A  \t   1   8   2   4   3   .
         37  37  36  37  35  09  47  09  41  09  31  38  32  34  33  2e
0000660   4  \t   .  \t   A   C   =   9   5   ;   A   N   =   1   8   8
         34  09  2e  09  41  43  3d  39  35  3b  41  4e  3d  31  38  38
0000700   ;   S   F   =   0   ,   1   ;   V   R   T   =   1  \t   G   T
         3b  53  46  3d  30  2c  31  3b  56  52  54  3d  31  09  47  54
0000720   :   P   L   :   A   D   :   D   P   :   G   Q  \r  \n   c   h
         3a  50  4c  3a  41  44  3a  44  50  3a  47  51  0d  0a  63  68
0000740   r   1  \t   7   2   1   6   4   5  \t   .  \t   G  \t   C  \t
         72  31  09  37  32  31  36  34  35  09  2e  09  47  09  43  09
0000760   5   5   8   .   3   5  \t   .  \t   A   C   =   1   ;   A   N
         35  35  38  2e  33  35  09  2e  09  41  43  3d  31  3b  41  4e
0001000   =   2   ;   S   F   =   0   ;   V   R   T   =   1  \t   G   T
         3d  32  3b  53  46  3d  30  3b  56  52  54  3d  31  09  47  54
0001020   :   P   L   :   A   D   :   D   P   :   G   Q  \r  \n   c   h
         3a  50  4c  3a  41  44  3a  44  50  3a  47  51  0d  0a  63  68
0001040   r   1  \t   7   2   1   6   9   4  \t   .  \t   A  \t   G  \t
         72  31  09  37  32  31  36  39  34  09  2e  09  41  09  47  09
0001060   7   6   0   3   .   5  \t   .  \t   A   C   =   1   2   ;   A
         37  36  30  33  2e  35  09  2e  09  41  43  3d  31  32  3b  41
0001100   N   =   2   4   ;   S   F   =   0   ,   1   ;   V   R   T   =
         4e  3d  32  34  3b  53  46  3d  30  2c  31  3b  56  52  54  3d
0001120   1  \t   G   T   :   G   Q   :   D   P   :   A   D   :   P   L
         31  09  47  54  3a  47  51  3a  44  50  3a  41  44  3a  50  4c
0001140  \r  \n   c   h   r   1  \t   7   2   1   7   0   5  \t   r   s
         0d  0a  63  68  72  31  09  37  32  31  37  30  35  09  72  73
0001160   1   5   1   0   7   2   0   7   3  \t   A  \t   G  \t   5   3
         31  35  31  30  37  32  30  37  33  09  41  09  47  09  35  33
0001200   1   1   .   0   8  \t   .  \t   A   C   =   1   1   ;   A   N
         31  31  2e  30  38  09  2e  09  41  43  3d  31  31  3b  41  4e
0001220   =   2   2   ;   S   F   =   0   ,   1   ;   V   R   T   =   1
         3d  32  32  3b  53  46  3d  30  2c  31  3b  56  52  54  3d  31
0001240  \t   G   T   :   D   P   :   A   D   :   P   L   :   G   Q  \r
         09  47  54  3a  44  50  3a  41  44  3a  50  4c  3a  47  51  0d
0001260  \n   c   h   r   1  \t   7   2   1   7   5   7  \t   r   s   1
         0a  63  68  72  31  09  37  32  31  37  35  37  09  72  73  31
0001300   8   9   1   4   7   6   4   2  \t   T  \t   A  \t   3   3   3
         38  39  31  34  37  36  34  32  09  54  09  41  09  33  33  33
0001320   6   6   .   5  \t   .  \t   A   C   =   1   0   2   ;   A   N
         36  36  2e  35  09  2e  09  41  43  3d  31  30  32  3b  41  4e
0001340   =   2   0   2   ;   S   F   =   0   ,   1   ;   V   R   T   =
         3d  32  30  32  3b  53  46  3d  30  2c  31  3b  56  52  54  3d
0001360   1  \t   G   T   :   D   P   :   P   L   :   A   D   :   G   Q
         31  09  47  54  3a  44  50  3a  50  4c  3a  41  44  3a  47  51
0001400  \r  \n   c   h   r   1  \t   7   2   1   7   8   8  \t   .  \t
         0d  0a  63  68  72  31  09  37  32  31  37  38  38  09  2e  09
0001420   T  \t   C  \t   1   1   9   3   .   6   4  \t   .  \t   A   C
         54  09  43  09  31  31  39  33  2e  36  34  09  2e  09  41  43
0001440   =   6   ;   A   N   =   1   2   ;   S   F   =   0   ,   1   ;
         3d  36  3b  41  4e  3d  31  32  3b  53  46  3d  30  2c  31  3b
0001460   V   R   T   =   1  \t   G   T   :   G   Q   :   P   L   :   A
         56  52  54  3d  31  09  47  54  3a  47  51  3a  50  4c  3a  41
0001500   D   :   D   P  \r  \n   c   h   r   1  \t   7   5   2   9   2
         44  3a  44  50  0d  0a  63  68  72  31  09  37  35  32  39  32
0001520   8  \t   .  \t   C  \t   T  \t   1   4   6   .   5   8  \t   .
         38  09  2e  09  43  09  54  09  31  34  36  2e  35  38  09  2e
0001540  \t   A   C   =   7   ;   A   N   =   1   4   ;   S   F   =   0
         09  41  43  3d  37  3b  41  4e  3d  31  34  3b  53  46  3d  30
0001560   ,   1   ;   V   R   T   =   1  \t   G   T   :   G   Q   :   D
         2c  31  3b  56  52  54  3d  31  09  47  54  3a  47  51  3a  44
0001600   P   :   A   D   :   P   L  \r  \n   c   h   r   1  \t   7   5
         50  3a  41  44  3a  50  4c  0d  0a  63  68  72  31  09  37  35
0001620   2   9   9   6  \t   .  \t   T  \t   C  \t   1   2   3   .   0
         32  39  39  36  09  2e  09  54  09  43  09  31  32  33  2e  30
0001640   7  \t   .  \t   A   C   =   1   ;   A   N   =   2   ;   S   F
         37  09  2e  09  41  43  3d  31  3b  41  4e  3d  32  3b  53  46
0001660   =   1   ;   V   R   T   =   1  \t   G   T   :   D   P   :   P
         3d  31  3b  56  52  54  3d  31  09  47  54  3a  44  50  3a  50
0001700   L   :   A   D   :   G   Q  \r  \n   c   h   r   1  \t   7   6
         4c  3a  41  44  3a  47  51  0d  0a  63  68  72  31  09  37  36
0001720   2   1   0   9  \t   .  \t   C  \t   T  \t   1   5   3   3   0
         32  31  30  39  09  2e  09  43  09  54  09  31  35  33  33  30
0001740   2  \t   .  \t   A   C   =   1   0   2   ;   A   N   =   2   0
         32  09  2e  09  41  43  3d  31  30  32  3b  41  4e  3d  32  30
0001760   4   ;   S   F   =   0   ,   1   ;   V   R   T   =   1  \t   G
         34  3b  53  46  3d  30  2c  31  3b  56  52  54  3d  31  09  47
0002000   T   :   P   L   :   A   D   :   D   P   :   G   Q  \r  \n   c
         54  3a  50  4c  3a  41  44  3a  44  50  3a  47  51  0d  0a  63
0002020   h   r   1  \t   7   6   2   1   8   7  \t   r   s   1   4   4
         68  72  31  09  37  36  32  31  38  37  09  72  73  31  34  34
0002040   0   1   5   2   0   9  \t   C  \t   T  \t   5   4   5   1   .
         30  31  35  32  30  39  09  43  09  54  09  35  34  35  31  2e
0002060   6   5  \t   .  \t   A   C   =   1   ;   A   N   =   2   ;   S
         36  35  09  2e  09  41  43  3d  31  3b  41  4e  3d  32  3b  53
0002100   F   =   0   ;   V   R   T   =   1  \t   G   T   :   G   Q   :
         46  3d  30  3b  56  52  54  3d  31  09  47  54  3a  47  51  3a
0002120   A   D   :   P   L   :   D   P  \r  \n   c   h   r   1  \t   7
         41  44  3a  50  4c  3a  44  50  0d  0a  63  68  72  31  09  37
0002140   6   2   2   1   5  \t   .  \t   A  \t   T  \t   1   9   0   8
         36  32  32  31  35  09  2e  09  41  09  54  09  31  39  30  38
0002160   8   .   7  \t   .  \t   A   C   =   3   ;   A   N   =   6   ;
         38  2e  37  09  2e  09  41  43  3d  33  3b  41  4e  3d  36  3b
0002200   S   F   =   1   ;   V   R   T   =   1  \t   G   T   :   D   P
         53  46  3d  31  3b  56  52  54  3d  31  09  47  54  3a  44  50
0002220   :   P   L   :   A   D   :   G   Q  \r  \n   c   h   r   1  \t
         3a  50  4c  3a  41  44  3a  47  51  0d  0a  63  68  72  31  09
0002240   7   6   2   2   7   3  \t   r   s   3   1   1   5   8   4   9
         37  36  32  32  37  33  09  72  73  33  31  31  35  38  34  39
0002260  \t   G  \t   A  \t   3   2   6   3   6   5   0  \t   .  \t   A
         09  47  09  41  09  33  32  36  33  36  35  30  09  2e  09  41
0002300   C   =   1   1   4   8   ;   A   N   =   1   4   2   6   ;   S
         43  3d  31  31  34  38  3b  41  4e  3d  31  34  32  36  3b  53
0002320   F   =   0   ,   1   ;   V   R   T   =   1  \t   G   T   :   G
         46  3d  30  2c  31  3b  56  52  54  3d  31  09  47  54  3a  47
0002340   Q   :   P   L   :   A   D   :   D   P  \r  \n   c   h   r   1
         51  3a  50  4c  3a  41  44  3a  44  50  0d  0a  63  68  72  31
0002360  \t   7   6   2   3   0   7  \t   .  \t   G  \t   A  \t   1   5
         09  37  36  32  33  30  37  09  2e  09  47  09  41  09  31  35
0002400   1   5   .   1   2  \t   .  \t   A   C   =   2   ;   A   N   =
         31  35  2e  31  32  09  2e  09  41  43  3d  32  3b  41  4e  3d
0002420   4   ;   S   F   =   1   ;   V   R   T   =   1  \t   G   T   :
         34  3b  53  46  3d  31  3b  56  52  54  3d  31  09  47  54  3a
0002440   G   Q   :   P   L   :   A   D   :   D   P  \r  \n   c   h   r
         47  51  3a  50  4c  3a  41  44  3a  44  50  0d  0a  63  68  72
0002460   1  \t   7   6   2   3   2   0  \t   r   s   7   5   3   3   3
         31  09  37  36  32  33  32  30  09  72  73  37  35  33  33  33
0002500   6   6   8  \t   C  \t   T  \t   3   9   9   8   2   .   2  \t
         36  36  38  09  43  09  54  09  33  39  39  38  32  2e  32  09
0002520   .  \t   A   C   =   1   8   ;   A   N   =   3   4   ;   S   F
         2e  09  41  43  3d  31  38  3b  41  4e  3d  33  34  3b  53  46
0002540   =   0   ,   1   ;   V   R   T   =   1  \t   G   T   :   G   Q
         3d  30  2c  31  3b  56  52  54  3d  31  09  47  54  3a  47  51
0002560   :   D   P   :   P   L   :   A   D  \r  \n   c   h   r   1  \t
         3a  44  50  3a  50  4c  3a  41  44  0d  0a  63  68  72  31  09
0002600   7   6   2   3   3   0  \t   r   s   7   4   0   4   5   2   1
         37  36  32  33  33  30  09  72  73  37  34  30  34  35  32  31
0002620   7  \t   G  \t   T  \t   5   6   9   9   4   .   8  \t   .  \t
         37  09  47  09  54  09  35  36  39  39  34  2e  38  09  2e  09
0002640   A   C   =   4   8   ;   A   N   =   9   6   ;   S   F   =   0
         41  43  3d  34  38  3b  41  4e  3d  39  36  3b  53  46  3d  30
0002660   ,   1   ;   V   R   T   =   1  \t   G   T   :   G   Q   :   D
         2c  31  3b  56  52  54  3d  31  09  47  54  3a  47  51  3a  44
0002700   P   :   A   D   :   P   L  \r  \n   c   h   r   1  \t   7   6
         50  3a  41  44  3a  50  4c  0d  0a  63  68  72  31  09  37  36
0002720   2   3   4   5  \t   r   s   7   4   0   4   5   2   1   8  \t
         32  33  34  35  09  72  73  37  34  30  34  35  32  31  38  09
0002740   A  \t   G  \t   5   2   4   2   8   .   7  \t   .  \t   A   C
         41  09  47  09  35  32  34  32  38  2e  37  09  2e  09  41  43
0002760   =   5   5   ;   A   N   =   1   1   0   ;   S   F   =   0   ,
         3d  35  35  3b  41  4e  3d  31  31  30  3b  53  46  3d  30  2c
0003000   1   ;   V   R   T   =   1  \t   G   T   :   G   Q   :   D   P
         31  3b  56  52  54  3d  31  09  47  54  3a  47  51  3a  44  50
0003020   :   A   D   :   P   L  \r  \n   c   h   r   1  \t   7   6   2
         3a  41  44  3a  50  4c  0d  0a  63  68  72  31  09  37  36  32
0003040   3   5   2  \t   .  \t   C  \t   G  \t   5   0   9   .   1   2
         33  35  32  09  2e  09  43  09  47  09  35  30  39  2e  31  32
0003060  \t   .  \t   A   C   =   2   ;   A   N   =   4   ;   S   F   =
         09  2e  09  41  43  3d  32  3b  41  4e  3d  34  3b  53  46  3d
0003100   1   ;   V   R   T   =   1  \t   G   T   :   P   L   :   A   D
         31  3b  56  52  54  3d  31  09  47  54  3a  50  4c  3a  41  44
0003120   :   D   P   :   G   Q  \r  \n   c   h   r   1  \t   7   6   2
         3a  44  50  3a  47  51  0d  0a  63  68  72  31  09  37  36  32
0003140   4   0   9  \t   .  \t   G  \t   C  \t   4   2   3   .   6   7
         34  30  39  09  2e  09  47  09  43  09  34  32  33  2e  36  37
0003160  \t   .  \t   A   C   =   2   ;   A   N   =   4   ;   S   F   =
         09  2e  09  41  43  3d  32  3b  41  4e  3d  34  3b  53  46  3d
0003200   1   ;   V   R   T   =   1  \t   G   T   :   G   Q   :   D   P
         31  3b  56  52  54  3d  31  09  47  54  3a  47  51  3a  44  50
0003220   :   A   D   :   P   L  \r  \n   c   h   r   1  \t   7   6   2
         3a  41  44  3a  50  4c  0d  0a  63  68  72  31  09  37  36  32
0003240   4   7   2  \t   r   s   1   4   5   4   9   3   2   0   5  \t
         34  37  32  09  72  73  31  34  35  34  39  33  32  30  35  09
0003260   C  \t   T  \t   1   6   1   6   4   .   7  \t   .  \t   A   C
         43  09  54  09  31  36  31  36  34  2e  37  09  2e  09  41  43
0003300   =   1   7   6   ;   A   N   =   3   3   8   ;   S   F   =   0
         3d  31  37  36  3b  41  4e  3d  33  33  38  3b  53  46  3d  30
0003320   ,   1   ;   V   R   T   =   1  \t   G   T   :   D   P   :   A
         2c  31  3b  56  52  54  3d  31  09  47  54  3a  44  50  3a  41
0003340   D   :   P   L   :   G   Q  \r  \n   c   h   r   1  \t   7   6
         44  3a  50  4c  3a  47  51  0d  0a  63  68  72  31  09  37  36
0003360   2   4   8   5  \t   r   s   1   4   8   9   8   9   2   7   4
         32  34  38  35  09  72  73  31  34  38  39  38  39  32  37  34
0003400  \t   C  \t   A  \t   1   9   1   4   1  \t   .  \t   A   C   =
         09  43  09  41  09  31  39  31  34  31  09  2e  09  41  43  3d
0003420   1   8   7   ;   A   N   =   3   5   8   ;   S   F   =   0   ,
         31  38  37  3b  41  4e  3d  33  35  38  3b  53  46  3d  30  2c
0003440   1   ;   V   R   T   =   1  \t   G   T   :   D   P   :   P   L
         31  3b  56  52  54  3d  31  09  47  54  3a  44  50  3a  50  4c
0003460   :   A   D   :   G   Q  \r  \n   c   h   r   1  \t   7   6   2
         3a  41  44  3a  47  51  0d  0a  63  68  72  31  09  37  36  32
0003500   4   8   6  \t   .  \t   A  \t   G  \t   4   2   1   .   4   3
         34  38  36  09  2e  09  41  09  47  09  34  32  31  2e  34  33
0003520  \t   .  \t   A   C   =   6   ;   A   N   =   1   2   ;   S   F
         09  2e  09  41  43  3d  36  3b  41  4e  3d  31  32  3b  53  46
0003540   =   0   ,   1   ;   V   R   T   =   1  \t   G   T   :   G   Q
         3d  30  2c  31  3b  56  52  54  3d  31  09  47  54  3a  47  51
0003560   :   A   D   :   P   L   :   D   P  \r  \n   c   h   r   1  \t
         3a  41  44  3a  50  4c  3a  44  50  0d  0a  63  68  72  31  09
0003600   7   6   2   4   9   4  \t   .  \t   C  \t   G  \t   1   3   5
         37  36  32  34  39  34  09  2e  09  43  09  47  09  31  33  35
0003620   3   .   8   4  \t   .  \t   A   C   =   7   ;   A   N   =   1
         33  2e  38  34  09  2e  09  41  43  3d  37  3b  41  4e  3d  31
0003640   4   ;   S   F   =   0   ,   1   ;   V   R   T   =   1  \t   G
         34  3b  53  46  3d  30  2c  31  3b  56  52  54  3d  31  09  47
0003660   T   :   D   P   :   A   D   :   P   L   :   G   Q  \r  \n   c
         54  3a  44  50  3a  41  44  3a  50  4c  3a  47  51  0d  0a  63
0003700   h   r   1  \t   7   6   2   5   3   8  \t   .  \t   G  \t   A
         68  72  31  09  37  36  32  35  33  38  09  2e  09  47  09  41
0003720  \t   1   7   6   .   1   4  \t   .  \t   A   C   =   3   ;   A
         09  31  37  36  2e  31  34  09  2e  09  41  43  3d  33  3b  41
0003740   N   =   6   ;   S   F   =   1   ;   V   R   T   =   1  \t   G
         4e  3d  36  3b  53  46  3d  31  3b  56  52  54  3d  31  09  47
0003760   T   :   G   Q   :   D   P   :   P   L   :   A   D  \r  \n   c
         54  3a  47  51  3a  44  50  3a  50  4c  3a  41  44  0d  0a  63
0004000   h   r   1  \t   7   7   7   3   1   8  \t   r   s   1   5   0
         68  72  31  09  37  37  37  33  31  38  09  72  73  31  35  30
0004020   5   8   0   9   1   0  \t   C  \t   T  \t   1   2   0   6   8
         35  38  30  39  31  30  09  43  09  54  09  31  32  30  36  38
0004040   .   5  \t   .  \t   A   C   =   8   ;   A   N   =   1   6   ;
         2e  35  09  2e  09  41  43  3d  38  3b  41  4e  3d  31  36  3b
0004060   S   F   =   0   ,   1   ;   V   R   T   =   1  \t   G   T   :
         53  46  3d  30  2c  31  3b  56  52  54  3d  31  09  47  54  3a
0004100   D   P   :   P   L   :   A   D   :   G   Q  \r  \n   c   h   r
         44  50  3a  50  4c  3a  41  44  3a  47  51  0d  0a  63  68  72
0004120   1  \t   7   7   7   4   3   7  \t   .  \t   A  \t   C  \t   1
         31  09  37  37  37  34  33  37  09  2e  09  41  09  43  09  31
0004140   6   0   2   .   6   5  \t   .  \t   A   C   =   2   ;   A   N
         36  30  32  2e  36  35  09  2e  09  41  43  3d  32  3b  41  4e
0004160   =   4   ;   S   F   =   1   ;   V   R   T   =   1  \t   G   T
         3d  34  3b  53  46  3d  31  3b  56  52  54  3d  31  09  47  54
0004200   :   G   Q   :   A   D   :   P   L   :   D   P  \r  \n   c   h
         3a  47  51  3a  41  44  3a  50  4c  3a  44  50  0d  0a  63  68
0004220   r   1  \t   7   7   7   4   5   6  \t   r   s   1   8   3   3
         72  31  09  37  37  37  34  35  36  09  72  73  31  38  33  33
0004240   0   7   0   2   8  \t   C  \t   T  \t   6   9   7   9   .   4
         30  37  30  32  38  09  43  09  54  09  36  39  37  39  2e  34
0004260   8  \t   .  \t   A   C   =   5   ;   A   N   =   1   0   ;   S
         38  09  2e  09  41  43  3d  35  3b  41  4e  3d  31  30  3b  53
0004300   F   =   0   ,   1   ;   V   R   T   =   1  \t   G   T   :   D
         46  3d  30  2c  31  3b  56  52  54  3d  31  09  47  54  3a  44
0004320   P   :   P   L   :   A   D   :   G   Q  \r  \n   c   h   r   1
         50  3a  50  4c  3a  41  44  3a  47  51  0d  0a  63  68  72  31
0004340  \t   7   7   7   5   1   3  \t   .  \t   G  \t   A  \t   6   3
         09  37  37  37  35  31  33  09  2e  09  47  09  41  09  36  33
0004360   1   5   .   8   9  \t   .  \t   A   C   =   1   7   ;   A   N
         31  35  2e  38  39  09  2e  09  41  43  3d  31  37  3b  41  4e
0004400   =   3   2   ;   S   F   =   0   ,   1   ;   V   R   T   =   1
         3d  33  32  3b  53  46  3d  30  2c  31  3b  56  52  54  3d  31
0004420  \t   G   T   :   G   Q   :   D   P   :   A   D   :   P   L  \r
         09  47  54  3a  47  51  3a  44  50  3a  41  44  3a  50  4c  0d
0004440  \n   c   h   r   1  \t   7   7   7   5   1   6  \t   .  \t   C
         0a  63  68  72  31  09  37  37  37  35  31  36  09  2e  09  43
0004460  \t   T  \t   1   5   1   2  \t   .  \t   A   C   =   3   ;   A
         09  54  09  31  35  31  32  09  2e  09  41  43  3d  33  3b  41
0004500   N   =   6   ;   S   F   =   0   ,   1   ;   V   R   T   =   1
         4e  3d  36  3b  53  46  3d  30  2c  31  3b  56  52  54  3d  31
0004520  \t   G   T   :   G   Q   :   D   P   :   A   D   :   P   L  \r
         09  47  54  3a  47  51  3a  44  50  3a  41  44  3a  50  4c  0d
0004540  \n   c   h   r   1  \t   7   7   7   5   7   5  \t   .  \t   G
         0a  63  68  72  31  09  37  37  37  35  37  35  09  2e  09  47
0004560  \t   A  \t   5   2   0   .   3   3  \t   .  \t   A   C   =   3
         09  41  09  35  32  30  2e  33  33  09  2e  09  41  43  3d  33
0004600   ;   A   N   =   6   ;   S   F   =   0   ,   1   ;   V   R   T
         3b  41  4e  3d  36  3b  53  46  3d  30  2c  31  3b  56  52  54
0004620   =   1  \t   G   T   :   P   L   :   A   D   :   D   P   :   G
         3d  31  09  47  54  3a  50  4c  3a  41  44  3a  44  50  3a  47
0004640   Q  \r  \n   c   h   r   1  \t   7   7   7   5   7   9  \t   .
         51  0d  0a  63  68  72  31  09  37  37  37  35  37  39  09  2e
0004660  \t   G  \t   A  \t   7   1   9   .   0   6  \t   .  \t   A   C
         09  47  09  41  09  37  31  39  2e  30  36  09  2e  09  41  43
0004700   =   3   ;   A   N   =   6   ;   S   F   =   1   ;   V   R   T
         3d  33  3b  41  4e  3d  36  3b  53  46  3d  31  3b  56  52  54
0004720   =   1  \t   G   T   :   D   P   :   P   L   :   A   D   :   G
         3d  31  09  47  54  3a  44  50  3a  50  4c  3a  41  44  3a  47
0004740   Q  \r  \n   c   h   r   1  \t   7   7   7   6   3   6  \t   .
         51  0d  0a  63  68  72  31  09  37  37  37  36  33  36  09  2e
0004760  \t   C  \t   T  \t   1   9   3   2   .   9  \t   .  \t   A   C
         09  43  09  54  09  31  39  33  32  2e  39  09  2e  09  41  43
0005000   =   7   ;   A   N   =   1   4   ;   S   F   =   0   ,   1   ;
         3d  37  3b  41  4e  3d  31  34  3b  53  46  3d  30  2c  31  3b
0005020   V   R   T   =   1  \t   G   T   :   G   Q   :   P   L   :   A
         56  52  54  3d  31  09  47  54  3a  47  51  3a  50  4c  3a  41
0005040   D   :   D   P  \r  \n   c   h   r   1  \t   7   8   3   0   7
         44  3a  44  50  0d  0a  63  68  72  31  09  37  38  33  30  37
0005060   1  \t   r   s   1   4   2   8   4   9   7   2   4  \t   C  \t
         31  09  72  73  31  34  32  38  34  39  37  32  34  09  43  09
0005100   T  \t   2   8   7   2   6   .   2  \t   .  \t   A   C   =   2
         54  09  32  38  37  32  36  2e  32  09  2e  09  41  43  3d  32
0005120   0   ;   A   N   =   3   8   ;   S   F   =   0   ,   1   ;   V
         30  3b  41  4e  3d  33  38  3b  53  46  3d  30  2c  31  3b  56
0005140   R   T   =   1  \t   G   T   :   G   Q   :   D   P   :   A   D
         52  54  3d  31  09  47  54  3a  47  51  3a  44  50  3a  41  44
0005160   :   P   L  \r  \n   c   h   r   1  \t   7   9   2   3   9   9
         3a  50  4c  0d  0a  63  68  72  31  09  37  39  32  33  39  39
0005200  \t   .  \t   A  \t   G  \t   1   3   0   8   .   2   6  \t   .
         09  2e  09  41  09  47  09  31  33  30  38  2e  32  36  09  2e
0005220  \t   A   C   =   5   ;   A   N   =   1   0   ;   S   F   =   0
         09  41  43  3d  35  3b  41  4e  3d  31  30  3b  53  46  3d  30
0005240   ,   1   ;   V   R   T   =   1  \t   G   T   :   G   Q   :   D
         2c  31  3b  56  52  54  3d  31  09  47  54  3a  47  51  3a  44
0005260   P   :   A   D   :   P   L  \r  \n   c   h   r   1  \t   8   6
         50  3a  41  44  3a  50  4c  0d  0a  63  68  72  31  09  38  36
0005300   1   4   5   3  \t   .  \t   C  \t   T  \t   2   7   7   .   1
         31  34  35  33  09  2e  09  43  09  54  09  32  37  37  2e  31
0005320   3  \t   .  \t   A   C   =   1   ;   A   N   =   2   ;   S   F
         33  09  2e  09  41  43  3d  31  3b  41  4e  3d  32  3b  53  46
0005340   =   1   ;   V   R   T   =   1  \t   G   T   :   A   D   :   P
         3d  31  3b  56  52  54  3d  31  09  47  54  3a  41  44  3a  50
0005360   L   :   D   P   :   G   Q  \r  \n   c   h   r   1  \t   8   6
         4c  3a  44  50  3a  47  51  0d  0a  63  68  72  31  09  38  36
0005400   5   5   8   4  \t   r   s   1   4   8   7   1   1   6   2   5
         35  35  38  34  09  72  73  31  34  38  37  31  31  36  32  35
0005420  \t   G  \t   A  \t   3   3   5   4   .   0   7  \t   .  \t   A
         09  47  09  41  09  33  33  35  34  2e  30  37  09  2e  09  41
0005440   C   =   3   ;   A   N   =   6   ;   S   F   =   0   ,   1   ;
         43  3d  33  3b  41  4e  3d  36  3b  53  46  3d  30  2c  31  3b
0005460   V   R   T   =   1  \t   G   T   :   G   Q   :   P   L   :   A
         56  52  54  3d  31  09  47  54  3a  47  51  3a  50  4c  3a  41
0005500   D   :   D   P  \r  \n   c   h   r   1  \t   8   6   5   6   2
         44  3a  44  50  0d  0a  63  68  72  31  09  38  36  35  36  32
0005520   4  \t   .  \t   C  \t   T  \t   1   3   1   0   .   5   6  \t
         34  09  2e  09  43  09  54  09  31  33  31  30  2e  35  36  09
0005540   .  \t   A   C   =   1   ;   A   N   =   2   ;   S   F   =   0
         2e  09  41  43  3d  31  3b  41  4e  3d  32  3b  53  46  3d  30
0005560   ;   V   R   T   =   1  \t   G   T   :   G   Q   :   P   L   :
         3b  56  52  54  3d  31  09  47  54  3a  47  51  3a  50  4c  3a
0005600   A   D   :   D   P  \r  \n   c   h   r   1  \t   8   6   5   6
         41  44  3a  44  50  0d  0a  63  68  72  31  09  38  36  35  36
0005620   2   8  \t   r   s   4   1   2   8   5   7   9   0  \t   G  \t
         32  38  09  72  73  34  31  32  38  35  37  39  30  09  47  09
0005640   A  \t   1   3   1   4   7   .   7  \t   .  \t   A   C   =   1
         41  09  31  33  31  34  37  2e  37  09  2e  09  41  43  3d  31
0005660   3   ;   A   N   =   2   6   ;   S   F   =   0   ,   1   ;   V
         33  3b  41  4e  3d  32  36  3b  53  46  3d  30  2c  31  3b  56
0005700   R   T   =   1  \t   G   T   :   G   Q   :   A   D   :   P   L
         52  54  3d  31  09  47  54  3a  47  51  3a  41  44  3a  50  4c
0005720   :   D   P  \r  \n   c   h   r   1  \t   8   6   5   6   6   2
         3a  44  50  0d  0a  63  68  72  31  09  38  36  35  36  36  32
0005740  \t   r   s   1   4   0   7   5   1   8   9   9  \t   G  \t   A
         09  72  73  31  34  30  37  35  31  38  39  39  09  47  09  41
0005760  \t   1   6   8   6   .   5   3  \t   .  \t   A   C   =   1   ;
         09  31  36  38  36  2e  35  33  09  2e  09  41  43  3d  31  3b
0006000   A   N   =   2   ;   S   F   =   0   ;   V   R   T   =   1  \t
         41  4e  3d  32  3b  53  46  3d  30  3b  56  52  54  3d  31  09
0006020   G   T   :   P   L   :   A   D   :   D   P   :   G   Q  \r  \n
         47  54  3a  50  4c  3a  41  44  3a  44  50  3a  47  51  0d  0a
0006040   c   h   r   1  \t   8   6   5   6   9   2  \t   .  \t   C  \t
         63  68  72  31  09  38  36  35  36  39  32  09  2e  09  43  09
0006060   G  \t   4   2   8   .   0   6  \t   .  \t   A   C   =   1   ;
         47  09  34  32  38  2e  30  36  09  2e  09  41  43  3d  31  3b
0006100   A   N   =   2   ;   S   F   =   0   ;   V   R   T   =   1  \t
         41  4e  3d  32  3b  53  46  3d  30  3b  56  52  54  3d  31  09
0006120   G   T   :   D   P   :   A   D   :   P   L   :   G   Q  \r  \n
         47  54  3a  44  50  3a  41  44  3a  50  4c  3a  47  51  0d  0a
0006140   c   h   r   1  \t   8   6   5   6   9   4  \t   r   s   9   9
         63  68  72  31  09  38  36  35  36  39  34  09  72  73  39  39
0006160   8   8   1   7   9  \t   C  \t   T  \t   9   9   3   4   .   8
         38  38  31  37  39  09  43  09  54  09  39  39  33  34  2e  38
0006200   1  \t   .  \t   A   C   =   1   4   ;   A   N   =   2   8   ;
         31  09  2e  09  41  43  3d  31  34  3b  41  4e  3d  32  38  3b
0006220   S   F   =   0   ,   1   ;   V   R   T   =   1  \t   G   T   :
         53  46  3d  30  2c  31  3b  56  52  54  3d  31  09  47  54  3a
0006240   G   Q   :   A   D   :   P   L   :   D   P  \r  \n   c   h   r
         47  51  3a  41  44  3a  50  4c  3a  44  50  0d  0a  63  68  72
0006260   1  \t   8   6   5   7   0   0  \t   r   s   1   1   6   7   3
         31  09  38  36  35  37  30  30  09  72  73  31  31  36  37  33
0006300   0   8   9   4  \t   C  \t   T  \t   4   5   1   5   .   7   9
         30  38  39  34  09  43  09  54  09  34  35  31  35  2e  37  39
0006320  \t   .  \t   A   C   =   3   ;   A   N   =   6   ;   S   F   =
         09  2e  09  41  43  3d  33  3b  41  4e  3d  36  3b  53  46  3d
0006340   0   ,   1   ;   V   R   T   =   1  \t   G   T   :   P   L   :
         30  2c  31  3b  56  52  54  3d  31  09  47  54  3a  50  4c  3a
0006360   A   D   :   D   P   :   G   Q  \r  \n   c   h   r   1  \t   8
         41  44  3a  44  50  3a  47  51  0d  0a  63  68  72  31  09  38
0006400   6   5   7   0   5  \t   r   s   1   4   6   3   3   1   7   7
         36  35  37  30  35  09  72  73  31  34  36  33  33  31  37  37
0006420   6  \t   C  \t   T  \t   1   6   2   6   .   2   1  \t   .  \t
         36  09  43  09  54  09  31  36  32  36  2e  32  31  09  2e  09
0006440   A   C   =   2   ;   A   N   =   4   ;   S   F   =   0   ,   1
         41  43  3d  32  3b  41  4e  3d  34  3b  53  46  3d  30  2c  31
0006460   ;   V   R   T   =   1  \t   G   T   :   P   L   :   A   D   :
         3b  56  52  54  3d  31  09  47  54  3a  50  4c  3a  41  44  3a
0006500   D   P   :   G   Q  \r  \n   c   h   r   1  \t   8   6   5   7
         44  50  3a  47  51  0d  0a  63  68  72  31  09  38  36  35  37
0006520   3   8  \t   r   s   1   3   9   5   7   0   4   9   0  \t   A
         33  38  09  72  73  31  33  39  35  37  30  34  39  30  09  41
0006540  \t   G  \t   1   7   7   7   5   .   3  \t   .  \t   A   C   =
         09  47  09  31  37  37  37  35  2e  33  09  2e  09  41  43  3d
0006560   2   1   ;   A   N   =   4   2   ;   S   F   =   0   ,   1   ;
         32  31  3b  41  4e  3d  34  32  3b  53  46  3d  30  2c  31  3b
0006600   V   R   T   =   1  \t   G   T   :   A   D   :   P   L   :   D
         56  52  54  3d  31  09  47  54  3a  41  44  3a  50  4c  3a  44
0006620   P   :   G   Q  \r  \n   c   h   r   1  \t   8   6   6   3   3
         50  3a  47  51  0d  0a  63  68  72  31  09  38  36  36  33  33
0006640   2  \t   .  \t   G  \t   C  \t   8   3   5   .   9   7  \t   .
         32  09  2e  09  47  09  43  09  38  33  35  2e  39  37  09  2e
0006660  \t   A   C   =   1   ;   A   N   =   2   ;   S   F   =   1   ;
         09  41  43  3d  31  3b  41  4e  3d  32  3b  53  46  3d  31  3b
0006700   V   R   T   =   1  \t   G   T   :   D   P   :   P   L   :   A
         56  52  54  3d  31  09  47  54  3a  44  50  3a  50  4c  3a  41
0006720   D   :   G   Q  \r  \n
         44  3a  47  51  0d  0a
0006726

for awk command am not sure what is the full command and if i should include a file at the end

Thanks
# 23  
Old 05-27-2017
Your file shows what we suspected. It is a file that have been saved from a msdos operating system. It needs to be converted to Unix like format, first.

Code:
perl -nle 's/\r$//; /SF=(\d+)/; print if $1 > 400 or $. == 1' real.txt

This User Gave Thanks to Aia For This Post:
# 24  
Old 05-27-2017
Thanks guys for your efforts and input. I did convert the file using dos2unix

however still same issue. it might be an issue with the file. will investigate more.

Thanks
# 25  
Old 05-28-2017
You MUST be kidding! Incredible! That file does NOT contain any SF value other than 0 or 1 :


Code:
awk '{print $5, $6, $7}' FS="[,;=]" file
  
SF 0 1
SF 0 1
SF 0 1
SF 0 1
SF 0 1
SF 0 1
SF 0 VRT
SF 0 1
SF 0 1
SF 0 1
SF 0 1
SF 0 1
SF 1 VRT
SF 0 1
SF 0 VRT
SF 1 VRT
SF 0 1
SF 1 VRT
SF 0 1
SF 0 1
SF 0 1
SF 1 VRT
SF 1 VRT
SF 0 1
SF 0 1
SF 0 1
SF 0 1
SF 1 VRT
SF 0 1
SF 1 VRT
SF 0 1
SF 0 1
SF 0 1
SF 0 1
SF 1 VRT
SF 0 1
SF 0 1
SF 0 1
SF 1 VRT
SF 0 1
SF 0 VRT
SF 0 1
SF 0 VRT
SF 0 VRT
SF 0 1
SF 0 1
SF 0 1
SF 0 1
SF 1 VRT

No surprise you have an empty output on all proposals! Unbelievable!
# 26  
Old 05-28-2017
File size is 2 giga. I am trying to investigate the original raw file in case its change.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Filtering records of a csv file based on a value of a column

Hi, I tried filtering the records in a csv file using "awk" command listed below. awk -F"~" '$4 ~ /Active/{print }' inputfile > outputfile The output always has all the entries. The same command worked for different users from one of the forum links. content of file I was... (3 Replies)
Discussion started by: sunilmudikonda
3 Replies

2. Shell Programming and Scripting

Concatenate values in the first column based on the second column.

I have a file (myfile.txt) with contents like this: 1.txt apple is 3.txt apple is 5.txt apple is 2.txt apple is a 7.txt apple is a 8.txt apple is a fruit 4.txt orange not a fruit 6.txt zero isThe above file is already sorted using this command: sort -k2 myfile.txtMy objective is to get... (3 Replies)
Discussion started by: shoaibjameel123
3 Replies

3. UNIX for Dummies Questions & Answers

Repositioning based on column values

Dear all ... I have a file which I want to change the structure based on the values in some columns and I would be grateful if you can help... one of my files looks like ... they all have ten rows 1,0,0 10,0,0 2,0,0 3,0,0 4,1,1 4,1,1 4,1,1 5,0,0 6,0,0 7,0,0 8,0.5,2 9,0.33,3 9,0.33,3... (1 Reply)
Discussion started by: A-V
1 Replies

4. Shell Programming and Scripting

Sum column values based in common identifier in 1st column.

Hi, I have a table to be imported for R as matrix or data.frame but I first need to edit it because I've got several lines with the same identifier (1st column), so I want to sum the each column (2nd -nth) of each identifier (1st column) The input is for example, after sorted: K00001 1 1 4 3... (8 Replies)
Discussion started by: sargotrons
8 Replies

5. Shell Programming and Scripting

Adding values of a column based on another column

Hello, I have a data such as this: ENSGALG00000000189 329 G A 4 2 0 ENSGALG00000000189 518 T C 5 1 0 ENSGALG00000000189 1104 G A 5 1 0 ENSGALG00000000187 3687 G T 5 1 0 ENSGALG00000000187 4533 A T 4 2 0 ENSGALG00000000233 5811 T C 4 2 0 ENSGALG00000000233 5998 C A 5 1 0 I want to... (3 Replies)
Discussion started by: Homa
3 Replies

6. Shell Programming and Scripting

Filtering lines for column elements based on corresponding counts in another column

Hi, I have a file like this ACC 2 2 21 aaa AC 443 3 22 aaa GCT 76 1 33 xxx TCG 34 2 33 aaa ACGT 33 1 22 ggg TTC 99 3 44 wee CCA 33 2 33 ggg AAC 1 3 55 ddd TTG 10 1 22 ddd TTGC 98 3 22 ddd GCT 23 1 21 sds GTC 23 4 32 sds ACGT 32 2 33 vvv CGT 11 2 33 eee CCC 87 2 44... (1 Reply)
Discussion started by: polsum
1 Replies

7. Shell Programming and Scripting

Perl: filtering lines based on duplicate values in a column

Hi I have a file like this. I need to eliminate lines with first column having the same value 10 times. 13 18 1 + chromosome 1, 122638287 AGAGTATGGTCGCGGTTG 13 18 1 + chromosome 1, 128904080 AGAGTATGGTCGCGGTTG 13 18 1 - chromosome 14, 13627938 CAACCGCGACCATACTCT 13 18 1 + chromosome 1,... (5 Replies)
Discussion started by: polsum
5 Replies

8. Shell Programming and Scripting

How to averaging column based on first column values

Hello I have file that consist of 2 columns of millions of entries timestamp and throughput I want to find the average (throughput ) for each equal timestamp before change it to proper format e.g : i want to average 2 coloumnd fot all 1308154800 values in column 1 and then print... (4 Replies)
Discussion started by: aadel
4 Replies

9. Shell Programming and Scripting

How to pick values from column based on key values by usin AWK

Dear Guyz:) I have 2 different input files like this. I would like to pick the values or letters from the inputfile2 based on inputfile1 keys (A,F,N,X,Z). I have done similar task by using awk but in that case the inputfiles are similar like in inputfile2 (all keys in 1st column and values in... (16 Replies)
Discussion started by: repinementer
16 Replies

10. UNIX for Dummies Questions & Answers

Filtering records of a file based on a value of a column

Hi all, I would like to extract records of a file based on a condition. The file contains 47 fields, and I would like to extract only those records that match a certain value in one of the columns, e.g. COL1 COL2 COL3 ............... COL47 1 XX 45 ... (4 Replies)
Discussion started by: risk_sly
4 Replies
Login or Register to Ask a Question