deleting rows under a certain condition Post: 302652231

Sponsored Content

Top Forums Shell Programming and Scripting deleting rows under a certain condition Post 302652231 by spacebar on Wednesday 6th of June 2012 06:44:41 PM

06-06-2012

Registered User

This is an example using 'sed':

Code:

$ cat test.txt
FID IID aspirpre statihos fibrahos ocholhos arbhos betabhos alphbhos cacbhos diurehos numbcig.x toast1 toast2 toast3 toast4 ischoth1 ischoth2 ischoth3 ischoth4
101 101 1 1 1 1 1 2 1 2 1 15 1 0 0 0 0 0 0 0
102 102 2 0 0 0 0 0 0 0 0 NA NA NA NA NA NA NA NA NA
103 103 2 2 1 1 1 2 1 1 1 NA 0 0 0 0 0 0 0 0
104 104 1 0 0 0 0 0 0 0 0 15 NA NA NA NA NA NA NA NA
105 105 1 2 1 1 1 1 1 1 1 NA 0 0 1 0 0 0 0 0
106 106 2 1 1 1 1 1 1 1 1 12 NA NA NA NA NA NA NA NA
107 107 1 2 1 1 1 1 1 1 1 15 0 0 1 0 0 0 0 0
108 108 1 1 1 1 2 1 1 2 2 NA 0 0 1 0 0 0 0 0
109 109 2 2 1 1 2 1 1 1 2 25 0 0 0 1 0 0 0 0
110 110 1 0 0 0 0 0 0 0 0 5 NA NA NA NA NA NA NA NA


$ sed '/NA NA NA NA NA NA NA NA$/d' test.txt
FID IID aspirpre statihos fibrahos ocholhos arbhos betabhos alphbhos cacbhos diurehos numbcig.x toast1 toast2 toast3 toast4 ischoth1 ischoth2 ischoth3 ischoth4
101 101 1 1 1 1 1 2 1 2 1 15 1 0 0 0 0 0 0 0
103 103 2 2 1 1 1 2 1 1 1 NA 0 0 0 0 0 0 0 0
105 105 1 2 1 1 1 1 1 1 1 NA 0 0 1 0 0 0 0 0
107 107 1 2 1 1 1 1 1 1 1 15 0 0 1 0 0 0 0 0
108 108 1 1 1 1 2 1 1 2 2 NA 0 0 1 0 0 0 0 0
109 109 2 2 1 1 2 1 1 1 2 25 0 0 0 1 0 0 0 0

if those are tabs(x'09') and not spaces between the columns you will need to use a '\t':

Code:

$ sed '/NA\tNA\tNA\tNA\tNA\tNA\tNA\tNA$/d' test.txt
FID     IID     aspirpre        statihos        fibrahos        ocholhos        arbhos  betabhos        alphbhos        cacbhos diurehos        numbcig.x   toast1   toast2  toast3  toast4  ischoth1        ischoth2        ischoth3        ischoth4
101     101     1       1       1       1       1       2       1       2       1       15      1       0       0       0       0       0       0       0
103     103     2       2       1       1       1       2       1       1       1       NA      0       0       0       0       0       0       0       0
105     105     1       2       1       1       1       1       1       1       1       NA      0       0       1       0       0       0       0       0
107     107     1       2       1       1       1       1       1       1       1       15      0       0       1       0       0       0       0       0
108     108     1       1       1       1       2       1       1       2       2       NA      0       0       1       0       0       0       0       0
109     109     2       2       1       1       2       1       1       1       2       25      0       0       0       1       0       0       0       0

This User Gave Thanks to spacebar For This Post:

spacebar

View Public Profile for spacebar

Find all posts by spacebar

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Deleting rows that begin with #

Hi, I have a file that has rows that start with # and ends with #. For example.. # hi text JK NM JK NM JK K JK NM # no # yes So I want to remove the #'s and put them into another file. so the output will be two files.. File 1: JK NM JK NM JK K JK NM

2. Shell Programming and Scripting

deleting rows that dont have ....

Hi I posted earlier. This is sorta similar but I want to delete rows that dont have R, T, Y or U. Nam1 RTYU Nam2 RRTT Nam3 RYTU Nam4 IRTT So the output would look like this? Nam1 RTYU Nam2 RRTT Nam3 RYTU too many problems thanks

3. Shell Programming and Scripting

Deleting specific rows in large files having rows greater than 100000

Hi Guys, I need help in modifying a large text file containing more than 1-2 lakh rows of data using unix commands. I am quite new to the unix language the text file contains data in a pipe delimited format sdfsdfs sdfsdfsd START_ROW sdfsd|sdfsdfsd|sdfsdfasdf|sdfsadf|sdfasdf...

4. Shell Programming and Scripting

Deleting of Specific Rows.

Fruit : Price : Quantity apple : 20 : 40 chiku : 40 :30 Hey guys, i have written a code using sed to delete a specific char which is being typed in. But the problem i am having is , how can i expand my coding to actually allow it do delete the whole row. For example,...

5. Shell Programming and Scripting

deleting rows that have certain characters

Hi, I want to delete rows whenever column one has the letters 'rpa'. The file is tab seperated. e.g. years 1 bears 1 cats 2 rpat 3 rpa99 4 rpa011 5 then removing 'rpa' containing rows based on the first column years 1 bears 1 cats 2 thanks

6. Shell Programming and Scripting

Parsing a CSV file and deleting all rows on condition

Hello list, I am working on a csv file which contains two fields per record which contain IP addresses. What I am trying to do is find records which have identical fields(IP addresses) which occur 4(four) times, and if they do, delete all records with that specific identical field(ip address). ...

7. Shell Programming and Scripting

selecting and deleting specific lines with condition

I have a set of data as below: The first field, $1 represent "|". The $3 (3rd field) and $6 (6th field) in my data file represent "number-molecule" which has arrangement as below: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 ...

8. UNIX for Dummies Questions & Answers

Deleting the unwanted data based on condition

hi i have my input data like this aaa bbb ccc asa dff nmj mnj saa dff oik aax cdx saa oik asq sdf dssi want my output file to be like this mnj saa dff oik aax cdx saa oiki want to retain only those lines which will have oik just below them and i want oik to be as next column to those...

9. Shell Programming and Scripting

Deleting the records based on the condition

Hi, Can any one help me, in deleting the records from the database table based on the following condition: script should take a configurable parameter as input. The input is nothing but �no. of years�. For example, if I enter 2 as input parameter, then the 2 year old records should get...

10. Shell Programming and Scripting

Average across rows with a condition

Hi Friends, My input file Gene1 10 20 0 Gene2 5 0 15 Gene3 10 10 10 Gene4 5 0 0 If there is a zero for any gene in any column, I don't want that column to be considered which reduces the denominator value during average. Here is my output Gene1 10 20 0 10 Gene2 5 0 15 10 Gene3...

LEARN ABOUT DEBIAN

bib1-attr

BIB-1 ATTRIBUTE SET(7)					   Conventions and miscellaneous				    BIB-1 ATTRIBUTE SET(7)

NAME

       bib1-attr - Bib-1 Attribute Set

DESCRIPTION

       This reference entry lists the Bib-1 attribute set types and values.

TYPES

       The Bib-1 attribute defines six attribute types: Use (1), Relation (2), Position (3), Structure (4), Truncation (5) and completeness (6).

USE (1)
	       1     Personal-name
	       2     Corporate-name
	       3     Conference-name
	       4     Title
	       5     Title-series
	       6     Title-uniform
	       7     ISBN
	       8     ISSN
	       9     LC-card-number
	       10    BNB-card-number
	       11    BGF-number
	       12    Local-number
	       13    Dewey-classification
	       14    UDC-classification
	       15    Bliss-classification
	       16    LC-call-number
	       17    NLM-call-number
	       18    NAL-call-number
	       19    MOS-call-number
	       20    Local-classification
	       21    Subject-heading
	       22    Subject-Rameau
	       23    BDI-index-subject
	       24    INSPEC-subject
	       25    MESH-subject
	       26    PA-subject
	       27    LC-subject-heading
	       28    RVM-subject-heading
	       29    Local-subject-index
	       30    Date
	       31    Date-of-publication
	       32    Date-of-acquisition
	       33    Title-key
	       34    Title-collective
	       35    Title-parallel
	       36    Title-cover
	       37    Title-added-title-page
	       38    Title-caption
	       39    Title-running
	       40    Title-spine
	       41    Title-other-variant
	       42    Title-former
	       43    Title-abbreviated
	       44    Title-expanded
	       45    Subject-precis
	       46    Subject-rswk
	       47    Subject-subdivision
	       48    Number-natl-biblio
	       49    Number-legal-deposit
	       50    Number-govt-pub
	       51    Number-music-publisher
	       52    Number-db
	       53    Number-local-call
	       54    Code-language
	       55    Code-geographic
	       56    Code-institution
	       57    Name-and-title
	       58    Name-geographic
	       59    Place-publication
	       60    CODEN
	       61    Microform-generation
	       62    Abstract
	       63    Note
	       1000  Author-title
	       1001  Record-type
	       1002  Name
	       1003  Author
	       1004  Author-name-personal
	       1005  Author-name-corporate
	       1006  Author-name-conference
	       1007  Identifier-standard
	       1008  Subject-LC-childrens
	       1009  Subject-name-personal
	       1010  Body-of-text
	       1011  Date/time-added-to-db
	       1012  Date/time-last-modified
	       1013  Authority/format-id
	       1014  Concept-text
	       1015  Concept-reference
	       1016  Any
	       1017  Server-choice
	       1018  Publisher
	       1019  Record-source
	       1020  Editor
	       1021  Bib-level
	       1022  Geographic-class
	       1023  Indexed-by
	       1024  Map-scale
	       1025  Music-key
	       1026  Related-periodical
	       1027  Report-number
	       1028  Stock-number
	       1030  Thematic-number
	       1031  Material-type
	       1032  Doc-id
	       1033  Host-item
	       1034  Content-type
	       1035  Anywhere
	       1036  Author-Title-Subject

RELATION (2)
	       1 Less than
	       2 Less than or equal
	       3 Equal
	       4 Greater or equal
	       5 Greater than
	       6 Not equal
	       100 Phonetic
	       101 Stem
	       102 Relevance
	       103 AlwaysMatches

POSITION (3)
	       1 First in field
	       2 First in subfield
	       3 Any position in field

STRUCTURE (4)
	       1 Phrase
	       2 Word
	       3 Key
	       4 Year
	       5 Date (normalized)
	       6 Word list
	       100 Date (un-normalized)
	       101 Name (normalized)
	       102 Name (un-normalized)
	       103 Structure
	       104 Urx
	       105 Free-form-text
	       106 Document-text
	       107 Local-number
	       108 String
	       109 Numeric-string

TRUNCATION (5)
	       1 Right truncation
	       2 Left truncation
	       3 Left and right truncation
	       100 Do not truncate
	       101 Process # in search term  . regular #=.*
	       102 RegExpr-1
	       103 RegExpr-2
	       104 Process # ?n . regular: #=., ?n=.{0,n} or ?=.* Z39.58

       Thw 105-106 truncation attributes below are only supported by Index Data's Zebra server.

	       105 Process * ! regular: *=.*, !=. and right truncate
	       106 Process * ! regular: *=.*, !=.

COMPLETENSS (6)
	       1 Incomplete subfield
	       2 Complete subfield
	       3 Complete field

SORTING (7)
	       1 ascending
	       2 descending

       Type 7 is an Index Data extension to RPN queries that allows embedding a sort critieria into a query.

SEE ALSO

       Bib-1 Attribute Set[1]

       Attibute Set Bib-1 Semantics[2].

NOTES

	1. Bib-1 Attribute Set
	   http://www.loc.gov/z3950/agency/defns/bib1.html

	2. Attibute Set Bib-1 Semantics
	   http://www.loc.gov/z3950/agency/bib1.html

YAZ 4.2.30							    04/16/2012						    BIB-1 ATTRIBUTE SET(7)