Sponsored Content
Top Forums UNIX for Dummies Questions & Answers Help with deleting specific rows from a text file Post 302534693 by evelibertine on Tuesday 28th of June 2011 01:39:48 PM
Old 06-28-2011
Help with deleting specific rows from a text file

I know this is a complicated question but I will try to illustrate it with some data. I have a data file that looks like the following:


Code:
1341 NA06985 0 0 2 46.6432798439
1341 NA06991 NA06993 NA06985 2 48.8478948517
1341 NA06993 0 0 1 45.8022601455
1340 NA06994 0 0 1 48.780669145
1340 NA07000 0 0 2 47.7312017846
1340 NA07019 NA07022 NA07056 2 41.7389244255
1340 NA07022 0 0 1 54.1498530714
1340 NA07029 NA06994 NA07000 1 X
1341 NA07034 0 0 1 41.709838673
1341 NA07048 NA07034 NA07055 1 41.4599808018
1341 NA07055 0 0 2 43.7346131504
1340 NA07056 0 0 2 43.8415287938
1345 NA07345 0 0 2 35.6671940928
1345 NA07348 NA07357 NA07345 2 44.3923953539
1345 NA07357 0 0 1 45.179924889
1408 NA10830 NA12154 NA12236 1 33.3463998717
1408 NA10831 NA12155 NA12156 2 46.9172160682
1416 NA10835 NA12248 NA12249 1 33.2843722268
1420 NA10838 NA12003 NA12004 1 43.9668852859
1420 NA10839 NA12005 NA12006 2 44.5388697648
1334 NA10846 NA12144 NA12145 1 37.4468745153
1334 NA10847 NA12146 NA12239 2 45.605211554
1344 NA10851 NA12056 NA12057 1 37.928057554
1349 NA10854 NA11839 NA11840 2 47.1457402335
1350 NA10855 NA11831 NA11832 2 X
1350 NA10856 NA11829 NA11830 1 X
1346 NA10857 NA12043 NA12044 1 59.3261972639
1347 NA10859 NA11881 NA11882 2 60.5802420929
1362 NA10860 NA11992 NA11993 1 55.428533745
1362 NA10861 NA11994 NA11995 2 52.5134811264
1375 NA10863 NA12264 NA12234 2 44.3368601343
1350 NA11829 0 0 1 33.4327616207
1350 NA11830 0 0 2 33.0018192844
1350 NA11831 0 0 1 48.8652993625
1350 NA11832 0 0 2 51.7719464358

I want to look at the first column and delete lines where the value on the first column is not repeated at least 6 times (in 6 different rows) throughout the text file. For example, there are 6 rows which start with 1341 or 1350 so I would keep those rows. But there are only 2 rows which start with 1362, so that row would be deleted. In the end my output would look like this:

Code:
1341 NA06985 0 0 2 46.6432798439
1341 NA06991 NA06993 NA06985 2 48.8478948517
1341 NA06993 0 0 1 45.8022601455
1340 NA06994 0 0 1 48.780669145
1340 NA07000 0 0 2 47.7312017846
1340 NA07019 NA07022 NA07056 2 41.7389244255
1340 NA07022 0 0 1 54.1498530714
1340 NA07029 NA06994 NA07000 1 X
1341 NA07034 0 0 1 41.709838673
1341 NA07048 NA07034 NA07055 1 41.4599808018
1341 NA07055 0 0 2 43.7346131504
1340 NA07056 0 0 2 43.8415287938
1350 NA10855 NA11831 NA11832 2 X
1350 NA10856 NA11829 NA11830 1 X
1350 NA11829 0 0 1 33.4327616207
1350 NA11830 0 0 2 33.0018192844
1350 NA11831 0 0 1 48.8652993625
1350 NA11832 0 0 2 51.7719464358

Thanks a lot!

Last edited by joeyg; 06-28-2011 at 03:04 PM.. Reason: Please wrap scripts and data with CodeTags - makes easier to see & cut/paste
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Deleting the emty rows in a file

I am getting some spaces between the two lines(rows) in file.i want delete that empty rows in the file example 1 abc xyz 2 def jkl like i am having lots of rows in a file i want to delete the spce between the two rows give any... (7 Replies)
Discussion started by: srivsn
7 Replies

2. Shell Programming and Scripting

Deleting rows from csv file

Hello, I am supposed to process about 100 csv files. But these files have some extra lines at the bottom of the file. these extra lines start with a header for each column and then some values below. These lines are actually a summary of the actual data and not supposed to be processed. These... (8 Replies)
Discussion started by: cobroraj
8 Replies

3. Shell Programming and Scripting

Deleting specific rows in large files having rows greater than 100000

Hi Guys, I need help in modifying a large text file containing more than 1-2 lakh rows of data using unix commands. I am quite new to the unix language the text file contains data in a pipe delimited format sdfsdfs sdfsdfsd START_ROW sdfsd|sdfsdfsd|sdfsdfasdf|sdfsadf|sdfasdf... (9 Replies)
Discussion started by: manish2009
9 Replies

4. Shell Programming and Scripting

Deleting of Specific Rows.

Fruit : Price : Quantity apple : 20 : 40 chiku : 40 :30 Hey guys, i have written a code using sed to delete a specific char which is being typed in. But the problem i am having is , how can i expand my coding to actually allow it do delete the whole row. For example,... (21 Replies)
Discussion started by: gregarion
21 Replies

5. UNIX for Dummies Questions & Answers

Deleting cells that contain a specific number only from a space delimited text file

I have this space delimited large text file with more than 1,000,000+ columns and about 100 rows. I want to delete all the cells that consist of just 2 (leave 2's that are not by themselves intact): File before modification aa bb cc 2 NA100 dd aa b1 c2 2 NA102 de File after modification... (1 Reply)
Discussion started by: evelibertine
1 Replies

6. UNIX for Dummies Questions & Answers

Delete all rows that contain a specific string (text)

Hi, I have a text file and I want to delete all rows that contain a particular string of characters. How do I go about doing that? Thanks! (9 Replies)
Discussion started by: evelibertine
9 Replies

7. UNIX for Dummies Questions & Answers

Deleting specific rows from a text file

How do I go about deleting specific rows from a text file (given row number)? (5 Replies)
Discussion started by: evelibertine
5 Replies

8. UNIX for Dummies Questions & Answers

Deleting lines that contain a specific string from a space delimited text file?

Hi, I have a space delimited text file that looks like the following: 250 rs10000056 0.04 0.0888 4 189321617 250 rs10000062 0.05 0.0435 4 5254744 250 rs10000064 0.02 0.2403 4 127809621 250 rs10000068 0.01 NA 250 rs1000007 0.00 0.9531 2 237752054 250 rs10000081 0.03 0.1400 4 17348363... (5 Replies)
Discussion started by: evelibertine
5 Replies

9. UNIX for Dummies Questions & Answers

Deleting rows where the value in a specific column match

Hi, I have a tab delimited text file where I want to delete all rows that have the same string for column 1. How do I go about doing that? Thanks! Example Input: aa 1 aa 2 aa 3 bb 4 bc 5 bb 6 cd 8 Output: bc 5 cd 8 (4 Replies)
Discussion started by: evelibertine
4 Replies

10. Shell Programming and Scripting

Deleting specific lines from text file via scripting

Hi, I'm trying to search for some number and from that line, i need to delete the 5th line exactly. Eg: Consider below as text file data: 10000 a b c d e . . . 10000 w q t (8 Replies)
Discussion started by: Gautham
8 Replies
dhcp_network(4) 						   File Formats 						   dhcp_network(4)

NAME
dhcp_network - DHCP network tables DESCRIPTION
The Dynamic Host Configuration Protocol (DHCP) network tables are used to map the client identifiers of DHCP clients to IP addresses and the associated configuration parameters of that address. One DHCP network table exists for each network served by the DHCP server, and each table is named using the network's IP address. There is no table or file with the name dhcp_network. The DHCP network tables can exist as ASCII text files, binary text files, or NIS+ tables, depending on the data store used. Since the for- mat of the file could change, the preferred method of managing the DHCP network tables is through the use of dhcpmgr(1M) or the pntadm(1M) command. The dhcp_network file is used as a policy mechanism for whether in.dhcpd(1M) leases addresses on a given network. If the DHCP server is not serving leases or information to a network, there should be no dhcp_network file for that network. To set the DHCP server in informational mode, where it responds to INFORM messages but does not lease addresses on that network, create an empty dhcp_network file for that net- work. For normal operations, where the DHCP server both leases addresses and responds to INFORM packets, create a dhcp_network file using dhcpmgr(1M) or pntadm(1M) and populate it with leasable addresses. The format of the records in a DHCP network table depends on the data store used to maintain the table. However, an entry in a DHCP network table must contain the following fields: Client_ID The client identifier field, Client_ID, is an ASCII hexadecimal representation of the unique octet string value of the DHCP Client Identifier Option (code 61) which identifies a DHCP client. In the absence of the DHCP Client Identifier Option, the DHCP client is identified using the form given below for BOOTP clients. The number of characters in this field must be an even number, with a maximum length of 64 characters. Valid characters are 0 - 9 and A-F. Entries with values of 00 are freely available for dynamic allocation to requesting clients. BOOTP clients are identified by the concatenation of the network's hardware type (as defined by RFC 1340, titled "Assigned Numbers") and the client's hardware address. For example, the following BOOTP client has a hardware type of '01' (10mb ethernet) and a hardware address of 8:0:20:11:12:b7, so its client identifier would be: 010800201112B7 Flags The Flags field is a decimal value, the bit fields of which can have a combination of the following values: 1 (PERMANENT) Evaluation of the Lease field is turned off (lease is permanent). If this bit is not set, Evaluation of the Lease field is enabled and the Lease is DYNAMIC. 2 (MANUAL) This entry has a manual client ID binding (cannot be reclaimed by DHCP server). Client will not be allocated another address. 4 (UNUSABLE) When set, this value means that either through ICMP echo or client DECLINE, this address has been found to be unusable. Can also be used by the network administrator to prevent a certain client from booting, if used in conjunction with the MANUAL flag. 8 (BOOTP) This entry is reserved for allocation to BOOTP clients only. Client_IP The Client_IP field holds the IP address for this entry. This value must be unique in the database. Server_IP This field holds the IP address of the DHCP server which owns this client IP address, and thus is responsible for initial allocation to a requesting client. On a multi-homed DHCP server, this IP address must be the first address returned by gethostbyname(3NSL). Lease This numeric field holds the entry's absolute lease expiration time, and is in seconds since January 1, 1970. It can be decimal, or hexadecimal (if 0x prefixes number). The special value -1 is used to denote a permanent lease. Macro This ASCII text field contains the dhcptab macro name used to look up this entry's configuration parameters in the dhcptab(4) database. Comment This ASCII text field contains an optional comment. TREATISE ON LEASES This section describes how the DHCP/BOOTP server calculates a client's configuration lease using information contained in the dhcptab(4) and DHCP network tables. The server consults the LeaseTim and LeaseNeg symbols in the dhcptab, and the Flags and Lease fields of the chosen IP address record in the DHCP network table. The server first examines the Flags field for the identified DHCP network table record. If the PERMANENT flag is on, then the client's lease is considered permanent. If the PERMANENT flag is not on, the server checks if the client's lease as represented by the Lease field in the network table record has expired. If the lease is not expired, the server checks if the client has requested a new lease. If the LeaseNeg symbol has not been included in the client's dhcptab parameters, then the client's requested lease extension is ignored, and the lease is set to be the time remaining as shown by the Lease field. If the LeaseNeg symbol has been included, then the server will extend the client's lease to the value it requested if this requested lease is less than or equal to the current time plus the value of the client's LeaseTim dhcptab param- eter. If the client's requested lease is greater than policy allows (value of LeaseTim), then the client is given a lease equal to the current time plus the value of LeaseTim. If LeaseTim is not set, then the default LeaseTim value is one hour. For more information about the dhcptab symbols, see dhcptab(4). ATTRIBUTES
See attributes(5) for a description of the following attribute: +-----------------------------+-----------------------------+ | ATTRIBUTE TYPE | ATTRIBUTE VALUE | +-----------------------------+-----------------------------+ |Availability |SUNWdhcsu | +-----------------------------+-----------------------------+ |Interface Stability |Evolving | +-----------------------------+-----------------------------+ SEE ALSO
dhcpconfig(1M), dhcpmgr(1M), dhtadm(1M), in.dhcpd(1M), pntadm(1M), dhcptab(4), dhcp(5), dhcp_modules(5), attributes(5) Solaris DHCP Service Developer's Guide System Administration Guide: IP Services Reynolds, J. and J. Postel, Assigned Numbers, STD 2, RFC 1340, USC/Information Sciences Institute, July 1992. SunOS 5.10 5 Mar 2004 dhcp_network(4)
All times are GMT -4. The time now is 02:27 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy