Removing blocks from a file Post: 302376891

Sponsored Content

Top Forums Shell Programming and Scripting Removing blocks from a file Post 302376891 by durden_tyler on Wednesday 2nd of December 2009 02:57:52 PM

12-02-2009

Registered User

Quote:

Originally Posted by kristinu

...
Then take the first after the > sign and the last before the > sign. Check whether the difference is greater than a certain value. If it is, the block is removed from the file.

For example, in the following block, I check whether ABS(12.9306 - 10) > 38

If it is greater than 38, the block got to be removed
...
>
12.9306 0 5.80696
12.722 0.138373 5.31509
12.3915 0.298905 4.65587
12.0588 0.409492 4.04942
11.7234 0.473844 3.46864
11.3851 0.492713 2.89112
11.0435 0.464082 2.29359
10.6984 0.382409 1.6451
10.3501 0.236171 0.891863
10 0 0
>

Here's one way to do it with Perl:

Code:

$ 
$ cat -n f8
     1  >  
     2  12.9306 0 5.80696
     3  12.722 0.138373 5.31509
     4  12.3915 0.298905 4.65587
     5  12.0588 0.409492 4.04942
     6  11.7234 0.473844 3.46864
     7  11.3851 0.492713 2.89112
     8  11.0435 0.464082 2.29359
     9  10.6984 0.382409 1.6451 
    10  10.3501 0.236171 0.891863
    11  10 0 0                   
    12  >                        
    13  52.9306 0 5.80696        
    14  12.722 0.138373 5.31509  
    15  10.3501 0.236171 0.891863
    16  10 0 0                   
    17  >                        
    18  12.9306 0 5.80696        
    19  10.3501 0.236171 0.891863
    20  10 0 0                   
    21  50.9306 0 5.80696        
    22  >                        
    23  12.9306 0 5.80696        
    24  12.9306 0 5.80696        
$                                
$
$ ##
$ perl -lne 'BEGIN{$lim=38; undef $/}
>            while(/^(>\n([\d.]+)[^>]*\n([\d.]+) ([\d.]+) ([\d.]+))/msg) {
>              print $1 if abs($2-$3) <= $lim;
>            }' f8
>
12.9306 0 5.80696
12.722 0.138373 5.31509
12.3915 0.298905 4.65587
12.0588 0.409492 4.04942
11.7234 0.473844 3.46864
11.3851 0.492713 2.89112
11.0435 0.464082 2.29359
10.6984 0.382409 1.6451
10.3501 0.236171 0.891863
10 0 0
>
12.9306 0 5.80696
10.3501 0.236171 0.891863
10 0 0
50.9306 0 5.80696
>
12.9306 0 5.80696
12.9306 0 5.80696
$
$

tyler_durden

durden_tyler

View Public Profile for durden_tyler

Find all posts by durden_tyler

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Delete blocks of lines from text file

Hello, Hello Firends, I have file like below. I want to remove selected blocks say abc,pqr,lst. how can i remove those blocks from file. zone abc { blah blah blah } zone xyz { blah blah blah } zone pqr { blah blah blah }

2. Solaris

Why does the # of blocks change for a file on a ZFS filesystem?

I created a zpool and zfs filesystem in OpenSolaris. I made two NFS mount points: > zpool history History for 'raidpool': 2009-01-15.17:12:48 zpool create -f raidpool raidz1 c4t1d0 c4t2d0 c4t3d0 c4t4d0 c4t5d0 2009-01-15.17:15:54 zfs create -o mountpoint=/vol01 -o sharenfs=on -o...

3. Shell Programming and Scripting

extract blocks of text from a file

Hi, This is part of a large text file I need to separate out. I'd like some help to build a shell script that will extract the text between sets of dashed lines, write that to a new file using the whole or part of the first text string as the new file name, then move on to the next one and...

4. UNIX for Dummies Questions & Answers

Convert 512-blocks to 4k blocks

I'm Unix. I'm looking at "df" on Unix now and below is an example. It's lists the filesystems out in 512-blocks, I need this in 4k blocks. Is there a way to do this in Unix or do I manually convert and how? So for container 1 there is 7,340,032 in size in 512-blocks. What would the 4k block be...

5. Shell Programming and Scripting

how to split this file into blocks and then send these blocks as input to the tool called Yices?

Hello, I have a file like this: FILE.TXT: (define argc :: int) (assert ( > argc 1)) (assert ( = argc 1)) <check> # (define c :: float) (assert ( > c 0)) (assert ( = c 0)) <check> # now, i want to separate each block('#' is the delimeter), make them separate files, and then send them as...

6. Shell Programming and Scripting

Extracting data blocks from file

Hi all, I want to extract blocks of data from a file depending on the contents of that block. The input file(table) has several blocks each starting with 'gene' in the first column. I want to extract only those blocks which do not have the expression '_T02' in the second column. Input file ...

7. Shell Programming and Scripting

Row blocks to column blocks

Hello, Searched for a while and found some "line-to-column" script. My case is similar but with multiple fields each row: S02 Length Per S02 7043 3.864 S02 54477 29.89 S02 104841 57.52 S03 Length Per S03 1150 0.835 S03 1321 0.96 S03 ...

8. Shell Programming and Scripting

Adding and removing blocks of text from file

Hello all, short story: I'm writing a script to add and remove dns records in dns files. Its on a RHEL 5.5 So far i've locked up the basic operations in a couple of functions: - validate the parameters - search for existant ip in file when adding - search for existant name records in...

9. Shell Programming and Scripting

Blocks of text in a file - extract when matches...

I sat down yesterday to write this script and have just realised that my methodology is broken........ In essense I have..... ----------------------------------------------------------------- (This line really is in the file) Service ID: 12345 ...

10. Solaris

Translate file name to disk blocks on UFS

Is there any way to translate a file name to the underlying file system's disk blocks/sectors/extents on UFS (Solaris OS on Sparc)? I found several ways to do it on linux file systems like ext2/3/4, using command like hdparm -- fibmap and filefrag. I also found one equivalent way to get that...

LEARN ABOUT DEBIAN

lgroupmod

lgroupmod(8)						      System Manager's Manual						      lgroupmod(8)

NAME

       lgroupmod - Modify an user group

SYNOPSIS

       lgroupmod [OPTION]... group

DESCRIPTION

       Modifies the user group with name group.

OPTIONS

       -A, --admin-add=list
	      Add users in comma-separated list among group's administrators.

       -a, --admin-remove=list
	      Remove  users  in comma-separated list from group's administrators.  Removing users that are not currently among group's administra-
	      tors silently succeeds.

       -g, --gid=gid
	      Change group's group ID to gid.

       -i, --interactive
	      Ask all questions when connecting to the user database, even if default answers are set up in libuser configuration.

       -L, --lock
	      Lock group.  This prevents users from using the group password with newgrp(1) to become a member of group.

       -M, --member-add=list
	      Add users in comma-separated list among group's members.

       -m, --member-remove=list
	      Remove users in comma-separated list from group's members.  Removing users that are not currently  among	group's  members  silently
	      succeeds.

       -n, --name=name
	      Rename group to name.

       -P, --plainpassword=password
	      Set group's password to password.  Note that the password can be viewed while running lgroupmod using tools such as ps(1).

       -p, --password=encrypted
	      Set  group's  password  to the password represented by the hash encrypted.  Note that the hash can be viewed while running lgroupmod
	      using tools such as ps(1).

       -U, --unlock
	      Unlock group.

EXIT STATUS

       The exit status is 0 on success, nonzero on error.

libuser 							    Jan 11 2005 						      lgroupmod(8)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Delete blocks of lines from text file

Discussion started by: nrbhole

2. Solaris

Why does the # of blocks change for a file on a ZFS filesystem?

Discussion started by: sqa777

3. Shell Programming and Scripting

extract blocks of text from a file

Discussion started by: cajunfries

4. UNIX for Dummies Questions & Answers

Convert 512-blocks to 4k blocks

Discussion started by: rockycj