how to filter out some paragraphs in a file

cnlhap · #1 (**permalink**) 06-07-2006

Hi,

I am trying to filter out those paragraphs that contains 'CONNECT', 'alter system switch logfile'. That means say the input file is :

-------------------------------------------------------
Wed Jun 7 00:32:31 2006
ACTION : 'CONNECT'
CLIENT USER: prdadm
CLIENT TERMINAL:

Wed Jun 7 00:32:31 2006
ACTION : 'alter system switch logfile'
CLIENT USER: prdadm
CLIENT TERMINAL:

Wed Jun 7 00:32:31 2006
ACTION : 'CONNECT'
CLIENT USER: prdadm
CLIENT TERMINAL:

Wed Jun 7 00:32:42 2006
ACTION : 'ALTER DATABASE CLOSE NORMAL'
CLIENT USER: prdadm
CLIENT TERMINAL:
----------------------------------------------------------------

I would like the output file to be :

----------------------------------------------------------------
Wed Jun 7 00:32:42 2006
ACTION : 'ALTER DATABASE CLOSE NORMAL'
CLIENT USER: prdadm
CLIENT TERMINAL:
----------------------------------------------------------------

Do you have any script to perform this, thank you very much

.

Corona688 · #2 (**permalink**) 06-08-2006

I'm assuming the horizontal lines aren't actually in the file, and are just used instead of

Code:

code tags

Code tags are better because they preserve spacing.

Here's a script:

Code:

#!/bin/sh

SHOULDPRINT=1

function do_flush
{
        if [[ ${SHOULDPRINT} -eq 1 && ! -z ${OUT} ]]
        then
                echo "${OUT}"
        fi
}

while read LINE
do
        if [[ -z ${LINE} ]]
        then
                do_flush
                OUT=""
                SHOULDPRINT=1
        elif    echo "${LINE}" | egrep -q "CONNECT|alter system switch logfile"
        then
                SHOULDPRINT=0
        else
                if [[ -z ${OUT} ]]
                then
                        OUT="
${LINE}"
                else
                        OUT="${OUT}
${LINE}"
                fi
        fi
done
do_flush

tmarikle · #3 (**permalink**) 06-08-2006

An awk example of the same thing:

Code:

 nawk '
    $0 !~ /ACTION : / {
        last_line=$0
    }

    $0 ~ /^ACTION : / && $0 !~ /CONNECT|alter system/ {
        print last_line
        print $0
        getline ; print
        getline ; print
    }
' your_log_file

vgersh99 · #4 (**permalink**) 06-08-2006

nawk -f cn.awk your_log_file

cn.awk:

Code:

BEGIN {
  RS=FS=""
  PATexclude="(CONNECT)|(alter system switch logfile)"
}
$0 !~ PATexclude

tmarikle · #5 (**permalink**) 06-08-2006

Quote:

Originally Posted by vgersh99

nawk -f cn.awk your_log_file

cn.awk:

Code:

BEGIN {
  RS=FS=""
  PATexclude="(CONNECT)|(alter system switch logfile)"
}
$0 !~ PATexclude

Nice! This works as long as the paragraphs have whitespace between them.

vgersh99 · #6 (**permalink**) 06-08-2006

Quote:

Originally Posted by tmarikle

Nice! This works as long as the paragraphs have whitespace between them.

yes, that was the assumption - 'paragraphs are separated by blank lines'!

More UNIX and Linux Forum Topics You Might Find Helpful
Thread	Thread Starter	Forum	Replies	Last Post
how to sort paragraphs by date within a file	nabmufti	Shell Programming and Scripting	1	02-13-2008 05:33 PM
how to extract paragraphs from file in BASH script followed by prefix ! , !! and !!!	nabmufti	Shell Programming and Scripting	6	02-09-2008 08:32 PM
filter the string from a file ??	varungupta	Shell Programming and Scripting	11	09-17-2007 11:11 PM
File filter	Dastard	Shell Programming and Scripting	3	09-06-2007 02:50 PM
filter out certain column from a file	CamTu	Shell Programming and Scripting	4	04-04-2005 07:24 PM

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes	Rate This Thread
Switch to Linear Mode Hybrid Mode Switch to Threaded Mode	Rate This Thread:


	Powered by