sed or awk to parse this text Post: 302449528

Sponsored Content

Top Forums Shell Programming and Scripting sed or awk to parse this text Post 302449528 by agama on Monday 30th of August 2010 11:17:14 PM

08-31-2010

Registered User

Quote:

Originally Posted by bulgin

Agama thank you for your reply. Are you suggesting I run this like:

awk -f awk.script testfile.txt

because that is producing errors.

I generally put it into a kshell script, but you can run it that way provided that you do NOT put the awk command nor the opening/closing single quotes into awk.script.

I assumed you were probably adding it to an existing ksh/bash script, something like this (replace ksh with bash if you prefer bash):

Code:

#!/usr/bin/env ksh
awk '
        /^[*]/ {                            # new section 
                if( snarf )
                        printf( "\n" );         # terminate the last section
                snarf = 1;                      # open the section
                n = index( $0, "-" );           # find first -
                printf( "%s ", substr( $0, n+1 ) );     # print everything after the first dash
                next;
        }

        NF == 0 { 
             if( snarf )
             {
                  snarf = 0; 
                  printf( "\n" );
              }
              next; 
       }     #terminate section on blank line

        snarf > 0 {                         # if in section print this line. 
                printf( "%s ", $0 );
                next;
        }

        END {
                if( snarf )                    # need to finish the last section with newline
                        printf( "\n" );
        }'   <test_file.txt

I hope that is a bit clearer.

---------- Post updated at 23:17 ---------- Previous update was at 23:16 ----------

If you are still having issues with it, please post the error messages.

agama

View Public Profile for agama

Find all posts by agama

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

To parse through the file and print output using awk or sed script

suppose if u have a file like that Hen ABCCSGSGSGJJJJK 15 Cock ABCCSGGGSGIJJJL 15 * * * * * * : * * * . * * * : Hen CFCDFCSDFCDERTF 30 Cock CHCDFCSDHCDEGFI 30 * . * * * * * * * : * * :* : : . The output shud be where there is : and . It shud...

2. Shell Programming and Scripting

awk/sed Command : Parse parameter file / send the lines to the ksh export command

Sorry for the duplicate thread this one is similar to the one in https://www.unix.com/shell-programming-scripting/88132-awk-sed-script-read-values-parameter-files.html#post302255121 Since there were no responses on the parent thread since it got resolved partially i thought to open the new...

3. Shell Programming and Scripting

awk/sed Command: To Parse Stament between 2 numbers

Hi, I need an awk command that would parse the below expression Input Format 1 'Stmt1 ............................'2 'Stmt2 ............................'3 'Stmt3 ............................'4 'Stmt4 ............................'5 'Stmt5 ............................'6 'Stmt6...

4. Shell Programming and Scripting

parse xm entry with awk/sed

Hi folks, I have XML files with the following sections (section occurs once per file) in them: <AuthorList CompleteYN="Y"> <Author ValidYN="Y"> <LastName>Bernal</LastName> <ForeName>Federico</ForeName> ...

5. Shell Programming and Scripting

Use awk or sed to parse delimited string

Hi I am trying to figure out the best way to search a long log file and print out certain information. For example if I had a line in a log file delimited by ampersand first_name=mike&last_name=smith&zip_code=55555&phone=555-5555&state=ma&city=boston and I only wanted to search for and...

6. Shell Programming and Scripting

sed/awk script to parse list of bandwidth rules

Hello all gurus, I have a long list of rules as below: 20 name:abc addr:203.45.247.247/255.255.255.255 WDW-THRESH:12 BW-OUT:10000000bps BW-IN:15000000bps STATSDEVICE:test247 STATS:Enabled (4447794/0) <IN OUT> 25 name:xyz160 addr:203.45.233.160/255.255.255.224 STATSDEVICE:test160...

7. Shell Programming and Scripting

[solved] Awk/shell question to parse hour minute from text

Hi, I have a quick question on parsing the hour/minute and value from a text file and remove the seconds portion. For example in the below text file: 20:26:01 95.83 20:27:01 96.06 20:28:01 95.99 20:29:01 7.11 20:30:01 5.16 20:31:01 8.27 20:32:02 9.79 20:33:01 11.27 20:34:01 7.83...

8. Shell Programming and Scripting

awk to parse file and display result based on text

I am trying using awk to open an input file and check a column 2/field $2 and if there is a warning then that is displayed (variantchecker): G not found at position 459, found A instead. The attached Sample1.txt is that file. If in that column/field there is a black space, then the text after...

9. Shell Programming and Scripting

awk or sed? rows text to co

Hello Friends! I would like to help the masters ... I have a file with the entry below and would like a script for that output: Input file: 001 1 01-20152142711532-24S 1637909825/05/2015BAHIA SERVICOS R F, ...

10. Shell Programming and Scripting

awk to parse field and include the text of 1 pipe in field 4

I am trying to parse the input in awk to include the |gc= in $4 but am not able to. The below is close: awk so far: awk '{sub(/\|]+]++/, ""); print }' input.txt Input chr1 955543 955763 AGRN-6|pr=2|gc=75 0 + chr1 957571 957852 AGRN-7|pr=3|gc=61.2 0 + chr1 970621 ...

LEARN ABOUT DEBIAN

dpkg-www

DPKG-WWW(1)						      General Commands Manual						       DPKG-WWW(1)

NAME

       dpkg-www - program to remotely open a WWW Debian package browser

SYNOPSIS

       dpkg-www [-s|--stdout] [-h|--host host] [query]

DESCRIPTION

       dpkg-www is used to remotely control a WEB browser and open a dpkg URL on the local host from an interactive shell or script.

       If  the	command  is invoked while running under X-window the script will try to find an installed X browser to open the specified URL.	If
       not running under X it will try to use a text browser instead.

       If Netscape is found and a Netscape instance is already running it will be asked to open the dpkg URL on localhost with the optional  query
       supplied on the command line.  If there is no browser running, it will start automatically a new one.

       The  functionality  provided  by this program is identical to running a web browser with the -remote openURL(http://localhost/cgi-bin/dpkg)
       argument or opening the same URL from within the browser.

       dpkg-www-installer is an helper application which can configured in the WWW browser for	web  installation.  It	should	never  be  invoked
       directly by the user.

OPTIONS

       -s, --stdout
	      Redirect output to stdout. Requires one of the text browsers (lynx, lynx-ssl or links) installed.

       -h, --host host
	      Send the query to a remote host, where dpkg-www must be installed.

       query  Specifies  an  optional  package name, an absolute pathname or a query argument which is passed to the dpkg cgi-bin. See dpkg-www(8)
	      for more information about the use of the cgi.

FILES

       /etc/dpkg-www.conf

       ~/.dpkg-www
	      Configuration files for dpkg-www. It is not necessary for these files to exist, there are sensible defaults for everything, but  you
	      can specify your preferred www browser with the DPKG_WWW_BROWSER variable, for example: DPKG_WWW_BROWSER=mozilla

EXAMPLES

       dpkg-www
	      This would open a dpkg URL on localhost listing all the installed packages.

       dpkg-www bash
	      This would open a dpkg URL asking info on the bash package.

       dpkg-www -h pisolo bash
	      This would open a dpkg URL asking info on the bash package on host pisolo.

       dpkg-www 'dpkg*'
	      This would open a dpkg URL listing all packages matching dpkg*.

       dpkg-www /bin/bash
	      This would open a dpkg URL asking info on the package(s) owning the file /bin/bash .

       dpkg-www depends=svgalib
	      This would open a dpkg URL listing all packages depending on svgalib.

       dpkg-www --stdout depends=awk | grep ^ii
	      This would list on stdout all packages depending on awk and grep all lines of installed packages.

SEE ALSO

       dpkg(8), dpkg-www(8)

AUTHOR

       Massimo Dal Zotto <dz@debian.org>.
       Bugs should be reported via the normal Debian bug reporting system.

LICENCE

       dpkg-www is licensed under the GNU General Public License version 2.

								 September 1, 2004						       DPKG-WWW(1)