exclude lines in a loop Post: 302299153

Sponsored Content

Top Forums Shell Programming and Scripting exclude lines in a loop Post 302299153 by dariyoosh on Thursday 19th of March 2009 10:13:18 AM

03-19-2009

Registered User

Quote:

Originally Posted by shantanuo

I use while do - done loop in my shell script. It is working as per my expectations.
But I do not want to process all the lines. I am finding it difficult to exclude certain lines.

1) I do not want to process blank lines as well as lines those start with a space " "
2) I do not want to process the headings. The headlines start with the word AGENT or PRODUCT or TOTAL

Any help will be appreciated.

Hello there,

I think the following KornShell script can do the job

Code:

#!/bin/ksh

IFS='
'

while read LINE
do
    
    for TOKEN in $LINE
    do
        UPPER=$(print $TOKEN | tr '[a-z]' '[A-Z]')
        if [[ ($UPPER = +([     ])*) ||
              ($UPPER = *([     ])+(TOTAL|AGENT|PRODUCT)*) ]]
        then
            continue
        else
            #     And here you put all
            #     instructions to process the input
            #     don't forget the following break
            break
        fi
    done
    
done < $1

Actually, because here you ignore also the space character, you will need to modify the default IFS. In fact, the space characters (and I suppose the tabs) must be omitted. The IFS containing only the new line character is defined in the following way

IFS='
'

If you just write something like $'\n' or "\n" it doesn't work. The same is true about tabs. If you want to define a pattern including one or several space/tab characters you have to write [ ], that is, after [ you put a space character and then you push the tab key before closing ] (if instead of doing that you write \t it will not work)

I hope this can help

Regards,
Smilie

dariyoosh

View Public Profile for dariyoosh

Find all posts by dariyoosh

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

grep - to exclude lines beginning with pattern

11132 13069 11137 11142 13070 Can I use grep command to exclude all lines beginning with 13? I dont want to use grep -v 13 as potentially there will be a number with something like 11013 that I would exclude in error..

2. UNIX for Dummies Questions & Answers

Exclude lines which have blanks at certain positions

Hi All, I am getting a input file which doesnt have a field seperator. The file is being sorted on certain positions say from 0.55 to 0.59. If there are any blanks from 0.55 to 0.59 they will be listed as first set of records. I am not sure abt the number of records which will have blanks at...

3. Ubuntu

[Solved] Using Find with an exclude/exclude file

I am familiar with using tar and exclude/include files: tar zcf backup.dirs.tgz --files-from=include.mydirs --exclude-from=exclude.mydirs --no-recursion but was wondering if I could use find in the same way. I know that you can just specify the directories to exclude but my list is...

4. Shell Programming and Scripting

Code to exclude lines with similar values

Hi!!! I have a problem with txt file. For example: File: CATEGORY OF XXX AAA 1 XXX BBB CCC AAA 1 XXX DDD EEE AAA 1 XXX FFF GGG AAA 1 XXX KKK LLL AAA 1 XXX MMM ...

5. Shell Programming and Scripting

Git diff exclude swapped lines

Hi, I am doing aws security group auditing every day to find the difference. I am using git to find the difference. But some times some security group rules order is changing up and down(swapping lines). So 'git diff' command gives this as a difference which i dont want(i need only new lines...

6. Shell Programming and Scripting

File lines starts with # not processed or exclude that lines

I have requirement in my every files starting lines have # needs to be not processing or exclude the that lines. I have written a code like below, but now working as expected getting ERROR" line 60: 1 #!/bin/sh 2 echo ======= LogManageri start ========== 3 4 #This directory is...

7. Shell Programming and Scripting

File lines starts with # not processed or exclude that lines from processing

I have a file like below #Fields section bald 1234 2345 456 222 abcs dddd dddd ssss mmmm mmm mmm i need do not process a files stating with # I was written code below while read -r line do if then echo ${line} >> elif then ...

8. Shell Programming and Scripting

Exclude lines in a file with matches with multiple Strings using egrep

Hi I have a txt file and I would like to use egrep without using -v option to exclude the lines which matches with multiple Strings. Let's say I have some text in the txt file. The command should not fetch lines if they have strings something like CAT MAT DAT The command should fetch me...

9. Shell Programming and Scripting

Exclude multiple lines using grep

Hi, I'm working on a shell script that reports service status on a database server. There are some services that are in disabled status that the script should ignore and only check the services that are in Enabled status. I output the service configuration to a file and use that information to...

10. Shell Programming and Scripting

How to exclude some files from the loop on the directory?

I have one question. On the directory I have many files start with DB.DAILYxxxxxxx.YYYYMMDD.HHMMSS and I have several files with other format, like LET.20170310 daily.20170310 tba.20170310 How can I exclude from my loop DB.DAILY files? I tried ls *20170310* | while read...

LEARN ABOUT DEBIAN

ndselect

NDSELECT(1)							   User Commands						       NDSELECT(1)

NAME

       ndselect - select lines and fields for numdiff

DESCRIPTION

       Usage: ndselect -h|--help|-v|--version	or

       ndselect [-b N][-e N][-s N][-F N][-L N][-I N][-S IFS][-x][-l PATH][-o PATH] [FILE]

       Print to standard output a subset of lines and fields from a given file.

       The  argument  after  the options is the name of the file to read from.	The complete path of the file should be given, a directory name is
       not accepted.  If no input file is specified, the program reads from the standard input.

       Exit status: 0 in case of normal termination, -1 (255) in case of error

       -b, --beginning, --start=N

	      Set to N the number of the first line to print (The default behavior is to start with line number 1)

       -e, --end=N

	      Set to N the number of the last line that can be printed (The default behavior is to arrive till to the end of the file)

       -s, --step=N

	      Set to N the increment to use when selecting the lines to print (The default value for the increment is 1)

       -F, --first-field=N

	      Set to N the number of the first field to print (The default behavior is to start with field number 1)

       -L, --last-field=N

	      Set to N the number of the last field that can be printed (The default behavior is to arrive till to the end of every line)

       -I, --increment=N

	      Set to N the increment to use when selecting the fields to print (The default value for the increment is 1)

       -S, --separator=IFS

	      Specify the set of characters to use to split the input lines into fields (The default set of characters is space, tab and newline).

       -x, --omit-empty-lines

	      Do not print empty lines

       -l, --warnings-to=PATH

	      Redirect warning and error messages from stderr to the indicated file

       -o, --output=PATH

	      Redirect output from stdout to the indicated file

       -h, --help

	      Show this help message

       -v, --version

	      Show version number, Copyright, Distribution Terms and NO-Warranty

COPYRIGHT

       Copyright (C) 2005, 2006, 2007, 2008, 2009, 2010, 2011, 2012  Ivano Primi <ivprimi@libero.it>
       License GPLv3+: GNU GPL version 3 or later, see <http://gnu.org/licenses/gpl.html>.
       This is free software: you are free to change and redistribute it.  There is NO WARRANTY, to the extent permitted by law.

SEE ALSO

       The full documentation for ndselect is maintained as a Texinfo manual.  If the info and ndselect programs are properly  installed  at  your
       site, the command

	      info numdiff

       should give you access to the complete manual.

ndselect 5.6.0							   January 2012 						       NDSELECT(1)