Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Using sed in a loop/to remove lines contained in variable from file
Top Forums Shell Programming and Scripting Using sed in a loop/to remove lines contained in variable from file Post 302927679 by DGPickett on Thursday 4th of December 2014 04:29:36 PM
Old 12-04-2014
It might be good to turn the short file into a script of piped together sed's or whatever, so one pas on the long file is all that is needed. This can be done in a file or env var, using eval.

Really, all that is needed is a generated sed script for one sed, unless you need more speed. 'sed' is not a shell command, but a different script interpreter.
 

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Redirect contained in variable not expanded as expected

Hi all, I have a selection of files that contain several commands that write to a file and are started as background processes similar to below. command_to_run_simulator -simulator_arguments > log_file 2>&1 & command_to_run_simulator -simulator_arguments > log_file 2>&1 &... (2 Replies)
Discussion started by: noose
2 Replies

2. Shell Programming and Scripting

using sed to remove lines

Can somebody explain why my sed command is not working. I do the folloinwg: Generates a binary file to /tmp/x1.out /usr/lib/sa/sa2 -s 4:00 -e 8:00 -i 3600 -A -o /tmp/x1.out decodes the file (no problem so far) sar -f /tmp/x1.out When I do this it does not appear to delete the... (4 Replies)
Discussion started by: BeefStu
4 Replies

3. Shell Programming and Scripting

Having sed to read lines of a file with the use of a variable..Possible?

This i will print the second line of a file sed -n '2p' test2 The use of a variable is impossible here. a=1 while ; do line=`sed -n '$a p' test2` # do some things here with the line variable a=`expr $a + 1` done But the uotput of sed command is 'p'..... What can i do to use a variable... (2 Replies)
Discussion started by: hakermania
2 Replies

4. Shell Programming and Scripting

grep/sed to remove lines in file

Hi, I have a file with values, file1: BELL-1180-1180-81|577:1017| BELL-1180-1180-81|jm10i-auto-stub1/577:102| BELL-1180-1180-81|jm10i-auto-stub1/577:101| BELL-1180-1180-81|jm10i-auto-stub1/577:1700| BELL-1180-1180-81|jm10i-auto-stub1/577:1699| I need to remove the lines which has... (9 Replies)
Discussion started by: giri_luck
9 Replies

5. Shell Programming and Scripting

Remove a range of lines from a file using sed

Hi I am having some issue editing a file in sed. What I want to do is, in a loop pass a variable to a sed command. Sed should then search a file for a line that matches that variable, then remove all lines below until it reaches a line starting with a constant. I have managed to write a... (14 Replies)
Discussion started by: Andy82
14 Replies

6. UNIX for Dummies Questions & Answers

How to remove certain lines using sed?

Hi I have the following kind of line sin my file . print ' this is first'. print ' this is firs and next ' ' line continuous '. -- this is entire print line. print ' this is first and next ' ' line continuous and' 'still there now over'. -- this 3lines together a single print line. ... (5 Replies)
Discussion started by: Sivajee
5 Replies

7. Shell Programming and Scripting

How to remove certain lines using sed?

Hi, I am new to unix and i started some scripting recently. Please go through the following script i wrote. #!/bin/sh file='path../tfile' file1='path../tfile1' rmfile='path../test2' C1=1 C2=1 exec 3< $file1 while read LINE1; do read LINE2 <&3 a=$LINE1 b=`expr $LINE2 - 1` ... (1 Reply)
Discussion started by: Subbu123
1 Replies

8. Shell Programming and Scripting

ksh Loop through file one, remove lines from file two

Good Afternoon, I start with a file named biglist.txt. I have another file smallerlist. txt I want to remove the lines from smallerlist.txt from biglist.txt and leave those lines that do not reside in smallerlist.txt. Thanks !! (2 Replies)
Discussion started by: popeye
2 Replies

9. Shell Programming and Scripting

sed to remove all lines in file that are not .vcf.gz extention

I am trying to use sed to remove all lines in a file that are nor vcf.gz. The sed below runs but returns all the files with vcf.gz in them, rather then just the ones that end in only that extention. Thank you :). file ... (9 Replies)
Discussion started by: cmccabe
9 Replies

10. Shell Programming and Scripting

How to remove repetitive lines in a file with sed?

Hello, My goal is the make all x times repeated lines into a single line. I need to attain the expected output with sed -i , I need to overwrite the MyFile MyFile: Hello World Welcome Hello World Welcome Back This is my test Expected output: Hello World Welcome Welcome Back This is... (6 Replies)
Discussion started by: baris35
6 Replies

LEARN ABOUT X11R4

break

break(1)                                                           User Commands                                                          break(1)

NAME

       break, continue - shell built-in functions to escape from or advance within a controlling while, for, foreach, or until  loop

SYNOPSIS

   sh
       break [n]

       continue [n]

   csh
       break

       continue

   ksh
       *break [n]

       *continue [n]

DESCRIPTION

   sh
       The break utility exits from the enclosing for or while loop, if any. If n is specified, break n levels.

       The continue utility resumes the next iteration of the enclosing for or while loop. If n is specified, resume at the n-th enclosing loop.

   csh
       The  break  utility  resumes  execution after the end of the nearest enclosing foreach or while loop. The remaining commands on the current
       line are executed. This allows multilevel breaks to be written as a list of break commands, all on one line.

       The continue utility continues execution of the next iteration of the nearest enclosing while or foreach loop.

   ksh
       The break utility exits from the enclosed for, while, until, or select loop, if any. If n is specified,  then  break  n  levels.  If  n  is
       greater than the number of enclosing loops, the outermost enclosing loop shall be exited.

       The  continue utility resumes the next iteration of the enclosed for, while, until, or select loop. If n is specified then resume at the n-
       th enclosed loop. If n is greater than the number of enclosing loops, the outermost enclosing loop shall be used.

       On this man page, ksh(1) commands that are preceded by one or two * (asterisks) are treated specially in the following ways:

       1.  Variable assignment lists preceding the command remain in effect when the command completes.

       2.  I/O redirections are processed after variable assignments.

       3.  Errors cause a script that contains them to abort.

       4.  Words that follow a command preceded by ** that are in the format of a variable assignment are expanded with the same rules as a  vari-
           able  assignment.  This means that tilde substitution is performed after the = sign, and also that word splitting and file name genera-
           tion are not performed.

ATTRIBUTES

       See attributes(5) for descriptions of the following attributes:

       +-----------------------------+-----------------------------+
       |      ATTRIBUTE TYPE         |      ATTRIBUTE VALUE        |
       +-----------------------------+-----------------------------+
       |Availability                 |SUNWcsu                      |
       +-----------------------------+-----------------------------+

SEE ALSO

       csh(1), exit(1), ksh(1), sh( 1), attributes(5)

SunOS 5.10                                                          17 Jul 2002                                                           break(1)
All times are GMT -4. The time now is 08:49 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy