Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Using sed in a loop/to remove lines contained in variable from file
Top Forums Shell Programming and Scripting Using sed in a loop/to remove lines contained in variable from file Post 302927673 by newbie2010 on Thursday 4th of December 2014 02:35:40 PM
Old 12-04-2014
Using sed in a loop/to remove lines contained in variable from file
I've tried numerous commands, but I am not sure how to use sed in a loop. This is what I have:

VARZ contains CARD_FILE_LIST and it also contains CARD_FILE_LIST2
so
echo "$VARZ"
CARD_FILE_LIST
CARD_FILE_LIST2

I have a file with 60 lines in /tmp/testfile it and I want those lines deleted from the file. Note that VARZ may not always contain CARD_FILE_LIST or CARD_FILE_LIST2. It may contain another line. I want the command to delete whatever values are contained by VARZ preferably with sed or awk.

I have tried:

Code:
for i in `cat /tmp/testfile`;do echo $i |sed "s/$VARZ//g"`;done

Code:
sed "/$VARZ/d" /tmp/testfile

Code:
sed '/'"${VARX}"'/d /tmp/testfile

I have the old version of sed so I can't use sed -i to make changes but obviously I could output it to another file and rename that one if I need to. I just want to get the command/loop working.

Any help is appreciated.
 

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Redirect contained in variable not expanded as expected

Hi all, I have a selection of files that contain several commands that write to a file and are started as background processes similar to below. command_to_run_simulator -simulator_arguments > log_file 2>&1 & command_to_run_simulator -simulator_arguments > log_file 2>&1 &... (2 Replies)
Discussion started by: noose
2 Replies

2. Shell Programming and Scripting

using sed to remove lines

Can somebody explain why my sed command is not working. I do the folloinwg: Generates a binary file to /tmp/x1.out /usr/lib/sa/sa2 -s 4:00 -e 8:00 -i 3600 -A -o /tmp/x1.out decodes the file (no problem so far) sar -f /tmp/x1.out When I do this it does not appear to delete the... (4 Replies)
Discussion started by: BeefStu
4 Replies

3. Shell Programming and Scripting

Having sed to read lines of a file with the use of a variable..Possible?

This i will print the second line of a file sed -n '2p' test2 The use of a variable is impossible here. a=1 while ; do line=`sed -n '$a p' test2` # do some things here with the line variable a=`expr $a + 1` done But the uotput of sed command is 'p'..... What can i do to use a variable... (2 Replies)
Discussion started by: hakermania
2 Replies

4. Shell Programming and Scripting

grep/sed to remove lines in file

Hi, I have a file with values, file1: BELL-1180-1180-81|577:1017| BELL-1180-1180-81|jm10i-auto-stub1/577:102| BELL-1180-1180-81|jm10i-auto-stub1/577:101| BELL-1180-1180-81|jm10i-auto-stub1/577:1700| BELL-1180-1180-81|jm10i-auto-stub1/577:1699| I need to remove the lines which has... (9 Replies)
Discussion started by: giri_luck
9 Replies

5. Shell Programming and Scripting

Remove a range of lines from a file using sed

Hi I am having some issue editing a file in sed. What I want to do is, in a loop pass a variable to a sed command. Sed should then search a file for a line that matches that variable, then remove all lines below until it reaches a line starting with a constant. I have managed to write a... (14 Replies)
Discussion started by: Andy82
14 Replies

6. UNIX for Dummies Questions & Answers

How to remove certain lines using sed?

Hi I have the following kind of line sin my file . print ' this is first'. print ' this is firs and next ' ' line continuous '. -- this is entire print line. print ' this is first and next ' ' line continuous and' 'still there now over'. -- this 3lines together a single print line. ... (5 Replies)
Discussion started by: Sivajee
5 Replies

7. Shell Programming and Scripting

How to remove certain lines using sed?

Hi, I am new to unix and i started some scripting recently. Please go through the following script i wrote. #!/bin/sh file='path../tfile' file1='path../tfile1' rmfile='path../test2' C1=1 C2=1 exec 3< $file1 while read LINE1; do read LINE2 <&3 a=$LINE1 b=`expr $LINE2 - 1` ... (1 Reply)
Discussion started by: Subbu123
1 Replies

8. Shell Programming and Scripting

ksh Loop through file one, remove lines from file two

Good Afternoon, I start with a file named biglist.txt. I have another file smallerlist. txt I want to remove the lines from smallerlist.txt from biglist.txt and leave those lines that do not reside in smallerlist.txt. Thanks !! (2 Replies)
Discussion started by: popeye
2 Replies

9. Shell Programming and Scripting

sed to remove all lines in file that are not .vcf.gz extention

I am trying to use sed to remove all lines in a file that are nor vcf.gz. The sed below runs but returns all the files with vcf.gz in them, rather then just the ones that end in only that extention. Thank you :). file ... (9 Replies)
Discussion started by: cmccabe
9 Replies

10. Shell Programming and Scripting

How to remove repetitive lines in a file with sed?

Hello, My goal is the make all x times repeated lines into a single line. I need to attain the expected output with sed -i , I need to overwrite the MyFile MyFile: Hello World Welcome Hello World Welcome Back This is my test Expected output: Hello World Welcome Welcome Back This is... (6 Replies)
Discussion started by: baris35
6 Replies

LEARN ABOUT DEBIAN

shtool-subst

SHTOOL-SUBST.TMP(1)					      GNU Portable Shell Tool					       SHTOOL-SUBST.TMP(1)

NAME

       shtool-subst - GNU shtool sed(1) substitution operations

SYNOPSIS

       shtool subst [-v|--verbose] [-t|--trace] [-n|--nop] [-w|--warning] [-q|--quiet] [-s|--stealth] [-i|--interactive] [-b|--backup ext]
       [-e|--exec cmd] [-f|--file cmd-file] [file] [file ...]

DESCRIPTION

       This command applies one or more sed(1) substitution operations to stdin or any number of files.

OPTIONS

       The following command line options are available.

       -v, --verbose
	   Display some processing information.

       -t, --trace
	   Enable the output of the essential shell commands which are executed.

       -n, --nop
	   No operation mode. Actual execution of the essential shell commands which would be executed is suppressed.

       -w, --warning
	   Show warning on substitution operation resulting in no content change on every file. The default is to show a warning on substitution
	   operations resulted in no content change on all files.

       -q, --quiet
	   Suppress warning on substitution operation resulting in no content change.

       -s, --stealth
	   Stealth operation. Preserve timestamp on file.

       -i, --interactive
	   Enter interactive mode where the user has to approve each operation.

       -b, --backup ext
	   Preserve backup of original file using file name extension ext.  Default is to overwrite the original file.

       -e, --exec cmd
	   Specify sed(1) command directly.

       -f, --file cmd-file
	   Read sed(1) command from file.

EXAMPLE

	#   shell script
	shtool subst -i -e 's;(c) ([0-9]*)-2000;(c) 1-2001;' *.[ch]

	#    RPM spec-file
	%install
	    shtool subst -v -n 
		-e 's;^(prefix=).*;1 $RPM_BUILD_ROOT%{_prefix};g' 
		-e 's;^(sysconfdir=).*;1 $RPM_BUILD_ROOT%{_prefix}/etc;g' 
		`find . -name Makefile -print`
	    make install

HISTORY

       The GNU shtool subst command was originally written by Ralf S.  Engelschall <rse@engelschall.com> in 2001 for GNU shtool.  It was prompted
       by the need to have a uniform and convenient patching frontend to sed(1) operations in the OpenPKG package specifications.

SEE ALSO

       shtool(1), sed(1).

18-Jul-2008							   shtool 2.0.8 					       SHTOOL-SUBST.TMP(1)
All times are GMT -4. The time now is 12:48 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy