Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Exclude variable from a file

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Exclude variable from a file
# 1  
Old 09-14-2016
Exclude variable from a file
Hello,

I have a list of patterns which I'd like to exclude from a file. I tried to do

Code:
while read line
do
grep -v $line file >> new.file
done < mylist

But obviously it won't work. It only works for just grep. I know I can do:

Code:
grep -Ev 'pattern1|pattern2|...' myfile

but my list is very long. Is there any other elegant way to do it? I don't need to use grep, anything else would be also fine.

Thank you!
# 2  
Old 09-14-2016
Did you consider using a pattern file:
Code:
grep -vf mylist file

This may not be the most efficient method, though.
This User Gave Thanks to RudiC For This Post:
coppuca
# 3  
Old 09-14-2016
Do you want to exclude the lines containing one of the patterns OR just the patterns in the lines?
# 4  
Old 09-14-2016
I need to exclude the lines
# 5  
Old 09-14-2016
Quote:
Originally Posted by coppuca
I need to exclude the lines
Then RudiC's suggestion should do what you want...
If the patterns in mylist are fixed strings, then:
Code:
grep -Fvf mylist file

will run a little bit faster. And, if the patterns are extended regular expression instead of basic regular expressions or fixed strings, you'd need:
Code:
grep -Evf mylist file

This User Gave Thanks to Don Cragun For This Post:
coppuca
# 6  
Old 09-14-2016
Quote:
Originally Posted by coppuca
I need to exclude the lines
In this case go with RudiCs excellent suggestion: "-v" inverts the match, excluding the lines matching the pattern and "-f" reads the patterns from a file instead of arguments from the command line. His command will process all the patterns in one pass.

I hope this helps.

bakunin

PS: Darn, Don types fast. ;-))
This User Gave Thanks to bakunin For This Post:
coppuca
# 7  
Old 09-14-2016
Thank you very much! It's working Smilie
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Find and exclude what is in file

Hello everyone, I try to find folders older than 3 years and display them, but excluding some directories, the below code does NOT exclude listed directories: find . -maxdepth 3 -mtime +1095 -type d -exec ls -l {} \; | grep -vFf oldExclude >> older oldExclude Folder1/ Folder2/... (7 Replies)
Discussion started by: Abu Rayane
7 Replies

2. UNIX for Dummies Questions & Answers

Exclude txt file in rsync

Hi Folks, I'm using rsync on Solaris 10 to backup a web server and need to exclude the cache and tmp directories. The man pages and google on rsync --exclude are ambiguous but I have tried--exclude=".*" and --exclude/remote_server/absolute_path with success only on the tmp files. Rather than make... (2 Replies)
Discussion started by: SmokeyJoe
2 Replies

3. UNIX for Dummies Questions & Answers

Reading file and exclude in ksh

I have a text file containing some file names. And I've a directory containing files with different name. I want to do some operaration (deleting) on the files which are NOT listed on the text file. Im using KSH. PLEASE HELP !!!!! Urgent Help!!!!! (2 Replies)
Discussion started by: maheshbabu
2 Replies

4. UNIX for Dummies Questions & Answers

Exclude file with tar

hi, i am trying to use a exclude file to exclude some file directories while making a tar archive. This is my command: tar -pcvf orahome10gR2.tar.gz db_1 -X /home/oracle/excludeFile.txt /home/oracle/ when i execute it, it seem to be tar-ing. But once is done, i cd to /home/oracle and could... (2 Replies)
Discussion started by: redologger
2 Replies

5. Shell Programming and Scripting

Exclude a file or not in

Hi Gurus. I have a directory and i receive many files with extension .log. I processed the file as i get it. i want to process all the files except one which i know i don't want to process. cd /backup/temp/rajesh/PACS #--- directory , under this i have below files... (1 Reply)
Discussion started by: guddu_12
1 Replies

6. Ubuntu

[Solved] Using Find with an exclude/exclude file

I am familiar with using tar and exclude/include files: tar zcf backup.dirs.tgz --files-from=include.mydirs --exclude-from=exclude.mydirs --no-recursion but was wondering if I could use find in the same way. I know that you can just specify the directories to exclude but my list is... (2 Replies)
Discussion started by: metallica1973
2 Replies

7. Shell Programming and Scripting

Have to exclude the first and last line of the file : help me

hi , i am very new to perl . scriptting.. pllease can any one help me ...pleaseeeeeee i ll have a file which look likes 123 |something |567 456 |welcome |789 457 |inboxpost |790 . . 123 |something |567 i have to execute all the lines in the file except the first and the... (14 Replies)
Discussion started by: vishwakar
14 Replies

8. Shell Programming and Scripting

ls to exclude file

I have cgicsave.env and cgic*, but I want to print cgic* value but NOT cgicsave.env Thanks (9 Replies)
Discussion started by: xs2punit
9 Replies

9. Shell Programming and Scripting

How to exclude certain colomn from the file?

Hi I have a file in the following format: 4135 f4135acc: 39798 rmtdb: 0 /t1/data/f4135acc.dta 4135 f4135pdb: 39795 rmtdb: 0 /bb/data/f4135pdb.dta 4135 p4135eng: 0 rmtdb: 0 /bb/bin/p4135eng 4135 r4135eng: 14142 rmtdb: 0 ... (6 Replies)
Discussion started by: aoussenko
6 Replies

10. UNIX for Dummies Questions & Answers

How to exclude a record from unix file

I want to exclude records from my unix file that have a specific pattern. How can I do this? Thanks. Ryan (1 Reply)
Discussion started by: Ryan2786
1 Replies
Login or Register to Ask a Question