Problems with "grep -vf", and exclusion files Post: 302877397

Sponsored Content

Top Forums UNIX for Dummies Questions & Answers Problems with "grep -vf", and exclusion files Post 302877397 by Doug Lassiter on Saturday 30th of November 2013 06:13:30 PM

11-30-2013

Registered User

Problems with "grep -vf", and exclusion files

OK, this really has me bolluxed.

I'm using Mac 10.6.8, and I'm trying to do simple analysis of my Apache logs in Unix. Let's call that text file "log".

Now I want to remove from that file all lines with incomplete GETs, so I do

Code:

grep -vf exclude log > out

where the file "exclude" has lines (one each) for 206 , 304 , 403 , 404 , 405 , 500 (included spaces). Those are status codes whose lines I want to remove from the log file. That works great.

Oh, I'll get rid of requests for mp3s too. So I add to that exclude file a line with "mp3" in it. I run the command, and it goes off in never-never land.

If I use an exclude file with just "mp3" in it, it works fine. Lines containing "mp3" are removed.

If I use an exclude file with "mp3" and "invitation" it works fine. Those lines are removed.

But if I use an exclude file with three or more lines of alphabetical characters, like "mp3, "invitation", and "pdf", it goes off into never-never land.

The rule seems to be that the "exclude" file works great with a list of numbers, OR with two or less words (as in, not numbers). This seems just nuts. What's going on??? I have basic Unix expertise. Is this a Mac peculiarity, or is there something else going on?

Last edited by radoulov; 12-01-2013 at 05:11 AM..

Doug Lassiter

View Public Profile for Doug Lassiter

Find all posts by Doug Lassiter

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

grep to find content in between curly braces, "{" and "},"

problem String ~~~~~~~~~~~~~~~~~~ icecream= { smart peopleLink "good" LC "happy" , smartpeopleLink "dull" LC "sad" } aend = {smart vc4 eatr kalu} output needed ~~~~~~~~~~~~~~~~~~ smart peopleLink "good" LC "happy" , smartpeopleLink "dull" LC "sad" smart vc4...

2. UNIX for Dummies Questions & Answers

Explain the line "mn_code=`env|grep "..mn"|awk -F"=" '{print $2}'`"

Hi Friends, Can any of you explain me about the below line of code? mn_code=`env|grep "..mn"|awk -F"=" '{print $2}'` Im not able to understand, what exactly it is doing :confused: Any help would be useful for me. Lokesha

3. Shell Programming and Scripting

ls -laR | grep "^-" | awk '{print $9}'| grep "$.txt"

Hi, I don't know hot to make this command work: ls -laR | grep "^-" | awk '{print $9}'| grep "$.txt" It should return the list of file .txt It's important to search .txt at the end of the line, becouse some file name have "txt" in their name but have other extensions

4. UNIX for Dummies Questions & Answers

How to use the "grep/egrep" command to search files.

Hi Team, I am new to this forum and also trying to learn Unix. I will highly appriciate your help if you can help me to get the right command . {{{ I use the command " today | egrep '(10:| 11: )' | grep ERROR " to grep all the files that has been error betweeen 10 to 11...

5. AIX

xx=`date +"%a %b %d"`;rsh xxx grep "^$XX" zzz ?

AIX 4.2 I am trying to do an rsh grep to search for date records inside server logs by doing this : xx=`date +"%a %b %d"` rsh xxx grep "^$XX" zzz gives : grep: 0652-033 Cannot open Jun. grep: 0652-033 Cannot open 11. But if I do : xx=`date +"%a %b %d"` grep "^$XX" zzz it works...

6. Shell Programming and Scripting

"Join" or "Merge" more than 2 files into single output based on common key (column)

Hi All, I have working (Perl) code to combine 2 input files into a single output file using the join function that works to a point, but has the following limitations: 1. I am restrained to 2 input files only. 2. Only the "matched" fields are written out to the "matched" output file and...

7. Shell Programming and Scripting

ps -ef | grep "string1" "string2" " "string3"

Hi all, can any one suggest me the script to grep multiple strings from ps -ef pls correct the below script . its not working/ i want to print OK if all the below process are running in my solaris system. else i want to print NOT OK. bash-3.00$ ps -ef | grep blu lscpusr 48 42 ...

8. Shell Programming and Scripting

awk command to replace ";" with "|" and ""|" at diferent places in line of file

Hi, I have line in input file as below: 3G_CENTRAL;INDONESIA_(M)_TELKOMSEL;SPECIAL_WORLD_GRP_7_FA_2_TELKOMSEL My expected output for line in the file must be : "1-Radon1-cMOC_deg"|"LDIndex"|"3G_CENTRAL|INDONESIA_(M)_TELKOMSEL"|LAST|"SPECIAL_WORLD_GRP_7_FA_2_TELKOMSEL" Can someone...

9. Shell Programming and Scripting

grep with "[" and "]" and "dot" within the search string

Hello. Following recommendations for one of my threads, this is working perfectly : #!/bin/bash CNT=$( grep -c -e "some text 1" -e "some text 2" -e "some text 3" "/tmp/log_file.txt" ) Now I need a grep success for some thing like : #!/bin/bash CNT=$( grep -c -e "some text_1...

10. Shell Programming and Scripting

Delete all log files older than 10 day and whose first string of the first line is "MSH" or "<?xml"

Dear Ladies & Gents, I have a requirement to delete all the log files in /var/log/test directory that are older than 10 days and their first line begin with "MSH" or "<?xml" or "FHS". I've put together the following BASH script, but it's erroring out: for filename in $(find /var/log/test...

LEARN ABOUT DEBIAN

normalize-mp3

NORMALIZE-MP3(1)					      General Commands Manual						  NORMALIZE-MP3(1)

NAME

       normalize-mp3 - adjust levels of mp3 or ogg files by running normalize-audio(1), then re-encoding

SYNOPSIS

	normalize-mp3 [OPTION]... [FILE]...
	normalize-ogg [OPTION]... [FILE]...

DESCRIPTION

       Normalize  volume  of  mp3  or  ogg  files  by decoding, running normalize, and re-encoding.  This requires as much extra disk space as the
       largest mp3 or ogg file, decoded.  Note that for batch and mix mode, all files must be decoded, so there must be enough disk space for  the
       decoded copies of all specified mp3 and ogg files.

       --ogg  Convert files to OGG, regardless of original format

       --mp3  Convert files to MP3, regardless of original format

       --bitrate BR
	      Set bitrate of re-encoded file (default 128)

       --tmpdir TMP
	      Put temporary WAV files in temp directory TMP

       --notags
	      Do not copy ID3 or OGG tags to the output file

       The  following  four options may be used to set the encoder and decoder commands for mp3 and ogg vorbis.  %m is expanded to the name of the
       mp3 or vorbis file, %w expands to the name of the temporary WAV file, and %b expands to the bitrate, as specified by the --bitrate  option.
       Run normalize-mp3 with no arguments to see the default values.

       --mp3encode=X
	      mp3 encoder

       --mp3decode=X
	      mp3 decoder

       --oggencode=X
	      ogg vorbis encoder

       --oggdecode=X
	      ogg vorbis decoder

       -h     Display this help and exit.

       -V     Display version information and exit.

       These arguments are passed as arguments to normalize-audio.
	      Run "normalize-audio --help" for more info.

       -a AMP

       -g ADJ

       -n

       -T THR

       -b

       -m

       -v

       -q

       REPORTING BUGS
	      Report bugs to <chrisvaill@gmail.com>.

SEE ALSO

       The normalize-audio(1) Man page

NOTES

       This page was provided by Eduardo Macan <macan@debian.org>

								  September 2001						  NORMALIZE-MP3(1)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

grep to find content in between curly braces, "{" and "},"

Discussion started by: keshav_rk

2. UNIX for Dummies Questions & Answers

Explain the line "mn_code=`env|grep "..mn"|awk -F"=" '{print $2}'`"

Discussion started by: Lokesha

3. Shell Programming and Scripting

ls -laR | grep "^-" | awk '{print $9}'| grep "$.txt"

Discussion started by: DNAx86

4. UNIX for Dummies Questions & Answers

How to use the "grep/egrep" command to search files.

Discussion started by: rkhanal