Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Removing a pattern from a log file
Top Forums Shell Programming and Scripting Removing a pattern from a log file Post 302471964 by kristinu on Monday 15th of November 2010 08:14:48 PM
Old 11-15-2010
Removing a pattern from a log file
I want to remove lines containing a tag from a log file.


Code:
cat file.log | awk '!/ ${pattern} /'

I want to pass a pattern as an argument to a csh script, that will then apply the removal of those lines.

For example passing the pattern (DIAG) should remove all lines having (DIAG).
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

removing duplicates of a pattern from a file

hey all, I need some help. I have a text file with names in it. My target is that if a particular pattern exists in that file more than once..then i want to rename all the occurences of that pattern by alternate patterns.. for e.g if i have PATTERN occuring 5 times then i want to... (3 Replies)
Discussion started by: ashisharora
3 Replies

2. Shell Programming and Scripting

Removing duplicates from log file?

I have a log file with posts looking like this: -- Messages can be delivered by different systems at different times. The id number is used to sort out duplicate messages. What I need is to strip the arrival time from each post, sort posts by id number, and reattach arrival time to respective... (2 Replies)
Discussion started by: Ilja
2 Replies

3. Shell Programming and Scripting

removing lines around a matched pattern

I have an ugly conf file that has the string I'm interested in searching for in the middle of a block of code that's relevant, and I'm trying to find a way to remove that entire block based on the matched line. I've googled for this problem, and most people helping are only interested in... (9 Replies)
Discussion started by: tamale
9 Replies

4. Shell Programming and Scripting

Removing all lines prior to the last pattern in a file/stream

Hi all, I didn't find anything that specifically answers this after searching for a bit, so please forgive me if this has been covered before. I'm looking to delete all lines prior to the last occurrence of a string in a file or stream from within a shell script (bash.) A bit of... (4 Replies)
Discussion started by: LivinFree
4 Replies

5. Shell Programming and Scripting

PERL "filtering the log file removing the duplicates

Hi folks, I have a log file in the below format and trying to get the output of the unique ones based on mnemonic IN PERL. Could any one please let me know with the code and the logic ? Severity Mnemonic Log Message 7 CLI_SCHEDULER Logfile for scheduled CLI... (3 Replies)
Discussion started by: scriptscript
3 Replies

6. Shell Programming and Scripting

Removing Colors and ^M in a log file

Hi, I'm trying to send a log file to mailx as a "Body Message" but since the file contains so many control and color characters it's making an attachement out of it instead of putting it in the body. The file looks like this: Bringing up loopback interface: ^^M^MŽ 19 Bringing up interface... (18 Replies)
Discussion started by: dgtek
18 Replies

7. UNIX for Dummies Questions & Answers

Grep from pattern file without removing duplicates?

I have been using grep to output whole lines using a pattern file with identifiers (fileA): fig|562.2322.peg.1 fig|562.2322.peg.3 fig|562.2322.peg.3 fig|562.2322.peg.3 fig|562.2322.peg.7 From fileB with corresponding identifiers in the second column: NODE_0 fig|562.2322.peg.1 peg ... (2 Replies)
Discussion started by: Mauve
2 Replies

8. Shell Programming and Scripting

Removing a pattern in a line

Dear team, I have a file curve.csv which is generated from oracle and each line has a comment associated with it, I want to get rid of this comment, can you please suggest me a command as how to do it Eg, cat curve.csv /*data for today curve*/ /*data for text1*/ this is the header /*data... (6 Replies)
Discussion started by: infyanurag
6 Replies

9. Shell Programming and Scripting

Archiving or removing few data from log file in real time

Hi, I have a log file that gets updated every second. Currently the size has grown to 20+ GB. I need to have a command/script, that will try to get the actual size of the file and will remove 50% of the data that are in the log file. I don't mind removing the data as the size has grown to huge... (8 Replies)
Discussion started by: Souvik Patra
8 Replies

10. UNIX for Dummies Questions & Answers

Removing PATTERN from txt without removing lines and general text formatting

Hi Everybody! First post! Totally noobie. I'm using the terminal to read a poorly formatted book. The text file contains, in the middle of paragraphs, hyphenation to split words that are supposed to be on multiple pages. It looks ve -- ry much like this. I was hoping to use grep -v " -- "... (5 Replies)
Discussion started by: AxeHandle
5 Replies

LEARN ABOUT REDHAT

exigrep

EXIGREP(8)						      System Manager's Manual							EXIGREP(8)

NAME

       EXIGREP - Search Exim's main log

SYNOPSIS

       exigrep [-l] pattern [log file] ...

DESCRIPTION

       The  exigrep  utility  is  a  Perl script that searches one or more main log files for entries that match a given pattern.  When it finds a
       match, it extracts all the log entries for the relevant message, not just those that match the pattern.	Thus, exigrep can extract complete
       log entries for a given message, or all mail for a given user, or for a given host, for example.

       The -l flag means 'literal', that is, treat all characters in the pattern as standing for themselves.  Otherwise the pattern must be a Perl
       regular expression.  The pattern match is case-insensitive.  If no file names are given on the command line, the standard input is read.

       If the location of a zcat command is known from the definition of ZCAT_COMMAND in Local/Makefile, exigrep  automatically  passes  any  file
       whose name ends in COMPRESS_SUFFIX through zcat as it searches it.

BUGS

       This manual page needs a major re-work. If somebody knows better groff than us and has more experience in writing manual pages, any patches
       would be greatly appreciated.

SEE ALSO

       exim(8), perlre(1), /usr/share/doc/exim4-base/

AUTHOR

       This manual page was stitched together from spec.txt by Andreas Metzler <ametzler at downhill.at.eu.org>, for the Debian  GNU/Linux  system
       (but may be used by others).

								  March 26, 2003							EXIGREP(8)
All times are GMT -4. The time now is 03:03 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy