Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Can you extract (remove) lines from log files?
Top Forums Shell Programming and Scripting Can you extract (remove) lines from log files? Post 302841645 by nbsparks on Wednesday 7th of August 2013 05:26:23 PM
Old 08-07-2013
So, if I want to catch "end of stream" and "lost connection" messages for IP addresses other than local host, could I do this for a script?

Code:
awk '(!/SEVERE/ || !/end of stream/ || !/127.0.0.1/) && (!/INFO/ || !/127.0.0.1/ || !/lost connection/)' server.log

Thanks for your help!

---------- Post updated at 02:26 PM ---------- Previous update was at 02:05 PM ----------

I modified a few IP addresses and tested with adding the extra bits to your code.

Here is what I came up with for my script:
Code:
cp server.log server.log.backup
awk '(!/SEVERE/ || !/end of stream/ || !/127.0.0.1/) && (!/INFO/ || !/127.0.0.1/ || !/lost connection/)' server.log.backup >server.log

Thank you!
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

is it hard to extract particular lines & strings from the files??

Hi Experts, I have lots of big size files. Below is the snapshot of a file. From the files i want extract informmation like belows. What could be command or script for that? DELETE RESP:940120105 CREATE RESP:0 GET RESP:0 File contains like below- ... ... <log... (8 Replies)
Discussion started by: thepurple
8 Replies

2. Shell Programming and Scripting

compare two files and to remove the matching lines on both the files

I have two files and need to compare the two files and to remove the matching lines from both the files (4 Replies)
Discussion started by: shellscripter
4 Replies

3. Shell Programming and Scripting

Extract lines from files

hi all, I have three files. The first file (FILE_INFO in my code) consists of four parameters for each line. 0.00765600 0.08450704 M3 E3 0.00441931 0.04878049 M4 E5 0.01904574 0.21022727 M5 E10 0.00510400 0.05633803 M6 E12 0.00905960 ... (11 Replies)
Discussion started by: my_Perl
11 Replies

4. Shell Programming and Scripting

Remove the files that have less than certain lines

Hi all, I'm a newbie and I'm sorry if my question is too simple. I'm having problem to delete the files that have less than certain lines, say 16. #!/bin/tcsh set filen = `sh -c 'ls *csv 2> /dev/null'` foreach fil (${filen}) if ]; then rm -f ${filen} fi end exit ... (2 Replies)
Discussion started by: GoldenFire
2 Replies

5. Shell Programming and Scripting

How to extract lines between tags into different files?

I have an xml file with the below data: unix>Cat address.xml <Address City=”Amsterdam” Street = “station straat” ZIPCODE="2516 CK " </Address> <Address City=”Amsterdam” Street = “Leeuwen straat” ZIPCODE="2517 AB " </Address> <Address City=”The Hauge” Street = “kirk straat” ... (1 Reply)
Discussion started by: LinuxLearner
1 Replies

6. Shell Programming and Scripting

Extract Log lines with Thread-(regex)

Hi everyone, Fist of all I must confess that I am pretty new in the Unix environment and especially to shell scripting, however due to work related requirements I have started to analyze software specific logs. The logs are structured so that it records by sessionID AND/OR Thread number, the... (3 Replies)
Discussion started by: sushimatt
3 Replies

7. Shell Programming and Scripting

How to remove the last 3 lines from many files?

Hello, I need to run a command or shell script that will remove the last 3 lines from every .js file that is under the directory /var/ww/vhost/ Can you please help ? thank you. (22 Replies)
Discussion started by: MaRiOsGR
22 Replies

8. Shell Programming and Scripting

Extract lines from text files

I have some files containing the following data # RESIDUE AA STRUCTURE BP1 BP2 ACC N-H-->O O-->H-N N-H-->O O-->H-N TCO KAPPA ALPHA PHI PSI X-CA Y-CA Z-CA 1 196 A M 0 0 230 0, 0.0 2,-0.2 0, 0.0 0, 0.0 0.000 360.0 360.0 360.0 76.4 21.7 -6.8 11.3 2 197 A D + 0 0 175 1,-0.1 2,-0.1 0, 0.0 0, 0.0... (10 Replies)
Discussion started by: edweena
10 Replies

9. Shell Programming and Scripting

Two files, remove lines from second based on lines in first

I have two files, a keepout.txt and a database.csv. They're unsorted, but could be sorted. keepout: user1 buser3 anuser19 notheruser27 database: user1,2343,"information about",field,blah,34 user2,4231,"mo info",etc,stuff,43 notheruser27,4344,"hiya",thing,more thing,423... (4 Replies)
Discussion started by: esoffron
4 Replies

10. UNIX for Dummies Questions & Answers

Extract the same lines from the two files

I used to use this script to extract the same lines from two files: grep -f file1 file2 > outputfile now I have file1 AB029895 AF208401 AF309648 AF526378 AJ444445 AJ720950 AJ851546 AY568629 AY591907 AY994087 BU116401 BU116599 BU119689 BU121308 BU125622 BU231446 BU236750 BU237045 (4 Replies)
Discussion started by: yuejian
4 Replies

LEARN ABOUT DEBIAN

cmannotifyd

cmannotifyd(8)						     CMAN Notification Daemon						    cmannotifyd(8)

NAME

       cmannotifyd - CMAN Notification Daemon

SYNOPSIS

       cmannotifyd [-f] [-d]

DESCRIPTION

       The cmannotifyd daemon talks to CMAN and provides a mechanism to notify external entities about cluster changes.

       CMAN dispatches 3 kind of notifications:

       - CMAN_REASON_TRY_SHUTDOWN when cman requests to all clients if it is allowed to shutdown.

       - CMAN_REASON_STATECHANGE when cman detects a node joining or leaving the cluster.

       - CMAN_REASON_CONFIG_UPDATE when a configuration change event has been detected/requested.

       These notifications are then dispatched to the shell script cman_notify in the environment variable CMAN_NOTIFICATION.

       cman_notify will then execute all the scripts in the configured notification directory (default: /etc/cluster/cman-notify.d) passing a very
       minimal set of envvars including, of course, the CMAN_NOTIFICATION= type.  The execution order is set by the filename as shown by "LC_ALL=C
       ls -las".

       cmannotifyd logs are stored in the default log file (/var/log/cluster/cmannotifyd.log).

       cman_notify  logs are stored in the default log file (/var/log/cluster/cman_notify.log). By default the output from the scripts executed by
       cman_notify is redirected to /dev/null.	Users can either set CMAN_NOTIFICATION_DEBUG=1 in their environment or set proper debug configura-
       tion in cluster.conf to redirect scripts output to the cman_notify log file.

NOTES

       cmannotifyd does not block on cman_notify nor check the exit status of the script.

       Notifications are dispatched in the same order as they arrive, one by one.

       CMAN_REASON_TRY_SHUTDOWN  is  passed  to  scripts  for information only, they can not influence cman's decsion about whether or not to shut
       down.

       CMAN_REASON_STATECHANGE also implies CMAN_NOTIFICATION_QUORUM exported in the environment. CMAN_NOTIFICATION_QUORUM will be set to 1  (when
       the node is part of a quorate cluster) or 0 (otherwise).

       A template for cman_notify scripts can be found in the doc/ directory.

OPTIONS

       -f     Run in the foreground (do not fork / daemonize).

       -d     Enable debug output.

								   November 2008						    cmannotifyd(8)
All times are GMT -4. The time now is 03:44 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy