08-04-2013
Can you extract (remove) lines from log files?
I use "MineOS" (a linux distro with python scripts and web ui included for managing a Minecraft Server). The author of the scripts is currently having a problem with the Minecraft server log file being spammed with certain entries. He's working on clearing up the spam.
But in the meantime, I'm wondering if I can run a shell script that will occasionally remove these spam lines (and only these lines) to keep the log file more manageable. Here is an example of the spam:
2013-08-02 20:51:30 [SEVERE] Reached end of stream for /127.0.0.1
2013-08-02 20:51:30 [INFO] /127.0.0.1:52343 lost connection
2013-08-02 20:51:30 [SEVERE] Reached end of stream for /127.0.0.1
2013-08-02 20:51:30 [INFO] /127.0.0.1:52344 lost connection
The consistent piece is the "
[SEVERE] Reached end of stream for /127.0.0.1". I would like to remove that entire line PLUS the single line that immediately follows each time (that lists 127.0.0.1:##### lost connection). But I don't want to remove other entries from the log file (named, "server.log" btw).
Is there a way to parse this server.log and selectively delete lines?
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi Experts,
I have lots of big size files. Below is the snapshot of a file. From the files i want extract informmation like belows. What could be command or script for that?
DELETE
RESP:940120105
CREATE
RESP:0
GET
RESP:0
File contains like below-
...
...
<log... (8 Replies)
Discussion started by: thepurple
8 Replies
2. Shell Programming and Scripting
I have two files and need to compare the two files and to remove the matching lines from both the files (4 Replies)
Discussion started by: shellscripter
4 Replies
3. Shell Programming and Scripting
hi all,
I have three files.
The first file (FILE_INFO in my code) consists of four parameters for each line.
0.00765600 0.08450704 M3 E3
0.00441931 0.04878049 M4 E5
0.01904574 0.21022727 M5 E10
0.00510400 0.05633803 M6 E12
0.00905960 ... (11 Replies)
Discussion started by: my_Perl
11 Replies
4. Shell Programming and Scripting
Hi all,
I'm a newbie and I'm sorry if my question is too simple.
I'm having problem to delete the files that have less than certain lines, say 16.
#!/bin/tcsh
set filen = `sh -c 'ls *csv 2> /dev/null'`
foreach fil (${filen})
if ]; then
rm -f ${filen}
fi
end
exit
... (2 Replies)
Discussion started by: GoldenFire
2 Replies
5. Shell Programming and Scripting
I have an xml file with the below data:
unix>Cat address.xml
<Address City=”Amsterdam”
Street = “station straat”
ZIPCODE="2516 CK "
</Address>
<Address City=”Amsterdam”
Street = “Leeuwen straat”
ZIPCODE="2517 AB "
</Address>
<Address City=”The Hauge”
Street = “kirk straat”
... (1 Reply)
Discussion started by: LinuxLearner
1 Replies
6. Shell Programming and Scripting
Hi everyone,
Fist of all I must confess that I am pretty new in the Unix environment and especially to shell scripting, however due to work related requirements I have started to analyze software specific logs.
The logs are structured so that it records by sessionID AND/OR Thread number, the... (3 Replies)
Discussion started by: sushimatt
3 Replies
7. Shell Programming and Scripting
Hello,
I need to run a command or shell script that will remove the last 3 lines from every .js file that is under the directory /var/ww/vhost/
Can you please help ?
thank you. (22 Replies)
Discussion started by: MaRiOsGR
22 Replies
8. Shell Programming and Scripting
I have some files containing the following data
# RESIDUE AA STRUCTURE BP1 BP2 ACC N-H-->O O-->H-N N-H-->O O-->H-N TCO KAPPA ALPHA PHI PSI X-CA Y-CA Z-CA
1 196 A M 0 0 230 0, 0.0 2,-0.2 0, 0.0 0, 0.0 0.000 360.0 360.0 360.0 76.4 21.7 -6.8 11.3
2 197 A D + 0 0 175 1,-0.1 2,-0.1 0, 0.0 0, 0.0... (10 Replies)
Discussion started by: edweena
10 Replies
9. Shell Programming and Scripting
I have two files, a keepout.txt and a database.csv. They're unsorted, but could be sorted.
keepout:
user1
buser3
anuser19
notheruser27
database:
user1,2343,"information about",field,blah,34
user2,4231,"mo info",etc,stuff,43
notheruser27,4344,"hiya",thing,more thing,423... (4 Replies)
Discussion started by: esoffron
4 Replies
10. UNIX for Dummies Questions & Answers
I used to use this script to extract the same lines from two files:
grep -f file1 file2 > outputfile
now I have file1 AB029895
AF208401
AF309648
AF526378
AJ444445
AJ720950
AJ851546
AY568629
AY591907
AY994087
BU116401
BU116599
BU119689
BU121308
BU125622
BU231446
BU236750
BU237045 (4 Replies)
Discussion started by: yuejian
4 Replies
LEARN ABOUT DEBIAN
load_dat_font
load_dat_font(3alleg4) Allegro manual load_dat_font(3alleg4)
NAME
load_dat_font - Loads a FONT from an Allegro datafile.
SYNOPSIS
#include <allegro.h>
FONT *load_dat_font(const char *filename, RGB *pal, void *param)
DESCRIPTION
Loads a FONT from an Allegro datafile. You can set param parameter to point to an array that holds two strings that identify the font and
the palette in the datafile by name. The first string in this list is the name of the font. You can pass NULL here to just load the first
font found in the datafile. The second string can be used to specify the name of the palette associated with the font. This is only
returned if the pal parameter is not NULL. If you pass NULL for the name of the palette, the last palette found before the font was found
is returned. You can also pass NULL for param, which is treated as if you had passed NULL for both strings separately. In this case, the
function will simply load the first font it finds from the datafile and the palette that precedes it.
For example, suppose you have a datafile named `fonts.dat' with the following contents:
FONT FONT_1_DATA
FONT FONT_2_DATA
FONT FONT_3_DATA
PAL FONT_1_PALETTE
PAL FONT_2_PALETTE
Then the following code will load FONT_1_DATA as a FONT and return FONT_1_PALETTE as the palette:
FONT *f;
PALETTE pal;
char *names[] = { "FONT_1_DATA", "FONT_1_PALETTE" }
f = load_dat_font("fonts.dat", pal, names);
If instead you want to load the second font, FONT_2, from the datafile, you would use:
FONT *f;
PALETTE pal;
char *names[] = { "FONT_2_DATA", "FONT_2_PALETTE" }
f = load_dat_font("fonts.dat", pal, names);
If you want to load the third font, but not bother with a palette, use:
FONT *f;
char *names[] = { "FONT_3_DATA", NULL }
f = load_dat_font("fonts.dat", NULL, names);
RETURN VALUE
Returns a pointer to the font or NULL on error. Remember that you are responsible for destroying the font when you are finished with it to
avoid memory leaks.
SEE ALSO
register_font_file_type(3alleg4), load_font(3alleg4)
Allegro version 4.4.2 load_dat_font(3alleg4)