01-08-2011
Improving the efficiency of information collection and analysis in widely-used IT applications
HPL-2010-164 (R.1)
Improving the efficiency of information collection and analysis in widely-used IT applications - Blagodurov, Sergey; Arlitt, Martin
Keyword(s): efficiency, collection, analysis, DataSeries, Apache, Bro, Web server, Intrusion Detection System
Abstract: Modern IT environments collect and analyze increasingly large volumes of data for a growing number of purposes (e.g., automated management, security, regulatory compliance, etc.). Simultaneously, such environments are challenged by the need to minimize their environmental footprints. A general solut ...
Full Report
More...
8 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
how efficient is it, and how practical is it to call outside programs in a shell script (bash) for small tasks?
for example, say i have a script that might preform many tasks, one of those tasks may require root access; rather than implementing inside the script a method to use su or sudo to... (11 Replies)
Discussion started by: norsk hedensk
11 Replies
2. Shell Programming and Scripting
I have the following Perl snippet:
# get datetime
@dt = gmtime();
$strdate = 1900 + $dt . addleadingzero(++$dt) . addleadingzero($dt) . addleadingzero($dt) . addleadingzero($dt) . addleadingzero($dt);
# write to file
$outfile = $strdate . ".txt";
getstore($url, $outfile) or die "Error:... (3 Replies)
Discussion started by: figaro
3 Replies
3. Shell Programming and Scripting
Hi !! I've finished an awk exercise. Here it is:
#!/bin/bash
function calcula
{
# Imprimimos el mayor tamaño de fichero
ls -l $1 | awk '
BEGIN {
max = $5; # Inicializamos la variable que nos guardará el máximo con el tamaño del primer archivo
}
{
if ($5 > max){ #... (8 Replies)
Discussion started by: Phass
8 Replies
4. Shell Programming and Scripting
Hello Everyone!
I am a newbie. I'd like to get key lines from a big txt file by Reg Exp, The file is nearly 22MB.
GREP or SED?which may be the best choice,more efficient way?
or any other best practise?
Thank you in advance.
Ever:) (5 Replies)
Discussion started by: ever
5 Replies
5. Shell Programming and Scripting
Hello, All
I learned from book about word anchor "\<" and "\>"; however when I tested them, they seem to work only in grep.
Can anyone suggest word anchor that can be used in grep, awk, perl ...? (3 Replies)
Discussion started by: littlewenwen
3 Replies
6. Shell Programming and Scripting
#!/usr/bin/perl
#
## Zabbix_Apache2.pl
## Versions 2.0
#
use LWP::Simple;
use strict;
#
my($url)="http://localhost/server-status?auto";
my($server_status)=get($url);
my($total_accesses,$total_kbytes,$cpuload,$uptime, $reqpersec,$bytespersec,$bytesperreq,$busyworkers,... (0 Replies)
Discussion started by: Shivaramakrishn
0 Replies
7. Shell Programming and Scripting
I've got this program set up so that it creates files whose unique names specify the jobs their contents describe. In order to retrieve the information inside those files, I have to do a "grep" and awk or sed to extract it. I've just assumed that making a directory with that unique name that... (1 Reply)
Discussion started by: gmark99
1 Replies
8. UNIX for Advanced & Expert Users
Hello, there.
I'm a new beginner to Linux kernel and curious about its memory management.
When multiple applications apply for memory space at the same time, how Linux kernel solve the resource contending problem for high performance?
I have known that there is a buddy system for allocating and... (4 Replies)
Discussion started by: blackwall
4 Replies
kgmon(8) Unsupported kgmon(8)
Name
kgmon - generate a dump of the operating system's profile buffers
Syntax
/etc/kgmon [ options ] [ system ] [ memory ]
Description
The command is used when profiling the operating system. When no arguments are supplied, indicates the state of operating system profiling
as running, off, or not configured. For further information, see If the option is specified, extracts profile data from the operating sys-
tem and produces a file suitable for later analysis by
The file is first converted to a format suitable for by using the filter. The command dumps the kernel profiling data for all the proces-
sors in the system. The command is used to create a file suitable for analysis by for any or all the processors in the system.
Options
-b Resumes the collection of profile data.
-h Stops the collection of profile data.
-p Dumps the contents of the profile buffers into a file.
-r Resets all the profile buffers. If the option is also specified, the file is generated before the buffers are reset.
If neither nor is specified, the state of profiling collection remains unchanged. For example, if the option is specified and profile data
is being collected, profiling will be momentarily suspended, the operating system profile buffers will be dumped, and profiling will be
immediately resumed.
Diagnostics
Users with only read permission on cannot change the state of profiling collection. They can get a file with the warning that the data may
be inconsistent if profiling is in progress.
Files
Default system
Default memory
See Also
gprof(1), config(8), kgconv(8)
kgmon(8)