Improving the efficiency of information collection and analysis in widely-used IT applications

Special Forums News, Links, Events and Announcements UNIX and Linux RSS News Improving the efficiency of information collection and analysis in widely-used IT applications

01-08-2011

Registered User

26,240, 27

Join Date: Sep 2000

Last Activity: 1 August 2008, 3:09 PM EDT

Posts: 26,240

Thanks Given: 0

Thanked 27 Times in 26 Posts

Improving the efficiency of information collection and analysis in widely-used IT applications

HPL-2010-164 (R.1) Improving the efficiency of information collection and analysis in widely-used IT applications - Blagodurov, Sergey; Arlitt, Martin
Keyword(s): efficiency, collection, analysis, DataSeries, Apache, Bro, Web server, Intrusion Detection System
Abstract: Modern IT environments collect and analyze increasingly large volumes of data for a growing number of purposes (e.g., automated management, security, regulatory compliance, etc.). Simultaneously, such environments are challenged by the need to minimize their environmental footprints. A general solut ...
Full Report

More...

Linux Bot

View Public Profile for Linux Bot

Find all posts by Linux Bot

Previous Thread | Next Thread

8 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

About efficiency of parallel memory allocation

Hello, there. I'm a new beginner to Linux kernel and curious about its memory management. When multiple applications apply for memory space at the same time, how Linux kernel solve the resource contending problem for high performance? I have known that there is a buddy system for allocating and...

2. Shell Programming and Scripting

File or Folder Efficiency?

I've got this program set up so that it creates files whose unique names specify the jobs their contents describe. In order to retrieve the information inside those files, I have to do a "grep" and awk or sed to extract it. I've just assumed that making a directory with that unique name that...

3. Shell Programming and Scripting

Apache Stats Collection Units information

#!/usr/bin/perl # ## Zabbix_Apache2.pl ## Versions 2.0 # use LWP::Simple; use strict; # my($url)="http://localhost/server-status?auto"; my($server_status)=get($url); my($total_accesses,$total_kbytes,$cpuload,$uptime, $reqpersec,$bytespersec,$bytesperreq,$busyworkers,...

4. Shell Programming and Scripting

What is the most widely used word anchor used in Regex?

Hello, All I learned from book about word anchor "\<" and "\>"; however when I tested them, they seem to work only in grep. Can anyone suggest word anchor that can be used in grep, awk, perl ...?

5. Shell Programming and Scripting

The efficiency between GREP and SED???

Hello Everyone! I am a newbie. I'd like to get key lines from a big txt file by Reg Exp, The file is nearly 22MB. GREP or SED?which may be the best choice,more efficient way? or any other best practise? Thank you in advance. Ever:)

6. Shell Programming and Scripting

Improve program efficiency (awk)

Hi !! I've finished an awk exercise. Here it is: #!/bin/bash function calcula { # Imprimimos el mayor tama�o de fichero ls -l $1 | awk ' BEGIN { max = $5; # Inicializamos la variable que nos guardar� el m�ximo con el tama�o del primer archivo } { if ($5 > max){ #...

7. Shell Programming and Scripting

Perl: code efficiency for gmtime

I have the following Perl snippet: # get datetime @dt = gmtime(); $strdate = 1900 + $dt . addleadingzero(++$dt) . addleadingzero($dt) . addleadingzero($dt) . addleadingzero($dt) . addleadingzero($dt); # write to file $outfile = $strdate . ".txt"; getstore($url, $outfile) or die "Error:...

8. Shell Programming and Scripting

efficiency..

how efficient is it, and how practical is it to call outside programs in a shell script (bash) for small tasks? for example, say i have a script that might preform many tasks, one of those tasks may require root access; rather than implementing inside the script a method to use su or sudo to...

LEARN ABOUT DEBIAN

rivet

RIVET(1)							   User Commands							  RIVET(1)

NAME

       rivet - Robust Independent Validation of Experiment and Theory

SYNOPSIS

       rivet [options] myfifo

OPTIONS

       --version
	      show program's version number and exit.

       -h, --help
	      show this help message and exit.

       -l NATIVE_LOG_STRS
	      set a log level in the Rivet library.

       -a ANA, --analysis=ANA
	      add an analysis to the processing list.

       --list-analyses
	      show the list of available analyses' names. With -v, it shows the descriptions, too.

       --list-used-analyses
	      list the analyses used by this command (after subtraction of inappropriate ones).

       --show-analysis=SHOW_ANALYSES, --show-analyses=SHOW_ANALYSES
	      show the details of an analysis.

       --analysis-path=PATH
	      specify the analysis search path (cf.  $RIVET_ANALYSIS_PATH).

       --analysis-path-append=PATH
	      append to the analysis search path (cf.  $RIVET_ANALYSIS_PATH).

       --pwd  append the current directory (pwd) to the analysis search path (cf. $RIVET_ANALYSIS_PATH).

       -H HISTOFILE, --histo-file=HISTOFILE
	      specify the output histo file path (default = Rivet.aida).

       -x XS, --cross-section=XS
	      specify the signal process cross-section in pb.

       -n NUM, --nevts=NUM
	      restrict the max number of events to read.

       --runname=NAME
	      give an optional run name, to be prepended as a 'top level directory' in histo paths.

       --ignore-beams
	      Ignore input event beams when checking analysis compatibility.

       --event-timeout=NSECS
	      max time in whole seconds to wait for an event to be generated from the specified source (default = 21600)

       --run-timeout=NSECS
	      max  time  in  whole  seconds  to  wait for the run to finish. This can be useful on batch systems such as the LCG Grid where tokens
	      expire on a fixed wall-clock and can render long Rivet runs unable to write out the final histogram file (default = unlimited).

       --histo-interval=HISTO_WRITE_INTERVAL
	      [experimental!] specify the number of events between histogram file updates. Default is to only write out at the	end  of  the  run.
	      Note  that intermediate histograms will be those from the analyze step only: analysis finalizing is currently not executed until the
	      end of the run.

       -v, --verbose
	      print debug (very verbose) messages.

       -q, --quiet
	      be very quiet.

EXAMPLES

	      mkfifo hepmc.fifo

	      my-generator -o myfifo &

	      rivet --analysis=ANALYSIS_NAME hepmc.fifo

ENVIRONMENT
:
       RIVET_ANALYSIS_PATH
	      list of paths to be searched for plugin analysis libraries at runtime.

       RIVET_REF_PATH
	      list of paths to be searched for reference data files.

       RIVET_INFO_PATH
	      list of paths to be searched for analysis metadata files.

AUTHOR

       This manual page was written by Lifeng Sun <lifongsun@gmail.com> for the Debian system (but may be used by others).

Rivet								     June 2012								  RIVET(1)

UNIX and Linux RSS News