10-26-2007
Announcing collectl - new performance linux performance monitor
About 4 years ago I wrote this tool inspired by Rob Urban's collect tool for DEC's Tru64 Unix. What makes this tool as different as collect was in its day is its ability to run at a low overhead and collect tons of stuff. I've expanded the general concept and even include data not available in any other tool such as Infiniband or Lustre data. Collectl can collect it all and present it in a consistent output format. There's even an option to let you generate the data in plottable format.
Far to many features to talk about here but they are discussed on the website for
collectl
Ever wonder why ALL tools that monitor linux network stats at 1 second intervals report the wrong numbers? The short answer is because the stats are only updated once ever 0.9765 seconds and unless you have a monitor that can run at fractional intervals like collectl, you'll get wrong numbers! You can read more about it on collectl's website but don't take my word for it. Download it and try it out.
-mark
8 More Discussions You Might Find Interesting
1. AIX
I am an old HP 3000 systems administrator who had to retire the 3000 for some nice pseries AIX boxes. We are a Symitar site and the powers that be do not think we are ready for root acess. I need to find ways within my chains to view system statistics. Being able to wow someone in management... (3 Replies)
Discussion started by: Beetlejuice
3 Replies
2. Red Hat
Hi everyone,
The last two days I'm researching results of NFS operations on Linux, and I noticed some time difference when read and write.
cat /proc/version : Linux version 2.6.9-42.ELsmp (bhcompile@hs20-bc1-1.build.redhat.com) (gcc version 3.4.6 20060404 (Red Hat 3.4.6-2)) #1 SMP Wed Jul 12... (1 Reply)
Discussion started by: sysgate
1 Replies
3. HP-UX
Hello,
there. We want to write application on HP-UX to monitor system resource,such as CPU,Network Traffic Load,Disk Usage,etc. Anyone know these API functions except the system command ? thanks. (6 Replies)
Discussion started by: Frank2004
6 Replies
4. Red Hat
I am getting absolutely dreadful iowait stats on my disks when I am trying to install some applications.
I have 2 physical disks on which I have created 2 separate logical volume groups and a logical volume in each. I have dumped some stats as below
My dual core CPU is not being over utilised... (3 Replies)
Discussion started by: jimthompson
3 Replies
5. AIX
Dear experts ,
Pls advice for any good Tool to monitor the CPU and performance of AIX the system ..
to keep monitoring to show me the utilization of that system .. (12 Replies)
Discussion started by: Mr.AIX
12 Replies
6. UNIX for Dummies Questions & Answers
One of our database server is suddenly became very slow and i have no clue what to do .Please help. I m sharing the performance inforamtion regarding cpu,harddisk,ram .
########CPU Information########
Machine Uptime Information:
uptime
10:25:06 up 16:50, 1 user, load average: 5.84, 5.65,... (10 Replies)
Discussion started by: pinga123
10 Replies
7. Programming
Hi,
May i know the tools which will give the below details in a consolidated fashion for some 'X' duration in single and multicore processors,
1) How many times and how long scheduler code and kernel threads are executing ?
2) Details about each process, time spent in each state (run, wait... (0 Replies)
Discussion started by: tkarthi85
0 Replies
8. Red Hat
IN solaris, for network high-availability we are using IPMP concept, can u tell me in REDHAT LINUX what we are using... also pls share good step to read & understand the that concept...
Also performance issue in linux what are step & cmd can u tell me??? (2 Replies)
Discussion started by: tiger09
2 Replies
LEARN ABOUT DEBIAN
genplotfiles
GENPLOTFILES(1) colplot GENPLOTFILES(1)
NAME
genplotfiles - utility to help automate creation of collectl plot file from raw ones
SYNOPSIS
/opt/hp/colplot/genplotfiles.pl -outdir [-switches]
DESCRIPTIONS
This utility is not intended to meet all plot file creation needs, but quite frankly should meet most. Features not provided with this
utility are best realized by running collectl directly in playback mode (see collectl -p). It is therefore important to understand what
this utility will and will not do for you before building an automation strategy around it.
The algorithm used is fairly simple - genplotfiles examines each collectl raw file to see it it falls within the data ranges (if specified)
and contains a matching hostname (if specified). If a plot file already exists, the timestamps are compared and the raw file skipped if
its newer than the plotfile.
Any raw files that pass all these tests are then passed to collectl with their timestamp wildcarded. The result is all raw files for that
host/date will be processed. This means if you copy over collectl raw files multiple times over the course of the day using rsync, you can
immediately genererate up-to-date plots for them using genplotfiles. Furthermore, you won`t even need any date parameters if the older
plot files are alreay up to date.
For an example of what a cron job that aggregates multiple collectl logs onto a single system for plotting purposes, see crontab.sh in the
same directory as this script.
SWITCHES
All switches are optional with the exception of -outdir:
-colbin path-to-collectl
This points to collectl and is only necessary if /usr/sbin is not in your path or you`ve chosen to install collectl in a non-stan-
dard directory.
-debug number
Primarily for development, will provide intermediate processing information based on its value. See souce for details.
-force
Always generate plot files even in there is an existing one that is newer than the latest raw file. This will be necessary if you
want to rerun this script and just change the value of -subsys.
-help
Print a summary of available switches.
-host string
Only process files that contain this string in their hostname portion of the filename.
-indir directory
Directory where to look for collectl logs. The default is /var/log/collectl and is therefore only necessary if your logs are in a
non-standard location.
-outdir directory
Directory into which to write the plottable files. This field is required.
-fromdate date
Ignore files with a datestamp in their name less that this value. The default is 20050101 and so defaults to all files. The value
of `yesterday` is also recognized to simplify scripts that call this.
-thrudate date
Ignore files with a datestamp in their name with a datestamp greater than this value. The default is the current day and one can
also specify a value of `yesterday`.
-subsys string
Instead of using the default subsystems for which data was collected, generate output files based on this set. There are basically
two reasons for doing this. The first is that you may want to reduce the size of the plot files, though with compression there is
rarely much point in this. The second is if you`ve asked collectl to collect summary data but want to plot detail data.
See the colplot FAQ for more information.
AUTHOR
This program was written by Mark Seger (mjseger@gmail.com).
Copyright 2005 Hewlett-Packard Development Company, L.P.
SEE ALSO
LOCAL
OCTOBER 2005 GENPLOTFILES(1)