Data Visualization For DNS, RADIUS Performance Logs
Hi there,
I have a script running on some DNS servers to calculate TPS, Success Rate and other Performance Counters.
My challenge is to get a Linux Data Visualization Software to collect these performance logs and produce a visualization that will be appealing to Business peeps. A sample of the logs is given below:
Code:
Tue Aug 19 13:00:11 WAT 2014 DNS query per second for 5 mins time range: 15389
Tue Aug 19 13:05:11 WAT 2014 DNS query per second for 5 mins time range: 15516
Tue Aug 19 13:10:11 WAT 2014 DNS query per second for 5 mins time range: 15269
Tue Aug 19 13:15:11 WAT 2014 DNS query per second for 5 mins time range: 15084
Tue Aug 19 13:20:11 WAT 2014 DNS query per second for 5 mins time range: 15068
Tue Aug 19 13:25:12 WAT 2014 DNS query per second for 5 mins time range: 15212
Tue Aug 19 13:30:12 WAT 2014 DNS query per second for 5 mins time range: 15137
Tue Aug 19 13:35:11 WAT 2014 DNS query per second for 5 mins time range: 15378
Tue Aug 19 13:40:12 WAT 2014 DNS query per second for 5 mins time range: 15250
Tue Aug 19 13:45:11 WAT 2014 DNS query per second for 5 mins time range: 15291
I know I can use tools like Centreon, Nagios, Cacti etc... But there are some nodes that due to restrictions, am only limited to be able to copy files from them, other access is restricted.
Can someone suggest an open source Data Visualization Software or Log Management or Business Intelligence that can work with my kind of Log files.
I have checked FLUENTD, ELK, GrayLog but it seems these are suited to some particular form of log like syslog.
You should plan on writing a script to order the different sets of data to fit the tool you use to present the data. Most tools accept delimited input files.
Greetings,
After a few hours of trial and error, I decide to ask for some help.
I am new to AWK and shell script, so please don't laugh :p
I made the below script, to gather data from some logs and have the output into a CSV file :
#!/bin/sh
#Script to collect Errors
... (9 Replies)
Hi,
We have HP OpenView tool to extract utilization report and extract them in csv. Every month I pull 30 days CPU and Memory utilization, every 5 minutes via GUI and export it in csv (excel) format. It is always a time consuming process to run it on a set of servers and then pick next set because... (0 Replies)
Hi Experts,
I am new to shell.How to extract logs (Web,APP,Database) using shell in performance testing?
Need for webserver logs,app server logs and d/b logs code.
Thanks in advance
Sree (3 Replies)
What is Performance data and Event data?
I want to write own discription about a data flow diagram but I don't understand exact meaning of following words.
1.Performance data
2.Event data
I googled it but still no luck.
Please guide me. (0 Replies)
How I can get the logs that are getting stored in specific location in unix server
through an Apache web server installed in unix server?
Requirement is to access the logs through the URL in windows browser without any access. (1 Reply)
I need to extract data from logs for a mentioned date range..Its quite urgent can anyone help me out with it..its to be written in unix..just thought its better to specify.. (4 Replies)
$SYBASE/bin/isql -U $DB_USERID -S $DB_SERVER << ! >> $OUTFILE
`echo $DB_PASSWD`
use $db
go
Print " The processing"
go
!
# Extract data to file
echo $DB_PASSWD | $SYBASE/bin/bcp $WRK_DB..open out $CONV_DIR/open".csv -t\, -c -U $DB_USERID -S $DB_SERVER -b 1000 | tail -3
I am able to... (0 Replies)
Hello,
I want to write a tool which fetches performance data from remote machines. Sounds easy? well there are some requirements:
No extra "client" software should be needed on the hosts, remote shell access (e.g. SSH) should be enough. -> I'm limited to a small amount of tools.
I want CPU,... (8 Replies)
Hi all,
I have a large log file that gets created daily.
I need to be able to pull text out of the log when I hit a pattern including the 7 lines above it and the 3 lines below and output it to a new text file.
Line 1
Line 2
Line 3
Line 4
Line 5
Line 6
Line 7
Pattern
Line 9
Line 10... (11 Replies)
