How to find out and monitor IO spikes history in Linux?


 
Thread Tools Search this Thread
Top Forums UNIX for Advanced & Expert Users How to find out and monitor IO spikes history in Linux?
# 1  
Old 11-02-2019
How to find out and monitor IO spikes history in Linux?

hello all
i have application which according to AWS monitoring is reaching to high spikes of IO at random time .
and causing the server to crash and restart .
my question is how can i find out what cause the spike and if i can't with the native linux tools
what free open source minimon intrusive monitor i can use ?
thanks
# 2  
Old 11-02-2019
Greetings,
I would try to write a script for cron using perhaps sar with what you mention my first reflex would be to look at the swap usage side, as most probably, memory issue could be the cause, now we really dont know enough about your server's architecture to be able to give usefull replies...
# 3  
Old 11-02-2019
thanks for your reply , the application is java tomcat web server which doing heavy batch operation involve reading and writing to DB which is in different server
can you please explain what is : "swap usage side" how do i measure it and what does it mean ?
also what are the best sar parameters to pinpoint what process operation doing the heavy IO
# 4  
Old 11-02-2019
Hi umen...

"swap usage side" means the file and/or partition of a disk or disks used to swap data out of and into memory. Nearly ALWAYS data nowadays but could be overlays of active code in embedded systems.

Surely you have heard of SWAPFILEs used in MS Windows OSes?

Also the /tmp drawer is technically a SWAP area if absolutely necessary...

EDIT:
man swapon for Linux systems...

Last edited by wisecracker; 11-02-2019 at 12:22 PM.. Reason: See EDIT.
This User Gave Thanks to wisecracker For This Post:
# 5  
Old 11-02-2019
thanks
yeah i know what is swap file, i wanted to learn something new from experts
# 6  
Old 12-03-2019
For Linux statistics, you can try with


1) sar : If sar was enabled, you can review performance statistics of several days ago, you can use "ksar" to generate the graphs.
2) nmon: is a excellent tools for perfomance analytics, the disadvantage is that you need run the command (manually or with crontab), but you can find multiples tools to generate the graphics.
# 7  
Old 12-04-2019
Quote:
Originally Posted by umen
i wanted to learn something new from experts
Here is something you obviously haven't known yet: DESCRIBE YOUR PROBLEM concisely first before you expect sensible answers: which OS? which "I/O problem"? Is it network I/O, disk I/O, serial I/O or WTF-I/O?

The way you asked you don't need an expert, you need a magician.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Nearly Random, Uncorrelated Server Load Average Spikes

I have been wrangling with a small problem on a Ubuntu server which runs a LAMP application. Linux ubuntu 4.15.0-33-generic #36-Ubuntu SMP Wed Aug 15 16:00:05 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux This server runs fine, basically: ubuntu:/var/www# uptime 20:17:13 up 105 days,... (45 Replies)
Discussion started by: Neo
45 Replies

2. What is on Your Mind?

New UNIX and Linux History Sections

Dear All, Taking a break from Vue.js coding for the site, SEO and YT videos; and hopefully addressing some well deserved criticism from some here that I have been too focused on the visual aspects of the forums versus the substance and the community.... While the "current generation... (9 Replies)
Discussion started by: Neo
9 Replies

3. HP-UX

How to find the head cleaning history on HP HP MSL4048 1 LT0-4 Ultrium 1840?

Please guide me how to get the head cleaning history on HP HP MSL4048 1 LT0-4 Ultrium 1840. (0 Replies)
Discussion started by: marunmeera
0 Replies

4. UNIX for Dummies Questions & Answers

Unable to find the history file

Hi friends, I am unable to find the .sh_history file on my PC. This files contains the log of all commands typed by the users. I searched it also , but no results. Please help me :(, where to find it . Or is there anything else to do to set the history file. (6 Replies)
Discussion started by: paras.oriental
6 Replies

5. Shell Programming and Scripting

To find the time stamps history of the files within the sub-folders

Hi - Can anyone help me to get the shell script for the below scenario I need to find out the time stamps history for the files residing within the subfolders. Ex.. Let say I got directory structure like /home/project1/ -- Fixed directory Now within the project there are many... (1 Reply)
Discussion started by: pankaj80
1 Replies

6. UNIX for Dummies Questions & Answers

Load average spikes once an hour

Hi, I am getting a high load average, around 7, once an hour. It last for about 4 minutes and makes things fairly unusable for this time. How do I find out what is using this. Looking at top the only thing running at the time is md5sum. I have looked at the crontab and there is nothing... (10 Replies)
Discussion started by: sm9ai
10 Replies

7. UNIX for Dummies Questions & Answers

How to clear history in Linux

Hello All, Good Morning. I am trying to erase history list in my linux box, but my below command is failing. What is the actual way to clear it? > history clear -bash: history: clear: numeric argument required Also when I run my commands in my command prompt, my team lead can see my... (7 Replies)
Discussion started by: NARESH1302
7 Replies

8. Linux

History of executed command in Linux

Hi All, Is there a way to check command executed by users in Linux for a specific date? I know we can use history, but it doesn't shows yesterday's executed commands. rgds, (3 Replies)
Discussion started by: ronny_nch
3 Replies

9. UNIX for Advanced & Expert Users

bash history with ctr+R, How to get find next match?

ctr+R is used to search bash history reversely, How to get next match? just like N in vi search. (1 Reply)
Discussion started by: honglus
1 Replies

10. Shell Programming and Scripting

stop users from running 'history -c' in Linux

Hi All, My question is how can i stop my users on system from deleting their history. How can i stop the users from running 'history -c'. I have searched thoroughly on the forum but didn't find any satisfactory solution to the problem. kindly help if you any suggestions Thanx in... (3 Replies)
Discussion started by: xander
3 Replies
Login or Register to Ask a Question