optimizing disk performance


 
Thread Tools Search this Thread
Special Forums Hardware Filesystems, Disks and Memory optimizing disk performance
# 1  
Old 06-12-2002
Question optimizing disk performance

I have some questions regarding disk perfomance, and what I can do to make it just a little (or much Smilie) more faster.

From what I've heard the first partitions will be faster than the later ones because tracks at the outer edges of a hard drive platter simply moves faster. But I've also read in a book that most-used partitions should be placed in the middle of a range of partitions. This doesn't make much sense to me.
Does this "put-heavily-accessed-in-the-middle" thing apply to logical partitions?

Should the heavily accessed partition really go in the middle? Even if the first partitions are large in size and later are small, thus leaving the heavily accessed partition "nearer" the center (where the platter moves slower)... ?

Any other suggestions like partition layout, filesystem recommendation etc are highly appreciated Smilie

I'm working with a linux system using a server software that does a lot of reading and writing so every bit of speed I can gain is valueable.

Thanks in advance

Last edited by J.P; 06-12-2002 at 08:21 PM..
# 2  
Old 06-12-2002
I have to tell you that I don't really think this approach is a great idea. With unix filesystems, it's too hard to to keep a file precisely positioned in one spot. Unix wasn't meant to be used that way. But here are your answers...

In the olden days disks had a fixed geometry. The first track and the last track held the same amount of data. As disk manufacturers chased after greater data densities, they changed things so that the outer tracks now have more sectors than the inner tracks. Some disk optimization papers were written in those olden days. Every thing they say may no longer apply. This is the problem with exploiting disk geometry...it changes and suddenly your hack is now counterproductive.

But in the olden days, since each sector could be read with equal speed, your primary concern was getting the disk heads to your sector. This is why putting the data in the middle of the disk is a good idea. The heads cannot be more than half a disk away. So the mean seek time is as low as you can get it. But this assumes that the heads might be anywhere on the disk. If you can guarantee that the heads are positioned over your data, seek time becomes less of an issue. One way to do this is to use only the outer tracks of each disk drive and ignore the inner 90% of the disk.

If that's not possible, then it will depend on how much data is to be transferred. With large multi-sector transfers, the longer seek time may be compensated by the faster transfer time. The only way to be sure is to try it both ways and benchmark it.

And while you're at it, put the data on the inner tracks and benchmark that. That should be the worst case, longest mean seek time and longest transfer time. This will give you a feel for how little benefit you're reaping from a lot of work.
# 3  
Old 06-13-2002
thank you very much for that informative reply.
Yes I've realized it's too much work for so little Smilie

But I'll do some benchmarking anyway just to test (just downloaded IOZone). Any recommendation on other good benchmarking software ?

And yet another hard disk tip i got from another book. It claims I'll get slightly better performance if I split my linux installation on several disks since more disk heads are working on the operating system. True, or just another worthless statement?

Thanks again
/J.P
# 4  
Old 06-13-2002
Quote:
Originally posted by J.P

And yet another hard disk tip i got from another book. It claims I'll get slightly better performance if I split my linux installation on several disks since more disk heads are working on the operating system. True, or just another worthless statement?

Thanks again
/J.P
That is absolutely true. At some point you have so many drives on an i/o path that they must wait for each other. Until you reach that point, the more drives the better.

I'm not a linux expert. But on HP-UX, there are several ways to exploit more drives. One way is to just use raids. They are a collection of drives that look like one drive to the os. But also with individual drives, HP (under LVM) supports striping. This lets you distribute a logical disk over several physical disks. HP also supports disk mirroring. With mirrors, a write must go to 2 or more drives, so writes take longer. But a read can come from any drive so reads are quicker. Since you usually read much more often than you write, this is a performance win.

If you don't have stuff like this on linux, then you can still work at the application level. It's not enough to just have the drives, they must be involved with your i/o intensive work. You may be able to one file on one drive, another file on the next drive and so on.
# 5  
Old 03-01-2005
I will recommend these 2 books:
1) configuration and capacity planning by Brian Wong
2) Sun performance and Tuning (java and internet) by Adrian Cockcroft

If fighting against time, go to this:
http://www.emc.com/techlib, go to:
Storage Systems
Guidelines for deploying EMC networked storage systems. Topics include configuration guidelines for optimizing reliability, scalability, capacity, and availability in various environments.

Choose
"EMC CLARiiON Fibre Channel Storage Fundamentals".

If still no time to read, but got lots of budget, do RAID 10 (Oracle says SAME, Stripe and Mirror Everywhere/Everything)
If this can't help, most likely no IO Storage Subsystem can help much. You will need application tuning.

Remember the 80/20 rule: 80% of the time, ONLY 20% of the data is still used.
Login or Register to Ask a Question

Previous Thread | Next Thread

7 More Discussions You Might Find Interesting

1. Debian

Optimizing exim performance

Hi, Recently, I experienced that exim was slow in sending outgoing mail, it was spending a lot of time in the queue, resulting in customer complains. I came across an article in the internet to optimize the performance of exim in the server. However, the location of the exim.conf is not in... (0 Replies)
Discussion started by: anaigini45
0 Replies

2. Linux

Disk Performance

I have a freshly installed Oracle Linux 7.1 ( akin to RHEL ) server. However after installing some Oracle software, I have noticed that my hard disk light is continually on and the system performance is slow. So I check out SAR and IOSTAT lab3:/root>iostat Linux... (2 Replies)
Discussion started by: jimthompson
2 Replies

3. Solaris

disk performance

What tools/utilities do you use to generate metrics on disk i/o throughput on Solaris. For example, if I want to see the i/o rate of random or sequential r/w. (2 Replies)
Discussion started by: dangral
2 Replies

4. Red Hat

Disk performance problem on login

Running CentOS 5.5: I've come across a relatively recent problem, where in the last 2 months or so, the root disk goes to 99% utilization for about 20 seconds when a user logs in. This occurs whether a user logs in locally or via ssh. I have tried using lsof to track down the process that is... (5 Replies)
Discussion started by: dangral
5 Replies

5. Red Hat

Linux disk performance

I am getting absolutely dreadful iowait stats on my disks when I am trying to install some applications. I have 2 physical disks on which I have created 2 separate logical volume groups and a logical volume in each. I have dumped some stats as below My dual core CPU is not being over utilised... (3 Replies)
Discussion started by: jimthompson
3 Replies

6. AIX

disk performance

Hello, I have a aix 570 system with san disk. I do write test of performance in a lv with four disk. While the test I run filemon tools for trace the disk activity. The outputs of filemon are at the en of this message. I see my lV(logical volume) throughput at 100 meg by second. 2 of 4 disk... (0 Replies)
Discussion started by: Hugues
0 Replies

7. News, Links, Events and Announcements

Optimizing Apache Server Performance

I found this link useful in a discussion about Apache performance tuning: http://www.serverwatch.com/tutorials/article.php/3436911 (0 Replies)
Discussion started by: Neo
0 Replies
Login or Register to Ask a Question