Visit Our UNIX and Linux User Community


I/O performance in HPUX file systems


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers I/O performance in HPUX file systems
# 1  
Old 09-04-2009
Error I/O performance in HPUX file systems

Hi guys,
what is the relation between I/O performance and file systems.
I have a file systems called /dcs/data01 which is having 4Tb size.
According our application we can split the file system like

dcs/data01 -> 1Tb
dcs/data02 -> 1Tb
dcs/data03 -> 1Tb
dcs/data04 -> 1Tb

do you think I/O performance will increase by doing this.

Many Thanks
Davinzy
# 2  
Old 09-05-2009
That depends on how the data is read, is it sequential or random access, is one process reading the data or many?

The performance is more likely to be affected by the volumes physical make up than the filesystem, i.e. is it striped across several disks, is it mirrored or just a RAID 5? The filesystem would have a more significant impact on performance with many small files but with only 1 or 4 files it will have little effect.

What will improve by splitting the 4TB files into 4 1TB files is the chances of successfully backing up and restoring the data, especially if a restore of only 1 of the 4 files is required!

The best answer is to measure your current performance and compare that with trying 4 separate files, not the answer you wanted I'm sure...
# 3  
Old 09-07-2009
HI Tony,

thank you very much for your reply, we are using ISAM to read data and there are many processors reading data.
Our system stores thousands of files in that file system which are having millions of records. And out processors read and write data frequently to that location.

no backing up of files needed, system will automatically purge files after file retention period .

how can I check how many physical volumes are there ?
# 4  
Old 09-07-2009
The next question is what connection is used to your disks...
FC to a SAN? what speed?
There are may things you can do to improve but for that you need to know your configuration:
SAN?
VG with ONlineJFS or other?
are the disks in the VG from a same array? (SAN side that is...)
Are you using aggregated LUNS?
What parameters are set on the filesystem?
etc...
# 5  
Old 09-07-2009
Quote:
Originally Posted by Davinzy
HI Tony,
how can I check how many physical volumes are there ?
From what I remember you run:
# df -k .
in the data volume to determine the logical volume (LV) it is stored in.

# lvdisplay -v lvnn
where lvnn is the name and number of the LV your data is stored in to see what volume group your LV is part of.

# vgdisplay vgnn
where vgnn is the name and number of the volume group (VG).

This will tel you how many Physical Volumes (PVs) your VG is spread over, they could be slices of disks some on the same disk just top confuse matters and the VGs could be divided into several LVs but hopefully your system is using whole disks and the VG is dedicated to the LV your data is stored in!

I hope that helps?


Edit:
I should have said that by the sounds of what you say you do need the volume striped over as many disks as possible to get the best bandwidth and access time for your parallel processing on multiple small files.

Last edited by TonyFullerMalv; 09-07-2009 at 07:27 PM..
 

Previous Thread | Next Thread
Test Your Knowledge in Computers #809
Difficulty: Easy
The CSS3 RGB Hex Code for DarkOrange is #FF4500.
True or False?

8 More Discussions You Might Find Interesting

1. HP-UX

pwage-hpux-T for Trusted HPUX servers

I'm sharing this in case anybody needs it. Modified from the original solaris pwage script. This modified hpux script will check /etc/password file on hpux trusted systems search /tcb and grep the required u_succhg field. Calculate days to expiry and notify users via email. original solaris... (2 Replies)
Discussion started by: sparcguy
2 Replies

2. What is on Your Mind?

From Systems Admin to Systems Eng.

I have been wondering how do Systems Administrators do the jump into Systems Engineering? Is it only a matter of time and experience or could I actually help myself get there? Opinions? Books I could read? Thanks a lot for your help! (0 Replies)
Discussion started by: svalenciatech
0 Replies

3. UNIX for Dummies Questions & Answers

How to get timestamp of a file in HPUX

Hi All, Am trying to get a command which gives the "date + time" that a file was edited. I cant use "ls -l" because it fails to get me the "time stamp" of files that were edited more than 6 months ago...commands like "stat" "ctime" etc aren't available on my server and I can't install them... (12 Replies)
Discussion started by: n_rajitr
12 Replies

4. AIX

volume group lun sizes and no of file systems for optimal performance

Hello, It's been a while since I've done AIX..., but I'm planning a new TSM on AIX disk-only backup solution. I'm planning to make an AIX volume group out of 40 luns of 1 TB. I'm planning to create one big file system on here. The purpose for this is to use this as a device class FILE for... (5 Replies)
Discussion started by: smashingpumpkin
5 Replies

5. SCO

file systems table

hi Where is file systems table stored, I mean which config file from SCO 5.0.6? On linux is in /etc/fstab. (1 Reply)
Discussion started by: ccc
1 Replies

6. Shell Programming and Scripting

Need Script to Use CPUs on a HPUX server to simulate Workload Manager on HPUX.

I am running HPUX and using WLM (workload manager). I want to write a script to fork CPUs to basically take CPUs from other servers to show that the communication is working and CPU licensing is working. Basically, I want to build a script that will use up CPU on a server. Any ideas? (2 Replies)
Discussion started by: cpolikowsky
2 Replies

7. UNIX for Dummies Questions & Answers

File systems...

Hello guys, I am new in Unix world. I would like know, how Can I check which type of file system (GPFS, JFS) is on the AIX server. I have AIX 5.1. Could you anyone advice me? Thanks. (4 Replies)
Discussion started by: sokratis
4 Replies

8. UNIX for Dummies Questions & Answers

Checking file systems

I am trying to resurrect an old UNIX server without any joy, I do not have much UNIX experience any I don't understand the messages I am receiving. The system is telling me that it cannot go multi - user until the following file systems are checked //dev/rroot It gives me the procedure 1)... (1 Reply)
Discussion started by: ianie
1 Replies

Featured Tech Videos