Solaris server read and write randomly slow


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Solaris server read and write randomly slow
# 8  
Old 05-22-2014
I want to replace sd12. I've been told I can try just remove it live, and that since I'm configured in raid-z2 it won't do any harm. I will need to replace it and reconfigure it in my pool also, another new adventure..

Regarding the zpool list, I was surprised to find out that I had 26 TB non-allocated, is it a normal procedure? The 26 TB correspond to a new MD1200 that was bought a year after... And I have a lot more space on those drives. Forget this last comment if it has nothing to do with the current case, and thank you again

Code:
-bash-3.00# zpool list 
NAME         SIZE  ALLOC   FREE    CAP  HEALTH  ALTROOT
production    76T  50.3T  25.7T    66%  ONLINE  -
rpool        146G  20.2G   126G    13%  ONLINE  -

Code:
-bash-3.00# zpool iostat -v production
                              capacity     operations    bandwidth
pool                       alloc   free   read  write   read  write
-------------------------  -----  -----  -----  -----  -----  -----
production                 50.2T  25.8T     62     51  2.56M   936K
  raidz2                   7.88T  3.00T      9      6   432K   123K
    c2t5000C500213AB5FBd0      -      -      2      1  78.9K  31.5K
    c2t5000C5002143BEEFd0      -      -      3      2  73.4K  31.4K
    c2t5000C500213ACF5Fd0      -      -      3      2  71.2K  31.5K
    c2t5000C500213EF72Fd0      -      -      3      2  77.8K  31.5K
    c2t5000C5002147AE4Fd0      -      -      3      2  71.9K  31.4K
    c2t5000C5002147AF4Bd0      -      -      3      2  70.9K  31.5K
  raidz2                   8.21T  2.66T      9      6   459K   147K
    c2t5000C5002147B0B3d0      -      -      3      2  74.4K  37.6K
    c2t5000C50021440C4Fd0      -      -      3      2  79.9K  37.5K
    c2t5000C50021442A9Fd0      -      -      3      2  80.7K  37.4K
    c2t5000C50021446E7Bd0      -      -      3      2  74.0K  37.6K
    c2t5000C50021474E0Fd0      -      -      3      2  80.8K  37.5K
    c2t5000C50021474E2Fd0      -      -      3      2  82.0K  37.4K
  raidz2                   8.33T  2.54T     10      7   458K   149K
    c2t5000C50021482D9Fd0      -      -      4      2  80.5K  38.0K
    c2t5000C50021496EDBd0      -      -      3      2  79.2K  38.2K
    c2t5000C50021497FC3d0      -      -      3      2  74.8K  38.1K
    c2t5000C500214269D7d0      -      -      4      2  80.7K  38.0K
    c2t5000C500214574ABd0      -      -      3      2  80.4K  38.2K
    c2t5000C500214751CFd0      -      -      3      2  75.7K  38.1K
  raidz2                   8.39T  2.48T     10      8   464K   153K
    c2t5000C500214752A3d0      -      -      4      3  83.5K  39.1K
    c2t5000C500214756BFd0      -      -      4      3  77.6K  39.1K
    c2t5000C500214769F3d0      -      -      3      3  77.3K  39.3K
    c2t5000C500214976A3d0      -      -      4      3  85.2K  39.1K
    c2t5000C5002147617Bd0      -      -      4      3  78.4K  39.1K
    c2t5000C50021475457d0      -      -      3      3  76.4K  39.3K
  raidz2                   8.86T  7.39T     11     11   408K   181K
    c4t5000CCA03E1E0F2Dd0      -      -      4      2  75.3K  46.4K
    c4t5000CCA03E1E09F1d0      -      -      4      3  66.7K  46.7K
    c4t5000CCA03E1E6571d0      -      -      4      3  68.2K  46.5K
    c4t5000CCA03E1F663Dd0      -      -      5      2  75.2K  46.4K
    c4t5000CCA03E1F6895d0      -      -      4      3  68.3K  46.7K
    c4t5000CCA03E2017FDd0      -      -      4      3  69.8K  46.5K
  raidz2                   8.51T  7.74T     11     11   404K   181K
    c4t5000CCA03E2075F9d0      -      -      5      3  93.6K  46.3K
    c4t5000CCA03E2077FDd0      -      -      4      3  59.4K  46.6K
    c4t5000CCA03E2090E9d0      -      -      4      3  55.8K  46.4K
    c4t5000CCA03E02426Dd0      -      -      5      3  92.9K  46.3K
    c4t5000CCA03E17870Dd0      -      -      4      3  60.7K  46.6K
    c4t5000CCA03E201965d0      -      -      4      3  57.4K  46.4K

---------- Post updated at 04:39 PM ---------- Previous update was at 03:34 PM ----------

Hi again, I'm continuing my reading and if I try to put the disk offline in my pool, would that be a good test?

Like
Code:
zpool offline -t production c2t5000C50021474E0Fd0

And then see what happens, I would do that when nothing is written on

What do you think?
Thanks
# 9  
Old 05-23-2014
You almost have the idea - I've not done this because we have a SAN, where we move fried disks in and out. Get a new disk first! Step by step:

Check the status of the pool:
Code:
zpool status -v [poolname]

How to swap a disk:
http://docs.oracle.com/cd/E19253-01/...zgd/index.html
# 10  
Old 06-11-2014
Just a quick word to say that was the problem, and it's now fixed, yeh!! Here's what I did in case it can help.

-Bought a new disk following the specs written in the output of
Code:
iostat -E 1 1 > /tmp/disk_errors.txt

-put my disk offline
Code:
zpool offline production c2t5000C50021474E0Fd0

-changed the disk

-with dmesg command, searched the new drive name through /dev/rdsk
Code:
-bash-3.00# dmesg
May 28 07:27:21 hermes scsi: [ID 583861 kern.info] sd125 at scsi_vhci0: unit-address g5000c50057d773fb: g5000c50057d773fb

-bash-3.00# ls -la | grep g5000c50057d773fb
lrwxrwxrwx   1 root     root          53 Jun  6 15:53 c2t5000C50057D773FBd0 -> ../../devices/scsi_vhci/disk@g5000c50057d773fb:wd,raw

-replaced the disk in the pool
Code:
zpool replace production c2t5000C500213AB5FBd0  c2t5000C50057D773FBd0

The resilver took 99h for 1,37 TB

Again, thank you so much for helping me find the problem.
 
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Infrastructure Monitoring

99% performance wa, slow server.

There is a big problem with the server (VPS based on OpenVZ, CentOS 5, 3GB RAM). The problem is the following. The first 15-20 minutes after starting the server is operating normally, the load average is less than or about 1.0, but then begins to increase sharply% wa, then hovers around 95-99%.... (2 Replies)
Discussion started by: draiphod
2 Replies

2. Solaris

Hard disk write performance very slow

Dear All, I have a hard disk in solaris on which the write performanc is too slow. The CPU , RAM memory are absolutely fine. What might be reason. Kindly explain. Rj (9 Replies)
Discussion started by: jegaraman
9 Replies

3. IP Networking

read/write,write/write lock with smbclient fails

Hi, We have smb client running on two of the linux boxes and smb server on another linux system. During a backup operation which uses smb, read of a file was allowed while write to the same file was going on.Also simultaneous writes to the same file were allowed.Following are the settings in the... (1 Reply)
Discussion started by: swatidas11
1 Replies

4. Shell Programming and Scripting

Find all files with group read OR group write OR user write permission

I need to find all the files that have group Read or Write permission or files that have user write permission. This is what I have so far: find . -exec ls -l {} \; | awk '/-...rw..w./ {print $1 " " $3 " " $4 " " $9}' It shows me all files where group read = true, group write = true... (5 Replies)
Discussion started by: shunter63
5 Replies

5. UNIX for Advanced & Expert Users

Linux server is slow

Hello, I am using Redhat redhat 4 update 4 kernal 2.6. My server is some time suddenly running slow. The averge cpu load goes up to 50 to 60. (There is only two CPU and usually, the averge load is between 1 to 2.5) That time, i see, there are several sessions connected. Normally, we have... (5 Replies)
Discussion started by: govindts
5 Replies

6. Shell Programming and Scripting

use awk to read randomly located columns in an excel file

Hi, I have an excel file that have a random count of columns/fields and what im trying to do is to only retrieve all the rows under 2 specific field headers. I can use the usually command for awk which is awk 'print{ $1 $2}' > output.txt, but the location of the 2 specific field headers is... (9 Replies)
Discussion started by: mdap
9 Replies

7. Shell Programming and Scripting

Read line from file randomly

I have data file with customer.dat, and this contains the customer names >cat customer.dat FirstName1 LastName1 FistName2 LastName1 FistName3 MiddleName3 LastName3 This file can contain areoun 100 customer names. Regards, (1 Reply)
Discussion started by: McLan
1 Replies

8. HP-UX

Server become too slow

Hi, Since last week our server become too slow when we try to run application on it. When we run top command, it show as below: So it's nothing to do with heavy utilization, right? Can you give some opinion on what actually had happended? Thank you very much... :b: (4 Replies)
Discussion started by: yeazas
4 Replies

9. Post Here to Contact Site Administrators and Moderators

It seems last 20 min Server was very very Slow

Hi Guys, Since last 20-30 min Server was Too slow ..even few of times i got Database connection error. Thanks Sanjay Tripathi (0 Replies)
Discussion started by: SanjayLinux
0 Replies
Login or Register to Ask a Question