I/O Error on SAN Disk


 
Thread Tools Search this Thread
Operating Systems Solaris I/O Error on SAN Disk
# 1  
Old 11-25-2010
I/O Error on SAN Disk

Hi,

I have a production solaris 10 SPARC system (portal). Yesterday legato/Networker gave an I/O Error on one of the files on its SAN mounted disk.
I went to that particular file on the system, did an ls and it showed the file. However, ls -l did not work and it said IO error.

What is the solution to fix this IO error. fsck?
# 2  
Old 11-25-2010
can you post relevant dmesg output?
# 3  
Old 11-25-2010
Code:
Nov 22 18:03:07 plumcrt01 ufs: [ID 879645 kern.notice] NOTICE: /opt/luminis: unexpected free inode 8677, run fsck(1M) -o f
Nov 22 18:04:37 plumcrt01 last message repeated 3 times
Nov 23 10:35:22 plumcrt01 ufs: [ID 879645 kern.notice] NOTICE: /opt/luminis: unexpected free inode 8677, run fsck(1M) -o f
Nov 23 10:36:17 plumcrt01 last message repeated 2 times
Nov 23 10:36:53 plumcrt01 ufs: [ID 879645 kern.notice] NOTICE: /opt/luminis: unexpected free inode 8677, run fsck(1M) -o f
Nov 23 11:03:40 plumcrt01 ufs: [ID 879645 kern.notice] NOTICE: /opt/luminis: unexpected free inode 8677, run fsck(1M) -o f
Nov 23 11:05:45 plumcrt01 last message repeated 3 times
Nov 23 12:33:28 plumcrt01 ufs: [ID 879645 kern.notice] NOTICE: /opt/luminis: unexpected free inode 8677, run fsck(1M) -o f
Nov 23 20:07:38 plumcrt01 ufs: [ID 879645 kern.notice] NOTICE: /opt/luminis: unexpected free inode 8677, run fsck(1M) -o f
Nov 23 20:10:27 plumcrt01 last message repeated 3 times
Nov 24 03:00:12 plumcrt01 ufs: [ID 879645 kern.notice] NOTICE: /opt/luminis: unexpected free inode 8612, run fsck(1M) -o f
Nov 24 08:58:32 plumcrt01 ufs: [ID 879645 kern.notice] NOTICE: /opt/luminis: unexpected free inode 8677, run fsck(1M) -o f
Nov 24 18:01:53 plumcrt01 ufs: [ID 879645 kern.notice] NOTICE: /opt/luminis: unexpected free inode 8612, run fsck(1M) -o f
Nov 24 18:04:59 plumcrt01 last message repeated 4 times
Nov 25 10:01:13 plumcrt01 ufs: [ID 879645 kern.notice] NOTICE: /opt/luminis: unexpected free inode 8677, run fsck(1M) -o f

# 4  
Old 11-25-2010
What was the original error? is the message from 11/22 the first one logged?

unmount, fsck and remount
# 5  
Old 11-26-2010
We saw the first error via legato. On the server, the following:
Code:
[root@plumcrt01 /opt/luminis/products/ds/slapd-cp/locks/server] # ls
1198
[root@plumcrt01 /opt/luminis/products/ds/slapd-cp/locks/server] # ls -l
./1198: I/O error
total 0

The second error via legato was an ldif data file. When we cated the file, it had garbage values at the end

---------- Post updated 11-26-10 at 10:13 AM ---------- Previous update was 11-25-10 at 12:02 PM ----------

Well, ran fsck it found some errors and fixed it. Everything appears to be fine, however, the cause of the IO error is still a mystery.

First Error (occurred during movement)
Code:
Nov 12 21:57:19 plumcrt01 savecore: [ID 570001 auth.error] reboot after panic: free: freeing free frag, dev:0x14800000008, blk:33717, cg:2, ino:13487, fs:/opt/luminis
Nov 12 22:46:02 plumcrt01 savecore: [ID 570001 auth.error] reboot after panic: free: freeing free frag, dev:0x14800000008, blk:33717, cg:2, ino:13487, fs:/opt/luminis
Nov 12 22:46:50 plumcrt01 /opt/luminisShared/common/imq/instances/imqbroker/lock
Nov 12 23:51:29 plumcrt01 savecore: [ID 570001 auth.error] reboot after panic: free: freeing free frag, dev:0x14800000000, blk:1416, cg:5, ino:30709, fs:/opt/luminisShared


Last edited by Mack1982; 11-26-2010 at 02:18 AM..
# 6  
Old 11-28-2010
my best guess is it happened when the server crashed. you should find out why the system crashed.
# 7  
Old 11-30-2010
lol, got mail from SUN stating that it might be because I did not connect the fiber cables properly.
Any way all is good till now. I am assuming that /opt being 100% full might be the cause since, the SAN partition was mounted on /opt as /opt/luminis
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

SAN vs. Local disk.

I am in the market looking to purchase a new E950 server and I am trying to decide between using local SSD drives or SSD based SAN. The application that will be running on this server is read-intensive so I am looking for the most optimal configuration to support this application. There are no... (2 Replies)
Discussion started by: ikx
2 Replies

2. AIX

San disk appearing double in old AIX

Hi guys, :) I'm a studient in IT field (AIX) I'm trying to map a LUN from a SAN (DS3400) to an AIX server (5300-04-00) I know there is no MPIO on this version of AIX, and i see double my LUN from the SAN root@localhost # lscfg | grep hdisk + hdisk7 ... (13 Replies)
Discussion started by: Tharsan
13 Replies

3. Red Hat

Sharing SAN disk with multiple severs

Hi , I had a requirement to share a san disk between two rhel severs. I am planning to discover the same disk in two rhel nodes and mount it. Is it a feasible solution? and what kind of issues we may encounter mounting same disk in two OS's parallel ? (2 Replies)
Discussion started by: nanduri
2 Replies

4. Solaris

Solaris 10 booting from EMC SAN DISK

Hi All, I have server : Sun-Fire-V490 configured with Solaris 10 zfs .. and I have configured three mirror the third one from EMC storage. root@server # zpool status -v pool: rpool state: ONLINE status: The pool is formatted using an older on-disk format. The pool can ... (8 Replies)
Discussion started by: top.level
8 Replies

5. UNIX for Dummies Questions & Answers

SAN and Disk I/O ... do we care?

Hi all, My main function is as a DBA. Another person manages the server and the SAN. I just want to know if I should be worried about high disk I/O or is it irrelevant as the I/O "load balancing" will be "taken care" of by the SAN? For example, I have hdisk1-5 and I can see that there are... (2 Replies)
Discussion started by: newbie_01
2 Replies

6. Filesystems, Disks and Memory

SAN Disk w/o Cluster

Scenario: I've got 2 M5000's connected to a 9985 SAN storage array. I have configured the SAN disks with stmsboot, format and newfs. I can access the same SAN space from both systems. I have created files from both systems on the SAN space. Question: Why can't I see the file created... (3 Replies)
Discussion started by: bluescreen
3 Replies

7. Solaris

SAN disk failure

hi all, have a solaris 9 OS and a SAN disk which used to work fine is not getting picked up by my machine. can anyone point out things to check in order to troubleshoot this ?? thanks in advance. (3 Replies)
Discussion started by: cesarNZ
3 Replies

8. AIX

hard disk and san

Hello everyone I got several aix boxes with aix 5.3 I got a ibm san ds4500 My question is How can I do a match between my disks on aix and the san? I try to do a match with the LUN but for example. In my san I got several 1 LUN and on one of my aix box I got this If I type lscfg... (4 Replies)
Discussion started by: lo-lp-kl
4 Replies

9. Filesystems, Disks and Memory

disk errors with san snapshot

so we have a solrais 9 system attached to an HP SAN. we are using sssu to do snap clones every hour. the only problem is the we get write errors on the solrais system every time we do a snap. from /var/adm/messages Apr 21 14:37:48 svr001 scsi: WARNING:... (0 Replies)
Discussion started by: robsonde
0 Replies

10. AIX

AIX disk less with SAN

Hi All, I have mirrored SAN volume on my B80 rootvg. Can I just remove the mirror and "Remove a P V from a V G" and it will be a diskless AIX? Is that going to boot on SAN rootvg volume? Thanks in advance, itik (3 Replies)
Discussion started by: itik
3 Replies
Login or Register to Ask a Question