DUAL VIOS & Client LPAR hangs at 25b3


 
Thread Tools Search this Thread
Operating Systems AIX DUAL VIOS & Client LPAR hangs at 25b3
# 1  
Old 01-03-2010
DUAL VIOS & Client LPAR hangs at 25b3

I have a DUAL VIO ( IBM Virtual I/O ) setup on p 570.
Two Vio server ( VIOS ) and many LPAR clients.
VIO ( latest version + service pack + applied the fix ) and AIX 6.1 ML2

When both VIOs are running, and if I turn on a Client LPAR, the LPAR hangs at LED 25b3 for more than 1 hour then it boots. But if I switch off one VIO then boot the Client LPAR it boots fine (very fast within 5 minutes)

My client lpar has SAN luns ( going via both VIOs ) and rootvg is mirrored (one virtual disk coming from VIO1 and the other coming from VIO2 )

Storage is IBM DS4200... Installed MPIO drivers...

anyone faced similar problem...searched the internet, found few users who have same problem but there was no resolution posted on the internet
see here AIX v5.3 Dual VIO - LPAR install slow. AIX for POWER Systems pSeries Tech Talk Forums
http://www.ibm.com/developerworks/fo...ageID=14172543

http://www.ibm.com/developerworks/fo...art=0#14385108

http://boardreader.com/thread/Boot_f...8d5bX6i43.html
http://www.ibm.com/developerworks/fo...art=0#14385143


AIX SAN LUN connection

someone posted
Quote:
Hi,

I've been struggling with a 25b3 hang on a p570 building from a 53TL08SP3 image onto VIO presented disk.

lsrefcode -r lpar -m <system> --filter lpar_ids=55

pointed to:

<snip>time_stamp=12/04/2008 11:17:38,refcode=25b3,word2=03400000,fru_call_out_loc_codes=U9117.570.656FEBC-V55-C13-T1

Slot 13 was the the virtual SCSI adapter on my VIO which was erroring with some missing SAN disk. (rootvg disks were on a different VSCSI). Removing the VSCSI adapter allowed the build to run past the 25b3 led code.

I suspect that '25B3' is something like 'configuring virtual scsi'!

----
LED 25B3 means "configuring virtual scsi client adapter". You should not see that for longer than 60 seconds, at which point the driver should give up the attempt to configure and log an informative message in the client partition error log. The cause of the temporary hang is likely to be that there is a host vscsi adapter defined in a VIOS partition somewhere, but that host adapter does not have any disks assigned to it. If the host adapter is not defined or the VIOS partition is not booted, then you should only see the 25B3 LED for about two seconds. Possible fixes are either assign some devices to the host adapter or remove the client and/or host adapters from the partition definition. Other causes are possible, but you will need to examine the client and VIOS partition definitions and the client and VIOS error logs.

contacted IBM support and they say check LUN ACCESS MODE ? and there is no such option in DS4200

if they mean access mode on the AIX / VIO side then that is no_reserve ( but the problem still exists )





============================
IBM AIX VIOs LPAR LED 25b3 516 517
============================

Last edited by Scott; 01-03-2010 at 03:11 PM.. Reason: fixed quote tag
# 2  
Old 02-16-2010
I had a similar problem and below is how I was able to finally get it fixed. We had two vio servers as well.

Shutdown vio2
Boot up the LPAR with only vio1 connection
Remove the non-rootvg disks from the LPAR that is unable to boot
Copy vio2's HMC profile to "vio2_no_fiber_cards"
Remove the fiber cards from vio2's "vio2_no_fiber_cards" profile
Boot up vio2 from the "vio2_no_fiber_cards" profile so that it boots with no fiber cards.
On vio2, remove the non-rootvg VTDs for the LPAR. They will be in the defined state.
Shutdown vio2
Boot up vio2 from the "vio2_normal" profile so the fibercards are back in the game
Verify that the disks are all back with the correct hdisk numbers (compare against vio1)
Verify that all the other VTDs (virtual target devices) are still there and now "Available" (lsmap –all)
Re-create the LPAR's VTDs (the one that was getting the 25b3 error)
Run cfgmgr on the LPAR and verify it can see the paths (lspath) through vio2.
Try and reboot the LPAR and see if it can come back up.
After a successful reboot, call vioc2 good

To summarize... some how the vio2 server's mapping got messed up. By booting the vio2 server with no fibercards, I could remove the then "defined" disk mappings and the disks without messing anything up. I then rebooted vio2 with fibercards and in the process of doing so, the vio2 server "refound" the disks. I re-created the VTD mappings on the vio2 server, then ran cfgmgr on the LPAR and then the problem went away. I was able to see both paths again with "lspath" and was able to reboot the LPAR with no hangups.

Last edited by kah00na; 02-16-2010 at 04:10 PM..
# 3  
Old 02-17-2010
actually we figured out what was the problem. The problem was with SAN Zoning. In case of DUAL VIO Setup SAN Zoning has to be different.
Each switch should see both Servers

When using only one Fibre Channel per Virtual I/O Server, you need an
additional switch to have a highly available configuration. In this case, it is
important that the SAN zoning be configured such that the single Fibre Channel
in each Virtual I/O Server LPAR is zoned to see both storage controllers in the
FAStT. If a second Fibre Channel is used for additional redundancy, the storage
administrator must ensure that each Fibre Channel is zoned to only one of the
DS4200 controllers. Rules for attachment of FAStT storage units to AIX can be
found in the Storage Manager documentation of the Storage Manager products.

http://lh3.ggpht.com/_FOnSOMQiszQ/S3...dual_vio_1.JPG

http://lh6.ggpht.com/_FOnSOMQiszQ/S3...dual_vio_2.JPG

http://lh4.ggpht.com/_FOnSOMQiszQ/S3...dual_vio_3.JPG

SEE IBM REDBOOKS PowerVM Virtualization on IBM System p: Introduction and Configuration Fourth Edition, SG24-7940-03
Redbooks, published 6 May 2008, last updated 11 January 2010,

IBM System p Advanced POWER Virtualization (PowerVM) Best Practices, REDP-4194-00
Redpapers, published 9 October 2006, last updated 22 May 2009, Rating: (based on 10 reviews)
83% 3. Advanced POWER Virtualization on IBM System p Virtual I/O Server Deployment Examples, REDP-4224-00
Redpapers, published 13 February 2007, last updated 19 June 2007, Rating: (based on 3 reviews)
& RED PAPER 4194

Last edited by filosophizer; 02-17-2010 at 09:23 AM..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. AIX

Chef client on VIOs? How do you manage your VIO configs?

I know the VIOs are generally to be treated as an appliance and one should never drop down to oem_setup_env. In reality however, oem is a very useful tool to get the job done. So that leads me into the question of using the Chef client on a VIO. Currently a big push to manage all our *nix... (4 Replies)
Discussion started by: RecoveryOne
4 Replies

2. UNIX for Advanced & Expert Users

Unable to install client AIX LPAR to vscsi hdisk provided from VIOS

Hi everybody, I have Power5 server with 4 internal hdisks each of 70Gb. VIOS server was installed via Virtual I/O Server Image Repository on the HMC. HMC release - 7.7.0 VIOS rootvg installed on 2 disk(these disks merged to one storage pool during VIOS install process),and 2 others hdisks... (2 Replies)
Discussion started by: Ravil Khalilov
2 Replies

3. AIX

VIOS: Extend virtual disk assigned to running lpar?

Hello, VIOS 2.2.1.4 using IVM. I'm trying to extend a virtual disk assigned to a running lpar so that I can expand the lpar's datavg and grow some filesystems for the user. Storage admin expanded the lun and new size was reflected in VIO right away. I then needed the storage pool to... (2 Replies)
Discussion started by: j_aix
2 Replies

4. AIX

Moving VIOS, LPAR's, HMC to different subnet

Hi, Just joined to new company with one Power 720 Express (8202-E4C) server and have no much experience with IBM systems. I am trying to move everything I mentioned to different subnet as required by customer contract (currently sitting on same subnet as company lan). Access to this subnet will... (8 Replies)
Discussion started by: spricer
8 Replies

5. AIX

VIOS LPAR Error 0518

I am trying to install AIX 5.3 on one of the LPARs through VIOS but I get this error 0518 Reference Code Selection 0518 (Time stamp: 12/18/12 12:10:20 AM UTC) Starting kernel (Time stamp: 12/18/12 12:10:15 AM UTC) AIX is starting. (Time stamp: 12/18/12 12:10:15 AM... (10 Replies)
Discussion started by: filosophizer
10 Replies

6. AIX

List LPAR from VIOS

Hi guys, does anyone know how to get a list of the LPAR running on VIOS? Thanks! (5 Replies)
Discussion started by: cecco16
5 Replies

7. AIX

What's the difference between VIOS and LPAR?

Hi All, Besides the licenses on VIO and LPAR. What's the main difference with the two? I have installed VIO, my manager told me so, because it's like a free hypervisor but I never installed LPAR before. How do you install it? And if you can give more info on the two, that would be great. ... (5 Replies)
Discussion started by: itik
5 Replies

8. AIX

VIOS to lpar Mapping

Hello, I have created mapping of 2 virtual adapters for Lpars using following command: mkvdev -vdev ipanalyzerlv1 -vadapter vhost11 mkvdev -vdev ipanalyzerlv -vadapter vhost13 The above two commands were succesfull but when I want to map the third virtual device to the same Lpar than... (3 Replies)
Discussion started by: Vit0_Corleone
3 Replies

9. AIX

Problem mapping LUN disk from VIOS to the LPAR

Hello guys, It would be so nice of you if someone can provide me with these informations. 1) My SAN group assigned 51G of LUN space to the VIO server.I ran cfgdev to discover the newly added LUN. Unfortunately most of the disks that are in VIO server is 51G. How would I know which is the newly... (3 Replies)
Discussion started by: solaix14
3 Replies

10. AIX

Setting Dual Ip address on LPAR AIX 5.3

Hi Guys, Can somebody help me how to add and activate addtional ip address on AIX. My server is IBM p5-570 i already set ipadress on ent1 ent0 -- 192.168.206.105 ( default ) ent1 -- 192.168.0.89 (additional) i can ping from outside to 192.168.0.89 but i can not telnet or ftp. for... (6 Replies)
Discussion started by: cahyo3074
6 Replies
Login or Register to Ask a Question