Solaris recovery


 
Thread Tools Search this Thread
Operating Systems Solaris Solaris recovery
# 1  
Old 11-04-2009
Solaris recovery

Some thing happened to our solaris 10 ( sparc ) box and it is not coming up now.

These are some of the console messages :

Quote:
Rebooting with command: boot -s
Boot device: /pci@1f,700000/scsi@2/disk@0,0 File and args: -s SunOS Release 5.10 Version Generic_118833-36 64-bit Copyright 1983-2006 Sun Microsystems, Inc. All rights reserved.
Use is subject to license terms.
Hardware watchdog enabled
Booting to milestone "milestone/single-user:default".
Hostname: tokgecpr21
ERROR: svc:/system/filesystem/minimal:default failed to mount /tmp (see 'svcs -x' for details) Nov 3 22:21:35 svc.startd[7]:
svc:/system/filesystem/minimal:default:
Method "/lib/svc/method/fs-minimal" failed with exit status 95.
[ system/filesystem/minimal:default failed fatally (see 'svcs -x' for
details) ]
Requesting System Maintenance Mode
Console login service(s) cannot run
ld.so.1: sulogin: fatal: libcmd.so.1: open failed: No such file or directory Requesting System Maintenance Mode Console login service(s) cannot run
ld.so.1: sulogin: fatal: libcmd.so.1: open failed: No such file or directory Requesting System Maintenance Mode
Quote:
Console login service(s) cannot run
ld.so.1: sulogin: fatal: libcmd.so.1: open failed: No such file or directory Requesting System Maintenance Mode (See /lib/svc/share/README for more information.) Console login service(s) cannot run
ld.so.1: sulogin: fatal: libcmd.so.1: open failed: No such file or directory Requesting System Maintenance Mode (See /lib/svc/share/README for more information.) Console login service(s) cannot run
ld.so.1: sulogin: fatal: libcmd.so.1: open failed: No such file or directory Requesting System Maintenance Mode (See /lib/svc/share/README for more information.)
I assume it is not able to find very basic system libraries so i need to tell it some how to find it under /lib:/usr/lib.

I booted it from the CD but now i dont remember the / file system device name.

So question is it correct approach to mount the root file system and then some tell OS to load above library path ?

Thanks
Singh
# 2  
Old 11-04-2009
No. Nothing is wrong with your library files. Firstly, your system patch level is very low. Boot the system to failsafe mode from ok> prompt and then you do a bootadm update-archive on the both disks (if mirrored). Reboot. You must have some knowledge on the troubleshooting. Messing up with the filesystem could be dangerous.
# 3  
Old 11-04-2009
Hold on, this looks more like a problem with the disk, as /tmp isnt mounting. Yes patch level may be low, but that isnt the problem. These sort of errors are effects of an underlying error. So, libraries cant be read, /tmp cant be mounted due to errors elsewhere. How come you rebooted the server ? where you installing a patch ?

Firslty, I would bring the server down and do a:-

Code:
ok> probe-scsi-all

probe-scsi-all.

Can you see all your disks ? If you can, work out what your boot disk is via devalias, or boot-device settings.

Then do a boot the system in to minx root using a solaris DVD.

Code:
ok> boot cdrom -s

Then, once in single user mode, mount the original root disk (assuming its sd0:a)

Code:
# mount /dev/rdsk/c0t0d0s0 /mnt

Then go take a look at the disk and see whats up. If its iffy, then boot off the mirror, if you've got one.

SBK

Last edited by sbk1972; 11-04-2009 at 10:04 AM..
# 4  
Old 11-04-2009
Thanks for the replies guys.

I am able to mount the file system but now the question is why it is not able to find basic system libraries when all of them are present in the /lib or /usr/lib. I think some how system is not able to find them so may be i need to find what controls the path for looking system libraries. For ex ld config type.

Currently there is no file under /var/ld/ld.config .. should i try creating it ?
# 5  
Old 11-05-2009
Quote:
Originally Posted by rajwinder
Thanks for the replies guys.

I am able to mount the file system but now the question is why it is not able to find basic system libraries when all of them are present in the /lib or /usr/lib. I think some how system is not able to find them so may be i need to find what controls the path for looking system libraries. For ex ld config type.

Currently there is no file under /var/ld/ld.config .. should i try creating it ?
No.. As I told you..

I will show you my experience when I had this same issue
Code:
Booting to milestone "milestone/single-user:default".
Hostname: HOSTNAME
NOTICE: VxVM vxdmp V-5-0-34 added disk array DISKS, datype = Disk

NOTICE: VxVM vxdmp V-5-0-34 added disk array 300453, datype = EMC

NOTICE: VxVM vxdmp V-5-0-34 added disk array CKM00084900118, datype = EMC_CLARiiON

NOTICE: VxVM vxdmp V-5-3-1700 dmpnode 308/0x0 has migrated from enclosure FAKE_ENCLR_SNO to enclosure DISKS

WARNING: The following files in / differ from the boot archive:

    changed /kernel/drv/emcp.conf

The recommended action is to reboot to the failsafe archive to correct
the above inconsistency. To accomplish this, on a GRUB-based platform,
reboot and select the "Solaris failsafe" option from the boot menu.
On an OBP-based platform, reboot then type "boot -F failsafe". Then
follow the prompts to update the boot archive. Alternately, to continue
booting at your own risk, you may clear the service by running:
"svcadm clear system/boot-archive"

Mar  8 15:18:07 svc.startd[7]: svc:/system/boot-archive:default: Method "/lib/svc/method/boot-archive" failed with exit status 95.

Mar  8 15:18:07 svc.startd[7]: system/boot-archive:default failed fatally: transitioned to maintenance (see 'svcs -xv' for details)

Requesting System Maintenance Mode
Console login service(s) cannot run

Root password for system maintenance (control-d to bypass): 
single-user privilege assigned to /dev/console.
Entering System Maintenance Mode

Mar  8 15:18:39 su: 'su root' succeeded for root on /dev/console

Sun Microsystems Inc.	SunOS 5.10	Generic	January 2005
-bash: /opt/EMCpower/scripts/emcp_setup.sh: No such file or directory
Sourcing /root/users/root/.profile-EIS.....

root@HOSTNAME# init 3
root@HOSTNAME# who -r

PPME_PP error(0x1e): System error (0x1e).

root@HOSTNAME# /usr/sbin/bootadm update-archive -v
is a READONLY filesystem: /

root@HOSTNAME# init 0

root@HOSTNAME# GAB INFO V-15-1-20021 GAB available
svc.startd: The system is coming down.  Please wait.
svc.startd: 82 system services are now being stopped.
svc.startd: The system is down.
syncing file systems... done
Program terminated

{10} ok boot -F failsafe
Resetting ...
RSC Alert: Host System has Reset

Software Reset

Enabling system bus....... Done
Initializing CPUs......... Done
Initializing boot memory.. Done
Initializing OpenBoot
Probing system devices
ChassisSerialNumber 0733AM0406 
Probing I/O buses
Probing system devices
ChassisSerialNumber 0733AM0406 
Probing I/O buses

Sun Fire V490, No Keyboard
Copyright 2006 Sun Microsystems, Inc.  All rights reserved.
OpenBoot 4.22.24, 32768 MB memory installed, Serial #71624202.
Ethernet address 0:14:4f:44:e6:a, Host ID: 8444e60a.

Initializing    12MB of memory at addr        a7ff000000 

Initializing   128MB of memory at addr        a7f7002000 
Initializing 32624MB of memory at addr        a000000000                                                                    
Rebooting with command: boot -F failsafe
Boot device: /pci@9,600000/SUNW,qlc@2/fp@0,0/disk@0,0  File and args: -F failsafe

SunOS Release 5.10 Version Generic_137137-09 64-bit
Copyright 1983-2008 Sun Microsystems, Inc.  All rights reserved.
Use is subject to license terms.
Configuring devices.
Searching for installed OS instances...

/dev/dsk/c3t0d0s0 is under md control, skipping.
To manually recover the boot archive on a root mirror,mount the first
side (the one that the system boots from) and run:

        bootadm update-archive -R <mount_point>

/dev/dsk/c3t1d0s0 is under md control, skipping.
To manually recover the boot archive on a root mirror,mount the first
side (the one that the system boots from) and run:

        bootadm update-archive -R <mount_point>

No installed OS instance found.

Starting shell.
 
# svcadm clear system/boot-archive
svcadm: Instance "svc:/system/boot-archive:default" is not in a maintenance or degraded state.

# mount /dev/dsk/c0t0d0s0 /mnt
# bootadm update-archive -R /mnt
Creating boot_archive for /mnt
updating /mnt/platform/sun4u/boot_archive
15+0 records in
15+0 records out
#umount /mnt

# mount /dev/dsk/c0t1d0s0 /mnt
# bootadm update-archive -R /mnt
Creating boot_archive for /mnt
updating /mnt/platform/sun4u/boot_archive
15+0 records in
15+0 records out
# umount /mnt

# init 6
# 
The system is being restarted.
syncing file systems... done
rebooting...
Resetting ...
RSC Alert: Host System has Reset

Software Reset

Enabling system bus....... Done
Initializing CPUs......... Done
Initializing boot memory.. Done
Initializing OpenBoot
Probing system devices
ChassisSerialNumber 0733AM0406 
Probing I/O buses
Probing system devices
ChassisSerialNumber 0733AM0406 
Probing I/O buses

Sun Fire V490, No Keyboard
Copyright 2006 Sun Microsystems, Inc.  All rights reserved.
OpenBoot 4.22.24, 32768 MB memory installed, Serial #71624202.
Ethernet address 0:14:4f:44:e6:a, Host ID: 8444e60a.

Initializing    12MB of memory at addr        a7ff000000 

Initializing   128MB of memory at addr        a7f7002000 

Initializing 32624MB of memory at addr        a000000000 
                                                                      
Rebooting with command: boot
Boot device: disk  File and args: 

SunOS Release 5.10 Version Generic_138888-01 64-bit
Copyright 1983-2008 Sun Microsystems, Inc.  All rights reserved.
Use is subject to license terms.


Hostname: HOSTNAME
NOTICE: VxVM vxdmp V-5-0-34 added disk array DISKS, datype = Disk

NOTICE: VxVM vxdmp V-5-0-34 added disk array 300453, datype = EMC

NOTICE: VxVM vxdmp V-5-0-34 added disk array CKM00084900118, datype = EMC_CLARiiON

NOTICE: VxVM vxdmp V-5-3-1700 dmpnode 308/0x0 has migrated from enclosure FAKE_ENCLR_SNO to enclosure DISKS

Mar  8 15:40:49 in.mpathd[445]: No test address configured on interface ce4; disabling probe-based failure detection on it

Mar  8 15:40:49 in.mpathd[445]: No test address configured on interface ce0; disabling probe-based failure detection on it

LLT INFO V-14-1-10009 LLT Protocol available
GAB INFO V-15-1-20021 GAB available
/dev/md/rdsk/d4 is clean
/dev/md/rdsk/d5 is clean
/dev/md/rdsk/d6 is clean
Reading ZFS config: done.

HOSTNAME

HOSTNAME console login:

Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Solaris

Solaris 11 recovery

Hi, I need to recover the Solaris 11 OS, and it backup via Netbackup 7.6 file level backup only. Does anyone know what are steps to recover it? Thanks. :confused::confused::confused: (3 Replies)
Discussion started by: freshmeat
3 Replies

2. UNIX for Advanced & Expert Users

File recovery

Hi, Please let me know the way to recover the files deleted from home directory by 'rm*' command . Thanks in advance. (10 Replies)
Discussion started by: ravigupta2u
10 Replies

3. Red Hat

ldap recovery

Is there a way to recover the ldap server if it crashes (4 Replies)
Discussion started by: nalcomis
4 Replies

4. AIX

AIX DR Recovery

I will be going for a DR test next month and have few concerns regarding restoring user vg's System which will be restored is on P750 (AIX 6.1) and the DR hdwr is P570. I do have bootable mksysb of the system and also have savevg (with no data) using "savevg -r -f " for the user volume... (5 Replies)
Discussion started by: mk8570
5 Replies

5. Solaris

Solaris 8 using Flash Archive for Disaster Recovery

Hello everyone I am Kevin and new to this forum. I have encounter an issue I can't seem to resolve. I am currently using Solaris 8 02/04 on Sun V240 servers. I know how to create a flar image of the server and restore it using NFS (network server) or Local Tape (tape drive). What I need to do... (2 Replies)
Discussion started by: Kevin1166
2 Replies

6. UNIX for Dummies Questions & Answers

Solaris 8 password recovery plz HELP!!!!!

Hello board, I'm new to Solaris Linux world, trying to learn on my onw, as I notice the windows is a big fraud.... OK let me get to my issue: I have a SOlaris 8 X86 that I don;t have a password and even the screen is disabled(assuming for the security reasons) I just see a... (8 Replies)
Discussion started by: nexOne
8 Replies

7. Solaris

Sun Solaris Disaster Recovery Plan ...

Hi all, I'm new in this domain, and on this operating system, but in my job, i have to find a way to make a disaster recovery plan for our server (sun solaris) which has the oracle database. I don't have any standby servers to be used for data replication, i only want to use CD's to put on... (4 Replies)
Discussion started by: sam212
4 Replies

8. Shell Programming and Scripting

make recovery tape for solaris

Hello All I am need of amke recover tape for solaris.Could anybody tell me how do i create a make recovery tape for solaris.I am on sun-solaris 2.8 regards Hrishy (2 Replies)
Discussion started by: xiamin
2 Replies

9. UNIX for Advanced & Expert Users

Recovery on solaris 2.6

I backed up savesets of my mailserver which is an nsr client to my nsr server, another remote system. I use solstice backup 5.5.1 and a 4.4 mm tape drive. My mailserver developed some problems a while ago and i had to reformat and reinstall the O/S and mailserver software. Now i want to recover... (6 Replies)
Discussion started by: lealyz
6 Replies
Login or Register to Ask a Question