aggr not persistent after a reboot


 
Thread Tools Search this Thread
Operating Systems Solaris aggr not persistent after a reboot
# 1  
Old 12-23-2011
aggr not persistent after a reboot

All,

I hope someone can help me on my problem with an aggregate, as I am a Solaris noob. I tried doing this according to the official documentation from Oracle (unfortunately, as a new user to the forum, I may not post URLs...) and also googled a lot around, but have not found any solution yet.


I am in the process of building a Solaris NAS system. I have installed Solaris 11 (not express, as it is not available anymore). I have 3 NIC's installed in the system. I want to use one (net3) for the management of the box, and the other two (net0 and net1) as an aggregate for the data traffic to the NAS.


My problem is that the aggregate always shows up as "disabled" after a reboot, and I have to manually enable it (which works without problems, by the way).


So here is what I did:
  1. Disabled nwam:
    Code:
    svcadm disable nwam
    svcadm enable network/physical:default

  2. removed any previous config from the adapters
    Code:
    ipadm delete-if net0
    ipadm delete-if net1

  3. created the aggregate
    Code:
    dladm create-aggr -L active -l net0 -l net1 aggr0

  4. Then, according to the doc, it should be possible to create the address using "ipadm create-addr -T static...", but in my case, this did not work. Instead, I had to plumb the aggregate:
    Code:
    ifconfig aggr0 plumb 192.168.1.224/24

    then I was able to bring it up - manually. I am aware that this command is only temporary and not persistent.
  5. I then tried to find a solution here and there, and after a lot of googling and trying around, I found the ipadm to work all of a sudden - honestly, I don't know why Smilie
    Code:
    ipadm create-ip aggr0
    ipadm create-addr -T static -a 192.168.1.224/24 aggr0/v4

That's as far as I got. Oh yes, my hosts file reads:
Quote:
::1 nas1 localhost
127.0.0.1 nas1 localhost loghost
192.168.1.222 nas1
192.168.1.224 nas1aggr

After each reboot, I see:
Quote:
root@nas1:~# ipadm show-addr
ADDROBJ TYPE STATE ADDR
lo0/v4 static ok 127.0.0.1/8
net3/_a static ok 192.168.1.222/24
lo0/v6 static ok ::1/128
aggr0/v4 static disabled 192.168.1.224/24

I can then bring the interface up with simply ipadm enable-if -t aggr0, however, as stated, it's still not persistent.


When googling, I learnt that in earlier versions of Solaris, there was a file for each interface like hostname.interface . This seems not to be the case anymore, according to the documentation from Oracle. Nevertheless, I have tried it just to be sure, and so I created a file /etc/nas1.aggr0, however, this did not work as well.


Any help is greatly appreciated - thanks!

Cap'
# 2  
Old 12-23-2011
Have you tried ipadm enable-if aggr0 - without "-t" and then reboot?
# 3  
Old 12-23-2011
Yes I have tried this, but rather by accident - I simply forgot "-t" several times. I then always get a message stating that "this operation is not allowed on the adapter" or something like that... I have to look up the exact wording tonight when I get home from work. I'll post it here afterwards.
Thanks,
Cap
# 4  
Old 12-23-2011
My co-worker just just did this on a Solaris 10 server.
He did it like this
Code:
dladm create-aggr -L active -l net0 -l net1 0
Also the hosts file like this.
::1 nas1 localhost
127.0.0.1 nas1 localhost loghost
192.168.1.222 nas1
192.168.1.224 nas1aggr  <--is this the right hostname?

My co worker made 4 ports on 2 different NIC that the same IP.

If this is not what you want, sorry.

Last edited by bitlord; 12-27-2011 at 11:34 AM..
# 5  
Old 12-23-2011
Thanks for the quick reply.
No, that wasn't correct, that should have been "nas1" only. However, the aggr0 is still not up after a reboot.

The error message I mentioned before is:
Quote:
root@nas1:~# ipadm enable-if aggr0
ipadm: persistent operation not supported for enable-if
root@nas1:~#
However, it works with "-t" flawlessly.
Thanks for your support...
Cap'
# 6  
Old 12-27-2011
Going nuts on this problem... anyone?

If not, how can I set a script that runs automatically on every OS start to ensure the aggregate is up?

Thanks,
Cap'
# 7  
Old 01-02-2012
I've setup several aggregates in the past. Just to make sure, are you working with your network team on this? The aggregate has to be setup on the switch end as well or it won't work. Both connections have to be going to the same switch. I've had trouble in the past with network guys who didn't know how to set it up properly on their end.

Sometimes the network guys also won't know what you mean by "aggregate" since it can sometimes go different names depending on vendors. I had to actually send our network guy the Wikipedia link so that he could go research how to do it on their Cisco switch -- Link aggregation - Wikipedia, the free encyclopedia

Depending on the network infrastructure in the data center sometimes network teams will freak out on you about this as well. I tried to set it up one data center, and the network team rejected it because they only had 2 GB links going between their switches in the data center and they were concerned I would flood their links.

Good luck! Once it's setup it works like a charm, and is persistant across reboots. I did this for a backup server in one data center that was getting bogged down at night due to so much traffic from various servers. After I set that up it knocked the backup times almost in half. It was awesome watching how fast the data was transferring.

Example syntax would be similar to this:

Code:
dladm create-aggr -d bge0 -d bge1 2
 
dladm show-aggr ### (to verify you set it up properly)
 
#### (Then do your ifconfig commands as necessary, you shouldn't have to reboot to make sure it's working. 
# Once you know it's working update your /etc/hostname.* files in Solaris 10 or ipadm in Solaris 11 and 
# reboot to make sure it continues to work across reboots.)
### Example:
ifconfig aggr2 plumb
ifconfig aggr2 ................


Last edited by jim mcnamara; 01-02-2012 at 10:28 AM..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Solaris

Create-aggr failed

Hi, I am trying to create aggregation by using dladm, But am getting the following error. dladm create-aggr -P L2 -l net2 sumaggr2 dladm: create operation failed: link busy I have checked in dladm show-link and the state is "down".. dladm show-link | grep ^net2 net2 phys ... (1 Reply)
Discussion started by: Sumanthsv
1 Replies

2. AIX

BootIP vs Persistent IP in HACMP

I have done other clusters (HP MC/Service Guard and oracle Clusters, and RHEL Cluster services), and have good idea about hacmp (a little older knowledge). However the term "Boot IP" for some reason is messing with my head. Have not done HACMP since the 4.1.2.X days. Is the Bootip the... (1 Reply)
Discussion started by: mrmurdock
1 Replies

3. Programming

Python Request Persistent

I noticed that when attempting to download videos from the url, I receive a 403 forbidden when I get through to a certain point in my downloads. I can download a third of the videos but will error: Retrieving file 'blah-video.f4v'... Traceback (most recent call last): ... (0 Replies)
Discussion started by: metallica1973
0 Replies

4. War Stories

Why am I persistent to be WRONG!

:wall::wall::wall::wall: I am sharing some techno-geeky-work related issue, which can best be dissected here only. I am expecting more of a discussion,as serious as when two guys sharing experience over smoke and beer. The thing is, till now i have been only a student, so never cared about how... (10 Replies)
Discussion started by: animesharma
10 Replies

5. AIX

PowerHA, same subnet for persistent and service ip

I am new in AIX and please forgive my poor english. I know that AIX allow same subnet IPs for different interfaces, which result in multipath routing / route striping. My question is, is there any best practice for the persistent and service IP with same subnet to stay on same interface, or... (5 Replies)
Discussion started by: skeyeung
5 Replies

6. AIX

Unable to add persistent IP

i am trying to make HACMP but when i add a persistent ip, error shows unable to determine address for 'UPIDGIS1_pers' pls help me out AIX - 5.3 HACMP -5.4 thanks (2 Replies)
Discussion started by: reply.ravi
2 Replies

7. AIX

HACMP Persistent IP blacklisted

Hi, I want to use the service IP incase for any network activity rather than the persistent IP as the Persistent IP is blacklisted in our network. Is there any way to make the service ip as LPARs default IP to be used as the lpars source IP incase it pings anything or acceses any external... (6 Replies)
Discussion started by: aixromeo
6 Replies

8. Shell Programming and Scripting

Persistent variable

I found a way to make a numeric variable persistent for a script : #!/bin/bash function Persist() { # 1:Expression like VARIABLE=Value (numeric) local V=${1%=*} eval "$1" sed -i "s/^$V=*/$1/" $(which $(basename $0)) || return 1 }And how to use itAA=12 read -p "Enter a... (2 Replies)
Discussion started by: frans
2 Replies

9. UNIX for Advanced & Expert Users

named pipe with persistent buffer

Hey folks, i need communicate between 2 processes in a reliable manner. The information delivery has to be guarenteed. I thought about proc 2 sending a signal to proc 1 when information has being written to disc and wirte() has been verified (sync/flush). The IPC method for the data is named... (4 Replies)
Discussion started by: heck
4 Replies

10. Solaris

different between soft reboot and hard reboot

Hi Guru's Can any want here could explain to me the different between soft reboot and hard reboot . Best Regards Seelan (3 Replies)
Discussion started by: seelan3
3 Replies
Login or Register to Ask a Question