How can I test link aggregation?


Login or Register for Dates, Times and to Reply

 
Thread Tools Search this Thread
# 1  
How can I test link aggregation?

Hi,
I have Solaris-10 server and link aggregation is configured on this in below way
Code:
# dladm show-aggr
key: 1 (0x0001) policy: L4      address: 3c:d9:2b:ee:a8:a (auto)
           device       address                 speed           duplex  link    state
           bnx1         3c:d9:2b:ee:a8:a          1000  Mbps    full    up      attached
           igb2         f4:ce:46:a7:eb:92         1000  Mbps    full    up      attached
key: 2 (0x0002) policy: L4      address: 3c:d9:2b:ee:a8:8 (auto)
           device       address                 speed           duplex  link    state
           bnx0         3c:d9:2b:ee:a8:8          1000  Mbps    full    up      attached
           igb3         f4:ce:46:a7:eb:93         1000  Mbps    full    up      attached
# dladm show-link
bnx0            type: non-vlan  mtu: 1500       device: bnx0
bnx1            type: non-vlan  mtu: 1500       device: bnx1
bnx2            type: non-vlan  mtu: 1500       device: bnx2
bnx3            type: non-vlan  mtu: 1500       device: bnx3
igb0            type: non-vlan  mtu: 1500       device: igb0
igb1            type: non-vlan  mtu: 1500       device: igb1
igb2            type: non-vlan  mtu: 1500       device: igb2
igb3            type: non-vlan  mtu: 1500       device: igb3
aggr1           type: non-vlan  mtu: 1500       aggregation: key 1
aggr2           type: non-vlan  mtu: 1500       aggregation: key 2
aggr150002      type: vlan 150  mtu: 1500       aggregation: key 2
aggr50001       type: vlan 50   mtu: 1500       aggregation: key 1
aggr55001       type: vlan 55   mtu: 1500       aggregation: key 1
aggr60001       type: vlan 60   mtu: 1500       aggregation: key 1
aggr62001       type: vlan 62   mtu: 1500       aggregation: key 1
aggr64001       type: vlan 64   mtu: 1500       aggregation: key 1
aggr66001       type: vlan 66   mtu: 1500       aggregation: key 1
aggr81001       type: vlan 81   mtu: 1500       aggregation: key 1

# dladm show-dev
bnx0            link: up        speed: 1000  Mbps       duplex: full
bnx1            link: up        speed: 1000  Mbps       duplex: full
bnx2            link: unknown   speed: 0     Mbps       duplex: unknown
bnx3            link: unknown   speed: 0     Mbps       duplex: unknown
igb0            link: unknown   speed: 0     Mbps       duplex: half
igb1            link: unknown   speed: 0     Mbps       duplex: half
igb2            link: up        speed: 1000  Mbps       duplex: full
igb3            link: up        speed: 1000  Mbps       duplex: full
#

There will be switch replacement, so one by one, link will go down from one side. Before that activity, is there any way to check/test, if server will work fine, if one side goes down ? In same way, as used to check by if_mpadm -d in ipmp.

Thanks
# 2  
The only way I know of to properly test it is to either physically pull a cable (logically if it's a virtual server) or to down the network interface card. Obviously you would down the physical card that supports one path or the aggregated link. You should be able to get statistics about the aggregated link to show you what is in use. A path should die and then recover when you turn it back on.

Of course, this introduces risk if it doesn't work, so always make sure you have a way to re-enable it all quickly.Smilie




Kind regards,
Robin
This User Gave Thanks to rbatte1 For This Post:
# 3  
Thank Robin,
Thats what I thought. I will plan it out
# 4  
Code:
dladm show-aggr

Check correct "speed" and "duplex mode" and there should be "link up".

If you use LACP (I think you must use LACP - everything else I have seen being faulty), then check with
Code:
dladm show-aggr -L

The output of a working LACP looks like this:
Code:
    device    activity timeout aggregatable sync  coll dist defaulted expired
    xyz0      passive  long    yes          yes   yes  yes  no        no     
    xyz1      passive  long    yes          yes   yes  yes  no        no

In Solaris 10 the timer defaults to "short", you should change it to "long" unless told otherwise by the vendor of the connected LAN switches.
"passive" or "active" does not mattter (the connected LAN switch must be "active").
"policy" does not matter.
The "sync" "coll" and "dist" must all be "yes" (otherwise it does not cooperate with the connected LAN switch).

That's all theory.
The practise is: pull a cable and check connectivity.
# 5  
In my output, timeout is mentioned as short.
How will it affect, if I do not change it to long ?
Code:
# dladm show-aggr -L
key: 1 (0x0001) policy: L4      address: 3c:d9:2b:ee:a8:a (auto)
                LACP mode: active       LACP timer: short
    device    activity timeout aggregatable sync  coll dist defaulted expired
    bnx1      active   short   yes          yes   yes  yes  no        no
    igb2      active   short   yes          yes   yes  yes  no        no
key: 2 (0x0002) policy: L4      address: 3c:d9:2b:ee:a8:8 (auto)
                LACP mode: active       LACP timer: short
    device    activity timeout aggregatable sync  coll dist defaulted expired
    bnx0      active   short   yes          yes   yes  yes  no        no
    igb3      active   short   yes          yes   yes  yes  no        no
#

# 6  
Ask your LAN switch vendor!
Most vendors support "short" if both NICs are connected to one LAN switch, but not if connected to two different LAN switches.
In the worst case a fail-over does not work. Do the "pull the cable" test at least!
# 7  
Thanks.
I was able to find a server, on which I can do "pull the cable test".
From below output, it shows that bnx1 cable was pulled out. since aggr is configured igb2 took the traffic and all link sustained. But first line shows "address: 3c:d9:2b:f9:20:5e (auto)" and this MAC address is for bnx1.
Since igb2 took all the traffic now and its mac is f4:ce:46:a7:df:ba , should it not show in auto ? Sorry, I am confused in understanding this.
Code:
# dladm show-aggr
key: 1 (0x0001) policy: L4      address: 3c:d9:2b:f9:20:5e (auto)
           device       address                 speed           duplex  link    state
           bnx1         3c:d9:2b:f9:20:5e         0     Mbps    half    down    standby
           igb2         f4:ce:46:a7:df:ba         1000  Mbps    full    up      attached
key: 2 (0x0002) policy: L4      address: 3c:d9:2b:f9:20:5c (auto)
           device       address                 speed           duplex  link    state
           bnx0         3c:d9:2b:f9:20:5c         1000  Mbps    full    up      attached
           igb3         f4:ce:46:a7:df:bb         1000  Mbps    full    up      attached
#
# dladm show-aggr -L
key: 1 (0x0001) policy: L4      address: 3c:d9:2b:f9:20:5e (auto)
                LACP mode: active       LACP timer: short
    device    activity timeout aggregatable sync  coll dist defaulted expired
    bnx1      active   short   yes          no    no   no   yes       no
    igb2      active   short   yes          yes   yes  yes  no        no
key: 2 (0x0002) policy: L4      address: 3c:d9:2b:f9:20:5c (auto)
                LACP mode: active       LACP timer: short
    device    activity timeout aggregatable sync  coll dist defaulted expired
    bnx0      active   short   yes          yes   yes  yes  no        no
    igb3      active   short   yes          yes   yes  yes  no        no
#

Login or Register for Dates, Times and to Reply

Previous Thread | Next Thread
Thread Tools Search this Thread
Search this Thread:
Advanced Search

10 More Discussions You Might Find Interesting

1. IP Networking

Link Aggregation

Hi ihave three link of internet and iwant to put one linux front of a firewall that this three linux speard firewall such az load balance and fialover but dont close any port and protocol and only firewall have been internet what way can i use for it ? are there any script and services do that... (0 Replies)
Discussion started by: mnnn
0 Replies

2. Solaris

Link Aggregation without LACP

Hi, I'm not from the Solaris world and some of these things are new to me. Can someone tell me if it is possible to configure link aggregation without using LACP? I am told etherchannel was setup without LACP. (3 Replies)
Discussion started by: techy1
3 Replies

3. HP-UX

Break Link Aggregation in HP UX.

Hi, I want to Break the Link Aggregation. My aggregation are lan0+lan1 = lan900. Now I want to break this and put the IP in lan0. But i have cluster environment and this is the main database server. So It need to change in cluster script. But I dont know where I have to change it. Please... (1 Reply)
Discussion started by: mkiron
1 Replies

4. Solaris

Link aggregation

Me again :) I'm trying to find a page describing the L2, L3 und L4 modes of dladm. It's nice to read "hashed by ip header", but how should I use that? On the file-server it's ok to have the six interfaces serving six clients each on it's own. But an rsync connection via switch between two... (8 Replies)
Discussion started by: PatrickBaer
8 Replies

5. HP-UX

Link Aggregation HPUX

Hi, Hoping someone can offer some advice on something i have not dealt with before. We have a server that seems to have some very strange configuration done on it. It has 2 physical NIC's and rather than both be aggregated into LAN900 we have 1 in LAN900 and 1 in LAN901? (See Below)... (2 Replies)
Discussion started by: Andyp2704
2 Replies

6. AIX

Link aggregation with hacmp ?

Hi, I need to setup a hacmp cluster (my first one, we usually use VCS on AIX), but I require more network bandwith than a normal gigabit etherchannel setup can provide, so I am thinking about using linkaggregation - 2 active adapters to one switch and a single backup adapter to another switch... (4 Replies)
Discussion started by: zxmaus
4 Replies

7. Solaris

Difference between IPMP and Link Aggregation ?

Hi everybody, One client asked me to configure network failover and load balancing for two Ethernet interfaces, I tried IPMP but I was unable to do so, because he's using his Gateway as firewall and PING is disabled. so IPMP kept telling me that all interfaces failed because gateway can't be... (8 Replies)
Discussion started by: Sun Fire
8 Replies

8. IP Networking

bonding lacp and link aggregation

Hello, I am trying to get clarity on a few things and am looking for some info. In every article I have read about link aggregation and lacp, it can be used combine physical links to create 1 logical link for increased bandwidth. But what it doesn't say is if this is limited by source/dst. ... (1 Reply)
Discussion started by: jaredo
1 Replies

9. UNIX for Advanced & Expert Users

Link Aggregation and LACP

Hi there I have a requirement to provide failover to our customer boxes in case of interface / switch failure, I have been looking at Solaris Link Aggregation with LACP and I wanted to ask a question Ive seen multiple websites that say the following Does this also mean that if the... (1 Reply)
Discussion started by: hcclnoodles
1 Replies

10. Solaris

Link Aggregation

Hi there I have a requirement to provide failover to our customer boxes in case of interface / switch failure, I have been looking at Solaris Link Aggregation with LACP and I wanted to ask a question Ive seen multiple websites that say the following Does this also mean that if the... (2 Replies)
Discussion started by: hcclnoodles
2 Replies

Featured Tech Videos