Originally Posted by zxmaus

ok, I don't see any errors or overflows or underruns on any of your adapters.That is a good thing. You can transfer large package sizes to everywhere else without loosing packages - which is a good thing too.
It would have been nice to know which adapters make up which link aggregation, but I forgot to ask for it
A few things I see in your network tunables, that I would probably change if this would be my systems to improve the general network flow, (i.e. sack, tcp_nodelayack, and buffer sizes) but for that it would help to know exactly which adapters make up which link aggregation. So if you could show me the lsattr -El entx outputs for your link aggregations and the underlying physical adapters that would help to make sure you dont use different speeds and depending on the adapters, the device attributes are set correctly. It might help as well to set certain settings on the adapters themselves in addition to the general system settings, like rfc1323 and buffers. And I can see that you have relatively little free memory. This may or may not be a problem so if you can give me the outputs of vmstat -v and vmstat -s, that would help me tell you the answer to this. You may as well want to populate netsvc.conf as it helps with order of name resolution and might generally improve network speed when the system does not have to guess how to find another host.
To get rid of the pkcs error on top of the lsdev -Cc adapter output, you probably need to install the security.pkcs11 fileset. And finally, can you please run lppchk -vm3 and post the output as well?.

sysopr1@oltpn8c:/home/sysopr1>lsattr -El ent32
adapter_names ent2,ent18 EtherChannel Adapters True
alt_addr 0x000000000000 Alternate EtherChannel Address True
auto_recovery yes Enable automatic recovery after failover True
backup_adapter NONE Adapter used when whole channel fails True
hash_mode default Determines how outgoing adapter is chosen True
interval long Determines interval value for IEEE 802.3ad mode True
mode 8023ad EtherChannel mode of operation True
netaddr 0 Address to ping True
noloss_failover yes Enable lossless failover after ping failure True
num_retries 3 Times to retry ping before failing True
retry_time 1 Wait time (in seconds) between pings True
use_alt_addr no Enable Alternate EtherChannel Address True
use_jumbo_frame no Enable Gigabit Ethernet Jumbo Frames True


sysopr1@oltpn8c:/home/sysopr1>lsattr -El ent33
adapter_names ent3,ent19 EtherChannel Adapters True
alt_addr 0x000000000000 Alternate EtherChannel Address True
auto_recovery yes Enable automatic recovery after failover True
backup_adapter NONE Adapter used when whole channel fails True
hash_mode default Determines how outgoing adapter is chosen True
interval long Determines interval value for IEEE 802.3ad mode True
mode 8023ad EtherChannel mode of operation True
netaddr 0 Address to ping True
noloss_failover yes Enable lossless failover after ping failure True
num_retries 3 Times to retry ping before failing True
retry_time 1 Wait time (in seconds) between pings True
use_alt_addr no Enable Alternate EtherChannel Address True
use_jumbo_frame no Enable Gigabit Ethernet Jumbo Frames True


sysopr1@oltpn8c:/home/sysopr1>lsattr -El ent34
adapter_names ent10,ent26 EtherChannel Adapters True
alt_addr 0x000000000000 Alternate EtherChannel Address True
auto_recovery yes Enable automatic recovery after failover True
backup_adapter NONE Adapter used when whole channel fails True
hash_mode default Determines how outgoing adapter is chosen True
interval long Determines interval value for IEEE 802.3ad mode True
mode 8023ad EtherChannel mode of operation True
netaddr 0 Address to ping True
noloss_failover yes Enable lossless failover after ping failure True
num_retries 3 Times to retry ping before failing True
retry_time 1 Wait time (in seconds) between pings True
use_alt_addr no Enable Alternate EtherChannel Address True
use_jumbo_frame no Enable Gigabit Ethernet Jumbo Frames True


sysopr1@oltpn8c:/home/sysopr1>lsattr -El ent35
adapter_names ent11,ent27 EtherChannel Adapters True
alt_addr 0x000000000000 Alternate EtherChannel Address True
auto_recovery yes Enable automatic recovery after failover True
backup_adapter NONE Adapter used when whole channel fails True
hash_mode default Determines how outgoing adapter is chosen True
interval long Determines interval value for IEEE 802.3ad mode True
mode 8023ad EtherChannel mode of operation True
netaddr 0 Address to ping True
noloss_failover yes Enable lossless failover after ping failure True
num_retries 3 Times to retry ping before failing True
retry_time 1 Wait time (in seconds) between pings True
use_alt_addr no Enable Alternate EtherChannel Address True
use_jumbo_frame no Enable Gigabit Ethernet Jumbo Frames True


sysopr1@oltpn8c:/home/sysopr1>lsattr -El ent36
adapter_names ent12,ent28 EtherChannel Adapters True
alt_addr 0x000000000000 Alternate EtherChannel Address True
auto_recovery yes Enable automatic recovery after failover True
backup_adapter NONE Adapter used when whole channel fails True
hash_mode default Determines how outgoing adapter is chosen True
interval long Determines interval value for IEEE 802.3ad mode True
mode 8023ad EtherChannel mode of operation True
netaddr 0 Address to ping True
noloss_failover yes Enable lossless failover after ping failure True
num_retries 3 Times to retry ping before failing True
retry_time 1 Wait time (in seconds) between pings True
use_alt_addr no Enable Alternate EtherChannel Address True
use_jumbo_frame yes Enable Gigabit Ethernet Jumbo Frames True


sysopr1@oltpn8c:/home/sysopr1>lsattr -El ent37
adapter_names ent13,ent29 EtherChannel Adapters True
alt_addr 0x000000000000 Alternate EtherChannel Address True
auto_recovery yes Enable automatic recovery after failover True
backup_adapter NONE Adapter used when whole channel fails True
hash_mode default Determines how outgoing adapter is chosen True
interval long Determines interval value for IEEE 802.3ad mode True
mode 8023ad EtherChannel mode of operation True
netaddr 0 Address to ping True
noloss_failover yes Enable lossless failover after ping failure True
num_retries 3 Times to retry ping before failing True
retry_time 1 Wait time (in seconds) between pings True
use_alt_addr no Enable Alternate EtherChannel Address True
use_jumbo_frame yes Enable Gigabit Ethernet Jumbo Frames True


sysopr1@oltpn8c:/home/sysopr1>vmstat -v
59703296 memory pages
24344784 lruable pages
2960431 free pages
12 memory pools
5104035 pinned pages
90.0 maxpin percentage
3.0 minperm percentage
90.0 maxperm percentage
66.1 numperm percentage
16101397 file pages
0.0 compressed percentage
0 compressed pages
66.1 numclient percentage
90.0 maxclient percentage
16101397 client pages
0 remote pageouts scheduled
16925 pending disk I/Os blocked with no pbuf
0 paging space I/Os blocked with no psbuf
2310 filesystem I/Os blocked with no fsbuf
0 client filesystem I/Os blocked with no fsbuf
963 external pager filesystem I/Os blocked with no fsbuf
68.1 percentage of memory used for computational pages


sysopr1@oltpn8c:/home/sysopr1>vmstat -s
2901456848 total address trans. faults
71529368 page ins
37972163 page outs
0 paging space page ins
0 paging space page outs
0 total reclaims
1499444920 zero filled pages faults
10061720 executable filled pages faults
129155399 pages examined by clock
5 revolutions of the clock hand
69804251 pages freed by the clock
35287579 backtracks
0 free frame waits
0 extend XPT waits
1787276 pending I/O waits
109500893 start I/Os
6814168 iodones
20209136397 cpu context switches
10241162941 device interrupts
5085027858 software interrupts
3949413325 decrementer interrupts
10361145 mpc-sent interrupts
10361144 mpc-receive interrupts
95687435 phantom interrupts
0 traps
160934074206 syscalls


sysopr1@oltpn8c:/home/sysopr1>lppchk -vm3
sysopr1@oltpn8c:/home/sysopr1>