Visit Our UNIX and Linux User Community


Supported but not advertised 1000baseT/Full only in one node of RH cluster


 
Thread Tools Search this Thread
Top Forums UNIX for Advanced & Expert Users Supported but not advertised 1000baseT/Full only in one node of RH cluster
# 1  
Old 08-12-2009
Supported but not advertised 1000baseT/Full only in one node of RH cluster

Hello all,

I have two twins Proliant DL580 G3 with RHEL4U4 clustered with Oracle RAC with two nics working in each one.

All nics have the same firmware, driver and type of physical cable connected (Cat 5E). All ports of the switch have the same configuration but only one of the nics of only one server can negociate to 1Gbps.

The main difference between nic working 1Gbps and the rest is the others nics Support 1000baseT/Full but this mode is NOT Advertised.

I have readed similar posts but in this case, I have two twin boxes which only work one interface of one box... It's very rare.

Configuration
------------------------------
Options: autoneg on
driver: tg3 -> version 3.92n 04B8459653BDAA6D1C7B798
version: 3.92n
firmware-version: 5704-v3.27b, ASFIPMIc v2.36
Broadcom Corporation NetXtreme BCM5704 Gigabit Ethernet (rev 10)
Kernel: 2.6.9-78.0.17.ELsmp


Thanks and regards.
# 2  
Old 08-14-2009
Last night we change the cable in server is working Gigabit and use it for the server can't negotiate Gbit and we used the same switch port with no results....

żAny suggestion why this nic can't negotiate Gigabit?
# 3  
Old 08-21-2009
Hi Rubick,

for testing switch the cable of one of the ports where your adapter is not negotiating with the cable in the port that is negotiating ... if the other adapter works, it is a problem with the switch / switchport, if not it's an adapter problem. Did you try different switchport settings ? Do you experience any difference when setting the switchport to 1000/full rather than auto?

Rgds
zxmaus
# 4  
Old 08-21-2009
We did a lot of test about 3 hours with service lost because is heartbeat interface, we tried many many differents configuracions in switch and adapter side (auto,full, etc...) with no results... We use the same cable and switch port with adapter working properly and adapter never shows advertisment 1000.

In this case, we have more servers and only one adapter of one server supports and advertisment one card in 1000/full others, only supports without advertisment.

Support tell us upgrade of all components... but I don't want to make this upgrade because one server is working with the same level of firmwares/drivers and I wan't to know the root problem not only "customer please, upgrade and maybe works"

By the other hand, maybe I will ask for mother board change as these interfaces are integrated.

I will upgrade this "X-file" when I come back of my holidays Smilie

Thanks.
# 5  
Old 08-21-2009
Have you used ethtool to see statistics, settings, etc? See http://lxr.linux.no/#linux+v2.6.30.5/drivers/net/tg3.c for lots of information about this driver internals.
# 6  
Old 08-21-2009
Yes, and ethool shows I commented before:

Code:
# ethtool eth1
Settings for eth1:
        Supported ports: [ TP ]
        Supported link modes:   10baseT/Half 10baseT/Full
                                100baseT/Half 100baseT/Full
                                1000baseT/Half 1000baseT/Full ----> Suppports Gbit
        Supports auto-negotiation: Yes
        Advertised link modes:  10baseT/Full
                                100baseT/Half 100baseT/Full
                                --- Where is Advertised Gbit mode?

# 7  
Old 08-21-2009
Looking at the source code, if a NIC is set in low power mode, it will not autonegotiate 1000baseT.

Suggest you dump the NVRAM of this NIC and a "good" NIC and see if they are the same.

Previous Thread | Next Thread
Test Your Knowledge in Computers #448
Difficulty: Medium
Quirky Linux and Puppy Linux were both created by Barry Kauler.
True or False?

10 More Discussions You Might Find Interesting

1. AIX

Cluster node not starting

Setting up HACMP 6.1 on a two node cluster. The other node works fine and can start properly on STABLE state (VGs varied, FS mounted, Service IP aliased). However, the other node is always stuck on ST_JOINING state. Its taking forever and you can't stop the cluster as well or recover from script... (2 Replies)
Discussion started by: depam
2 Replies

2. Solaris

SVM metaset on 2 node Solaris cluster storage replicated to non-clustered Solaris node

Hi, Is it possible to have a Solaris cluster of 2 nodes at SITE-A using SVM and creating metaset using say 2 LUNs (on SAN). Then replicating these 2 LUNs to remote site SITE-B via storage based replication and then using these LUNs by importing them as a metaset on a server at SITE-B which is... (0 Replies)
Discussion started by: dn2011
0 Replies

3. Solaris

How to remove single node cluster

Hi Gurus, I am very new to clustering and for test i have created a single node cluster, now i want to remove the system from cluster. Did some googling however as a newbee in cluster unable to co related the info. Please help Thanks (1 Reply)
Discussion started by: kumarmani
1 Replies

4. HP-UX

Identify cluster active node

Hello, Is there any way to identify the active node in a HP-UX cluster without root privileges? (3 Replies)
Discussion started by: psimoes79
3 Replies

5. Solaris

Active Sun cluster node?

I now the logical name and Virtual IP of the cluster. How can I find the active sun cluster node without having root access? (3 Replies)
Discussion started by: sreeniatbp
3 Replies

6. High Performance Computing

Setting up 2 node cluster using solaris 10

hi, i am trying to setup a 2 node cluster environment. following is what i have; 1. 2 x sun ultra60 - 450MHz procs, 1GB RAM, 9GB HDD, solaris 10 2. 2 x HBA cards 3. 2 x Connection leads to connect ultra60 with D1000 4. 1 x D1000 storage box. 5. 3 x 9GB HDD + 2 x 36GB HDD first of all,... (1 Reply)
Discussion started by: solman17
1 Replies

7. HP-UX

MC/SG Fail to join cluster node

Hi, Please advise me whereas I have two node cluster server configured with MC/SG. Application and DB are running on Node 1, while Node 2 is standby. All the volume group devices are part of cluster environment. There is only one package running at node 1. Node 2 is having the problem to... (1 Reply)
Discussion started by: rauphelhunter
1 Replies

8. HP-UX

Node can't join cluster

Need help guys! when running cmrunnode batch i'm getting this error cmrunnode : Waiting for cluster to... (1 Reply)
Discussion started by: Tris
1 Replies

9. Shell Programming and Scripting

The other node name of a SUN cluster

Hello, Under ksh I have to run a script on one of the nodes of a Solaris 8 cluster which at some time must execute a command on the alternate node: # rsh <name> "command" I have to implement this script on all the clusters of my company (a lot of...). Fortunately, the names of the two nodes... (11 Replies)
Discussion started by: heartwork
11 Replies

10. HP-UX

i-node full on /var

Can anyone tell me how would I troubleshoot when /var becomes full with inodes? This is on HP11.11 system. Where used is 92%, ifree is 1891 iuse is 88%. Thanks. (3 Replies)
Discussion started by: catwomen
3 Replies

Featured Tech Videos