Visit Our UNIX and Linux User Community

Guest LDOMS on same subnet cant ping eachother

Thread Tools Search this Thread
Operating Systems Solaris Guest LDOMS on same subnet cant ping eachother
# 1  
Old 03-01-2015
Guest LDOMS on same subnet cant ping eachother

Hi all,

New to this forum.

I have just been reading through a historical thread about some issues with IPMP.

Some tips from "Peasant" where very useful. Please see below

"Just couple of more hints regarding VM.
For VDS, use one VDS - one guest LDOM, don't put everything in primary-vds.
Disable extended-mappin-space everywhere since i noticed sometimes live migration fails with this on.
You might want to disable INTER-VNET-LINK (to off)
I had a situation when network between two guests, that reside same physical machine on the same subnet, just stops working.
I have ran some internal test with those two options on/off (which should improve network throughput), and didn't notice any
performance gains, only experienced issue above.  Depends on which patchset you are, perhaps those issues are now fixed.

The issue I am having is that two Guest LDOMS which have IP addresses in h same subnet/range are unable to ping each other. They can ping all other LDOM Guets, control/ Service etc. but not each other.

Actually, before i switched off INTER-VNET-LINK=off then they would just crash.

We have two IO domains with aggregated ports using IPMP

Please let me know what info you require and I hope you can help. Some details below:

First Guest Domain = Sneezy
    NAME             MAC               NET-DEV   ID   DEVICE     LINKPROP   DEFAULT-VLAN-ID PVID VID                  MTU   MODE   INTER-VNET-LINK
    primary-vsw50    00:14:4f:f9:c0:79 aggr0     0    switch@0              1               1    50                   1500         off
    NAME             MAC               NET-DEV   ID   DEVICE     LINKPROP   DEFAULT-VLAN-ID PVID VID                  MTU   MODE   INTER-VNET-LINK
    secondary-vsw50  00:14:4f:fb:21:17 aggr0     0    switch@0              1               1    50                   1500         off
    NAME             SERVICE                     ID   DEVICE     MAC               MODE   PVID VID                  MTU   LINKPROP
    vnet0            primary-vsw50@primary       0    network@0  00:14:4f:f9:1a:0b        50                        1500  phys-state
    vnet1            secondary-vsw50@secondary   1    network@1  00:14:4f:fa:92:25        50                        1500  phys-state

Second guest domain on different host= sleepy
admin@lannister:~$ ldm list -o network
    NAME             MAC               NET-DEV   ID   DEVICE     LINKPROP   DEFAULT-VLAN-ID PVID VID                  MTU   MODE   INTER-VNET-LINK
    primary-vsw50    00:14:4f:fa:c3:20 aggr0     0    switch@0              1               1    50                   1500         off
    NAME             MAC               NET-DEV   ID   DEVICE     LINKPROP   DEFAULT-VLAN-ID PVID VID                  MTU   MODE   INTER-VNET-LINK
    secondary-vsw50  00:14:4f:f9:a8:69 aggr0     0    switch@0              1               1    50                   1500         off
    NAME             SERVICE                     ID   DEVICE     MAC               MODE   PVID VID                  MTU   LINKPROP
    vnet0            primary-vsw50@primary       0    network@0  00:14:4f:fa:92:25        50                        1500  phys-state
    vnet1            secondary-vsw50@secondary   1    network@1  00:14:4f:f9:1a:0b        50                        1500  phys-state

admin@lannister:~$ ldm -V
Logical Domains Manager (v
        Hypervisor control protocol v 1.11
        Using Hypervisor MD v 1.4
System PROM:
        Hostconfig      v. 1.4.0        @(#)Hostconfig 1.4.0 2014/04/04 17:51
        Hypervisor      v. 1.13.0.a     @(#)Hypervisor 1.13.0.a 2014/04/08 14:05
        OpenBoot        v. 4.36.0       @(#)OpenBoot 4.36.0 2014/04/04 15:50

Other useful information that may help.

admin@lannister:~$ dladm show-aggr
aggr0             trunk L2       auto                 active       short
admin@lannister:~$ dladm show-vlan
LINK                VID      OVER                FLAGS
aggr5000            50       aggr0               -----

admin@lannister:~$ dladm
LINK                CLASS     MTU    STATE    OVER
net0                phys      1500   up       --
net1                phys      1500   up       --
net2                phys      1500   up       --
aggr5000            vlan      1500   up       aggr0
aggr0               aggr      1500   up       net0 net1

admin@lannister:~$ dladm show-phys
LINK              MEDIA                STATE      SPEED  DUPLEX    DEVICE
net0              Ethernet             up         10000  full      ixgbe0
net1              Ethernet             up         10000  full      ixgbe1
net2              Ethernet             up         10000  full      vsw0

Many thanks

---------- Post updated at 07:01 PM ---------- Previous update was at 01:25 PM ----------

This has now been solved.

It was due to duplicate ldom mac address (vnet mac addresses). Needed to manually change those using ldm set-vnet mac-addr=

Last edited by Don Cragun; 03-01-2015 at 10:00 PM.. Reason: Remove duplicated update.
# 2  
Old 03-02-2015
That is strange, you should have no need to setup mac addresses 'by hand'.
Have you setuped some of your macs by hand and other automatically ?

Few more hints to avoid problems in future.
If you have multiple physical hosts (hypervisors) and one or more ldoms can be migrated / imported to other, be sure to export the configuration of everything daily into a file
ldm list-services -l ldom# this will provide additional information, especially HOSTID.
ldm -x list-constraints ldom # for import of ldom on another physical machine.

hostid is important here cause a change can happen if you don't migrate the machine (ldm migrate) to a new host, but import it from configuration file, can cause for zpools not to import during boot (rpool should import, but every other zpool will require manual work.)

Hope that helps

# 3  
Old 03-02-2015
Hi peasant

All mac addresses have been setup automatically up to now. I know there it is supposed to do some form of subnet scan for used MAC address but clearly this is not doing that. We have 4 T5-2 servers.

Many thanks for the extra tips!
# 4  
Old 03-02-2015
Be sure to check that all 4 hypervisor are in the same subnet for their network (primary domain network not ldoms).

Per documentation, each domain manager sends a multicast with MAC he wants to give to new ldom, if it is busy on other domain manager will respond and it will iterate to the next.

Collision can occur if one or more logical domain managers (physical hosts)are down, and you are creating ldom on a working domain manager.
In theory, since 2 hosts are down and are not aware of new ldom being created on another host, but i have never experienced this in practice.
# 5  
Old 03-02-2015
All four T5-2 servers are on the same Subnet. One thing to mention is that all four have two IO/Service domains. Again the alternate IO domain is also on the same subnet.

Can you please elaborate a little on what you mentioned regarding taking XML backups of each LDOM every night please?

Is there anyway to check if the multicast is happening or not, as it clearly is not I think?

Many thanks
# 6  
Old 03-03-2015
Regarding backups, you just need to run the commands i gave you with standard unix redirection > to a file.

Those are plain XML files with your configuration, put it somewhere you can access it @ all times (like small FC zpool, or a tape backup)

Think about it, if you put gzip compression or even better deduplication on zfs fileset sized 1 GB, you can probably save configurations there for the next 10 years daily without deleting anything Smilie

You should be able to tcpdump for multicast traffic on your network, there are examples online.
Unfortunately, since i'm on leave, i cannot offer practical assistance with the dump for the next seven days.

There is also some code provided by Oracle to do the same, probably this is the way how ldmd communicate to each other:
Discovering Systems Running the Logical Domains Manager - Oracle VM Server for SPARC 3.0 Administration Guide

Hope that helps
This User Gave Thanks to Peasant For This Post:
# 7  
Old 03-13-2015
Peasant, many thanks for the comment. Its a huge help.

I am somwhat struggling to identify how to fix this issue I have with conflicting IP addresses. I have read the link you posted but am struggling how to apply it.

I created a new LDOM today and yet again it had a conflicting mac address with a LDOM on a different host, but on the same subnet ip range.

Previous Thread | Next Thread
Test Your Knowledge in Computers #973
Difficulty: Easy
GCC is the default compiler for the Linux kernel source.
True or False?

10 More Discussions You Might Find Interesting

1. IP Networking

Loop in /24 Subnet, No ping beyond .1 and .2

Running 3650 switch. I have this odd issue where I cannot get 4 new Centos 7 boxes pinging out on public IPs (nor pinging in), only gateway .1 and first public IP .2 This is what I see, which doesn't look normal. How do I fix this? The server itself is configured fine (Centos 7) # cat... (0 Replies)
Discussion started by: Bashed
0 Replies

2. Linux

Unable to ping Linux guest from win7 host

Hi, I am using win7 on my PC and installed VMware on it on which i am running linux I am unable to ping my linux guest from my win machine, but i can ping my windows host from linux guest : Below is my system configuration Linux root@localhost ~]# ifconfig eth0 Link... (9 Replies)
Discussion started by: chander_1987
9 Replies

3. Solaris

Help needed - trying to run commands in Guest LDoms from Control LDOM

Hi Folks, I am used to writing scripts to get info by running commands at local zones level from their respective global zone by using zlogin <localzone> "command>" while remaining at the global zone level. Can the same be done with Guest LDoms while remaining at the control LDOM level? ... (4 Replies)
Discussion started by: momin
4 Replies

4. Linux

Ping check failed from Nagios master server on windows hosts in the same subnet

Hello All, We have added a windows host and its config files to Nagios master server and wanted to do a ping check alone at the moment however, the nagios master server identifies the host in its GUI and immediately disappears can anyone let me know the right approach to this one, We want to... (2 Replies)
Discussion started by: lovesaikrishna
2 Replies

5. Solaris

Migrating Solaris 8, 9 to Guest Domains (LDOMs)

Hi Everyone, one question is it possible to migrate a physical standalone Solaris 8 or 9 OS to Guest Domain (LDOMs). If yes, can someone please provide steps to migrate these OS to LDOMs. Thanks, Kartheek. (1 Reply)
Discussion started by: bobby320
1 Replies

6. Programming

putting numbers behind eachother

I want to make a program where you have to insert binary numbers like this: do { iBinary = getche(); }while(iBinary == 1 || iBinary == 0); after you get the numbers I want them to be placed behind eachother so you will get: input: 1 1 0 1 output: 1101 (7 Replies)
Discussion started by: metal005
7 Replies

7. Shell Programming and Scripting

Bash script for ping in your own subnet

I have a question for one who wants to help me. I want to create a bash script to ping IP-adresses. It must first ask me the beginnen IP, then the ending IP like: - When nothing is filled in, then it must find my subnet and ping that, like when my ip is... (14 Replies)
Discussion started by: ugurgazi
14 Replies

8. Solaris

LDoms can't ping each other

I've got Sun Fire T2000 with two LDoms - primary and ldom1, both being Solaris 10 u8. Both can be accessed over the network (ssh, ping), both can access the network, but they can't ping or ssh to each other. I only use e1000g0 interface on T2000, the primary ldom has an address on it, ldm has a... (1 Reply)
Discussion started by: mludvig
1 Replies

9. IP Networking

Migrating existing Subnet to a new subnet and changing ip addresses in UNIX

Hi, My project needs to migrate the existing Subnet ( to a new subnet and change the ipaddresses (currently C class). How can I do that. I need some information. John (0 Replies)
Discussion started by: johnmarsh
0 Replies

10. UNIX for Dummies Questions & Answers

Unix TCP/IP ping to other subnet

I have Digital UNIX V4.0B (Rev. 564) on alpha machine. I'm trying to acces network in subnet (192.168.1.x). Ip on Alpha comp. is from 192.168.3.X subnet. My default gateway on this network is and it working OK from other machines. This machine is visible from same subnet... (2 Replies)
Discussion started by: ermingut
2 Replies

Featured Tech Videos