Virtual Ethernet VIO HMC LPARs


 
Thread Tools Search this Thread
Operating Systems AIX Virtual Ethernet VIO HMC LPARs
# 1  
Old 05-31-2009
Virtual Ethernet VIO HMC LPARs

Hi,

I am little confused about the virtual Ethernet configuration on VIO and Client Partitions. There is alot of info on the internet but it gets more confusing....

If I have LHEA, it is very simple. Just assign LHEA (logical host ethernet adapter) to client partition -> run smitty tcpip and do the configuration.

However, if I don't have LHEAs then I have to use SEA (shared ethernet adapter)

My VIO Server has ethernet adapter.

I would like to share this ethernet port on VIO Server for all my client partition traffic going outside ?

How would i create the shared ethernet ?

1) Do I have to create virtual ethernet card both in VIO & Client Partition

2) Map the physical port on VIO with the virtual port ?

3) then smitty tcpip on client partition ?

– Shared Ethernet Adapter (SEA) – A physical adapter or EtherChannel in
a VIO Server can be shared by client partitions. Clients use virtual
Ethernet adapters
 Virtual Ethernet – a LPAR-to-LPAR Virtual LAN within a POWER5 Server
– Does not require the APV feature code

I believe there are 3 ways to create Virtual Ethernet on Client Partition

1. LHEA -- the simplest method. Just assign the LHEA from HMC to the client partition, run cfgmgr and you will see en0

2. Create Virtual Adapter in HMC on the client partition
1. In the navigation pane, open Systems Management > Servers, and click the system on which the logical partition is located.
2. In the work pane, select the logical partition on which you want to configure the virtual Ethernet adapter, click the Tasks button, and click Dynamic Logical Partitioning > Virtual Adapters.
3. Click Actions and choose Create > Ethernet Adapter.
4. Enter the slot number for the virtual Ethernet adapter into Adapter ID. {filosophizer: Which slot number is this?}
5. Enter the Port Virtual LAN ID (PVID) for the virtual Ethernet adapter into VLAN ID. The PVID allows the virtual Ethernet adapter to communicate with other virtual Ethernet adapters that have the same PVID.
6. Select IEEE 802.1 compatible adapter if you want to configure the virtual Ethernet adapter to communicate over multiple virtual LANs. If you leave this option unchecked and you want this logical partition to connect to multiple virtual networks, you must create multiple virtual adapters by creating additional virtual LAN IDs.


3. SEA (shared Ethernet Adapter)
1. Create Virtual Adapter for VIO Server
2. Run Cfgmgr
3. mkvdev -sea target_device -vadapter virtual_ethernet_adapters \
-default DefaultVirtualEthernetAdapter -defaultid SEADefaultPVID
{filosophizer: what steps do I have to take for SEA on the client side ?}

thanks

P.S: The attachment has many methods to create virtual ethernet , but it is really confusing..

VIO WIKI: http://www.ibm.com/developerworks/wi...ualization/VIO

Last edited by filosophizer; 05-31-2009 at 04:40 PM..
# 2  
Old 06-01-2009
This can be a tough concept to grasp - I'll list the steps I do.

1. Edit VIO profile from the HMC like you list in #2.
- I noticed that the steps you listed in #2 go into the 'Dynamic Logical Partitioning' but be careful because if you don't make changes to the profile also then when you reboot the lpar (VIO or client) all changes will be lost.
- Make sure you put a checkmark in 'Access external network Trunk priority'. Also , make note of which adapter ID you give it (it doesn't matter what the number is, this will be used later when you do the mkvdev command). I used 23 because we have a .23.xxx network segment and a .41.xxx segment (you can guess what I used for the other virtual ethernet adapter id).

2. Edit the lpar client's profile from the HMC and do all of the steps you listed under #2
- BUT do NOT put a checkmark in 'Access external network'
- Use the same Adapter ID you made note of in my Step 1. I also use the same ID for the VLAN ID.

3. Create the SEA on VIO1 - (on our system the 23 segment cable is plugged into ent1)
Example from my VIO1:
# lsdev -Cc adapter |grep ent

ent0 Available 02-08 10/100/1000 Base-TX PCI-X Adapter (14106902)
ent1 Available 0A-00 10/100/1000 Base-TX PCI-Express Adapter (14104003)
ent2 Available 0A-01 10/100/1000 Base-TX PCI-Express Adapter (14104003)
ent3 Available 08-08 2-Port 10/100/1000 Base-TX PCI-X Adapter (14108902)
ent4 Available 08-09 2-Port 10/100/1000 Base-TX PCI-X Adapter (14108902)
ent5 Available Virtual I/O Ethernet Adapter (l-lan)
ent6 Available Virtual I/O Ethernet Adapter (l-lan)

## Find 23 segment (C23) virtual adapter (Ex. ent5)
# lscfg | grep ent | grep Virtual
* ent5 U9117.MMA.10FF11F-V3-C23-T1 Virtual I/O Ethernet Adapter (l-lan)
* ent6 U9117.MMA.10FF11F-V3-C41-T1 Virtual I/O Ethernet Adapter (l-lan)

## So we will create the SEA using ent1 as the physical adapter and ent5 as the virtual adapter
$ mkvdev -sea ent1 -vadapter ent5 -default ent5 -defaultid 23

4. Boot the client lpar or run cfgmgr if it's already up and running - then configure the adapter as usual with 'smitty tcpip'

Hope this helps.
Homeyjoe
# 3  
Old 06-02-2009
homeyjoe, thanks for the info. It was helpful.


However, I have few comments:

1) On the VIO SERVER
I did mark YES Access external network & Trunk priority = 2

2) On the VIO SERVER
I did mark YES IEEE.Q Protocol
{ When I marked YES on this one, I couldn't ping from my laptop which is connected to the switch to the VIO SERVER which is also connected to the switch and when I un-marked it, I was able to ping from my laptop to the VIO server... But when it was marked YES, between the AIX servers (LPARS) I was able to ping the VIO Server.....I don't understand this one ? Can anyone explain }

3) To each AIX LPARs.. you mentioned I should not check YES Access external network & Trunk priority = ?
{could you please explain this... will I be able to access outside/external network}

4) As an experiment, I did check YES Access external network & Trunk priority = ? on each LPARs...
But when I give it the same Trunk Priority as VIO SERVER, my LPAR couldn't detect the Virtual Ethernet Adapter. As soon as the Trunk Priority number is different.. I can see the virtual adapter using cfgmgr.
{ -Do I need to check Access outside network for each LPAR ? }
{ -Should I always give different Trunk Priority and what does it mean ?}


Thanks
# 4  
Old 06-02-2009
The trunk priority is not important on the LPAR but is on a dual VIO configuration. Also the access external network MUST NOT be selected on the LPAR as there is no external network to access as it is all logical!
# 5  
Old 06-03-2009
Quote:
The trunk priority is not important on the LPAR but is on a dual VIO configuration. Also the access external network MUST NOT be selected on the LPAR as there is no external network to access as it is all logical!
I have removed the Trunk priority and access to external network from the LPARs... and it is working fine.

I am facing another issue.

I would like to create another Virtual Ethernet Adapter and give it a new IP - different segment and different subnet mask..

LPAR 1
My en0 ==> 172.16.101.10
G/W ==> 172.16.101.1
Subnet mask: 255.255.255.0
VLAN ID: 1
IEEE.8 = NO


For my en1 ==> 10.10.10.10
G/W -- No gateway since it is connected to the same switch as above (Cisco Switch) but this IP is going to be used between LPARs only for RAC ( Oracle Real Application Cluster )
VLAN ID: 1
IEEE.8 = NO
subnet mask: 255.255.255.252

LPAR 2

My en0 ==> 172.16.101.11
G/W ==> 172.16.101.1
Subnet mask: 255.255.255.0
VLAN ID: 1
IEEE.8 = NO


For my en1 ==> 10.10.10.11
G/W = No Gateway
VLAN ID: 1
IEEE.8 = NO
subnet mask: 255.255.255.252

MY VIO Server 1
physical Port ==> en1 ==> 172.16.101.2
G/W: 172.16.101.1
VLAN ID: 1
IEEE.8 = NO
Subnet mask: 255.255.255.0

Physical Port
virtual en3 ( mapped with en0 for external ) ==> 172.16.101.3
G/W: 172.16.101.1
VLAN ID: 1
IEEE.8 = NO
Subnet mask: 255.255.255.0

MY VIO Server 2
physical Port ==> en1 ==> 172.16.101.4
G/W: 172.16.101.1
Subnet mask: 255.255.255.0

Physical Port
virtual en3 (mapped with en0 for external) ==> 172.16.101.5
G/W: 172.16.101.1
Subnet mask: 255.255.255.0


But I cannot ping
from LPAR1 to LPAR2 on the IP 10.10.10.11

1) Do I need to add a different VLAN ID in each LPAR for 10.10.10.x SUB-NET ?

2) Do I need to add a different VLAN ID and create a virtual ethernet adapter in VIO_Server ?

3) Do I need to enable the IEEE8 ?

any help would be appreciated.
# 6  
Old 06-07-2009
Guys I need help, any thoughts & comments would be appreciated.

I have two VIOS


VIO_1
en0 = physical
mkvdev -sea ent0 -default ent2 -defaultid 101
en1 = physical / 172.16.101.10
ent0 = adapter with two ports
en3 = virtual / sea / 172.16.101.11



VIO_2
en0 = physical
mkvdev -sea ent0 -default ent2 -defaultid 101
en1 = physical / 172.16.101.12
ent0 = adapter with two ports
en3 = virtual / sea / 172.16.101.13



Lpar_1
en0 = 172.16.101.20
en1 = 10.10.10.20

Lpar_2
en0 = 172.16.101.21
en1 = 10.10.10.20

Lpar_3 ( HACMP )
en0 = 172.16.101.21
en1 = 10.10.10.20
en2 = 172.16.102.21 {boot IP}
en3 = 172.16.103.21 {Admin IP}


in HMC
- what is the VLAN ID, I should give to VIO_1 ?
{ should it be same as VLAN_ID i give it to LPAR_1 ? }

- VLAN ID for each LPARs for the subnet 10.x.x.x ?

- How can the subnet 10.x.x.x & 172.16.102.21 reach external network ?

any help would be appreciated.
# 7  
Old 06-13-2009
Quick Questions:

1) I have two virtual ethernet adapters on my VIO_Server.. Can I create more than one SEA for One Physical Ethernet Adapter

for ENT0
mkvdev -sea ent0 -vadapter ent2 -default ent2 -defaultid 1
en4

then again with a different VLAN ID
mkvdev -sea ent0 -vadapter ent3 -default ent3 -defaultid 2
en5

2) Can I create etherchannel for my physical ports on VIO Server
ENT0 + ENT1 = ENT2
and create SEA for this ENT2 ?

thanks
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. AIX

Need to replace a broken PV in a VIO VG used for client LPARs (and it won't release the old one)

I have a broken PV in a VIO VG that's used to support client LPARs using LVs. On the client LPAR, I reduced all PVs from the relevant client VG and thus deleted it. I.e. there is no client LPAR using the VIO VG. Yet when I try to reducevg the VIO VG, it complains that the LV hosted on the PV is... (2 Replies)
Discussion started by: maraixadm
2 Replies

2. AIX

Connecting system to Virtual HMC

Hi, I just successfully build a Virtual Machine in virtual box with Perfectly running HMC v7. I have a IBM eServer pSeries Model 630 Model 6C4 (Power 4) i.e. 7024-6C4. I am not able to have it connect to the HMC console on the Virtual Box. Can anyone help me on how to connect it to the... (8 Replies)
Discussion started by: uzair_rock
8 Replies

3. AIX

vio server ethernet to vio client ethernet(concepts confusing)

Hi In the vio server when I do # lsattr -El hdisk*, I get a PVID. The same PVID is also seen when I put the lspv command on the vio client partition. This way Im able to confirm the lun using the PVID. Similarly how does the vio client partition gets the virtual ethernet scsi client adapter... (1 Reply)
Discussion started by: newtoaixos
1 Replies

4. AIX

Setting up an Integrated Virtual Ethernet adapter

All I am trying allocate an IVE to an LPAR (not a VIO) running AIX 7.1. I am getting the error: HSCL068A Explanation Logical port can not be assigned to Logical Partition because this Logical Partition is not the promiscuous LPAR for the physical port. Has anyone encountered this... (1 Reply)
Discussion started by: johnf
1 Replies

5. AIX

Inherited VIO server an LPARs

Lucky me, someone has installed a server and got it running with the best intentions, but leaving me a headache. :wall: We have a simple p520 with 4 disks. 2x145Gb & 2x300Gb. The smaller disk pair have been built into a VIO mirrored rootvg, and quite right too. The other two disks form a... (3 Replies)
Discussion started by: rbatte1
3 Replies

6. AIX

CDROM Issue on LPAR HMC VIO

Whenever I assign/unassign a CDROM ( RAID CTRL ) to Active LPAR from HMC, I have to reboot the LPAR. How can I do it without rebooting the LPARS. POWER6 with HMC LPARS = AIX 6.1 Any info developerWorks : AIX and UNIX : PowerVM Forum : Moving CD-ROM/DVD-ROM dynamically ... But... (5 Replies)
Discussion started by: filosophizer
5 Replies

7. AIX

Virtual Ethernet with VIO

We're using VIO (not an HMC) to manage our LPAR's We have 3 physical adapters and 4 LPARs. Through the VIO interface we assigned 2 virtual interfaces but require a 3rd interface assigned to these LPARs. I am experiencing issues understanding exactly how to create another virtual adapter, either... (1 Reply)
Discussion started by: scottsl
1 Replies

8. UNIX for Advanced & Expert Users

Virtual Ethernet

I understand that one should setup virtual ethernet adapters in the lpars which is the best way for various lpars to communicate with each other - Does anyone have info on this or can point me to a doc that explains how to set this up? (1 Reply)
Discussion started by: capeme
1 Replies

9. AIX

Help urgent : vio server - add extral disk on virtual lpar

Hi, I define 2 new LV on the vio server and run a cfgmgr on the partition and see my 2 new hdisk (hdisk6 and hdisk7). I extend my vg vg000 (on the partition) and add the 2 hdisks. I had a filesystem on the vg000 and when I added the disk I would like to increase the filesystem. But I cannot do a... (0 Replies)
Discussion started by: touny
0 Replies
Login or Register to Ask a Question