Configuring the (InfiniBand) IP-LAN Secure Fabric Connection for Red Hat Linux

The default IP over InfiniBand (IPoIB) interfaces—typically ib0 and ib1—are used to interface with the IP-LAN secure fabric. If you wish to associate your operating system with a secure fabric other than the IP-LAN secure fabric, create virtual IPoIB interfaces, bond the virtual IPoIB interfaces for resilient operation, and assign a appropriate secure fabric IP address.

For more information on creating and bonding virtual IPoIB interfaces in a Red Hat Linux operating environment, and associating the virtual IPoIB interfaces with a secure fabric, refer to .

Note: The use of bonded virtual IPoIB interfaces together with bonding of the default IPoIB interfaces in a Red Hat Linux operating environment is restricted in the current release. If the default IPoIB interfaces are bonded, be sure to reconfigure the default IPoIB interfaces to remove the bond before bonding the virtual IPoIB interfaces.

Depending on whether you will be associating your operating system with the IP-LAN secure fabric or another secure fabric, perform one of the following procedures.

Assigning IP Addresses for the Default InfiniBand Ports and Bonding the Ports

To bond the default IP over InfiniBand (IPoIB) interfaces and configure the IP-LAN secure fabric connection, log in as root, and do the following:

  1. Create a file named ifcfg-ib0 in the /etc/sysconfig/network-scripts directory with the following content:

    TYPE=InfiniBand
    BOOTPROTO=none
    MASTER=bond0
    SLAVE=yes
    NAME=ib0
    DEVICE=ib0
    ONBOOT=yes
    
  2. Create a file named ifcfg-ib1 in the /etc/sysconfig/network-scripts directory with the following content:

    TYPE=InfiniBand
    BOOTPROTO=none
    MASTER=bond0
    SLAVE=yes
    NAME=ib1
    DEVICE=ib1
    ONBOOT=yes
    
  3. Create a file named ifcfg-bond0 in the /etc/sysconfig/network-scripts directory with the following content:

    DEVICE=bond0
    NAME=bond0
    TYPE=Bond
    BONDING MASTER=yes
    BONDING_OPTS="mode=active-backup fail_over_mac=0"
    BOOTPROTO=none
    IPADDR=172.31.xx.1
    PREFIX=16
    NETWORK=172.31.0.0
    BROADCAST=172.31.255.255
    ONBOOT=yes
    

    Where xx is the platform number for your enterprise partition platform.

    Note: The default subnet address of the IP-LAN secure fabric is 172.31.0.0/16. If the subnet was changed (for example, during initial hardware installation and software configuration), be sure to use the new subnet address value when configuring your network connections. If needed, use Fabric Manager to check the IP-LAN secure fabric IP address for the partition on the partition summary page of the nonpartitionable enterprise partition platform (NEPP).

  4. Execute the following commands to restart all InfiniBand interfaces and apply your changes:

    systemctl restart network
    nmcli con reload

Assigning IP Addresses for the Default InfiniBand Ports Without Bonding the Ports

If you wish to associate your operating system with a secure fabric other than the IP-LAN secure fabric, log in as root, and do the following to configure the default IP over InfiniBand (IPoIB) interfaces:

  1. Create a file named ifcfg-ib0 in the /etc/sysconfig/network-scripts directory with the following content:

    TYPE=InfiniBand
    BOOTPROTO=none
    IPADDR=172.31.xx.1
    NETMASK=255.255.0.0
    BROADCAST=172.31.255.255
    NAME=ib0
    DEVICE=ib0
    ONBOOT=yes
    

    Where xx is the platform number for your enterprise partition platform.

    Note: The default subnet address of the IP-LAN secure fabric is 172.31.0.0/16. If the subnet was changed (for example, during initial hardware installation and software configuration), be sure to use the new subnet address value when configuring your network connections. If needed, use Fabric Manager to check the IP-LAN secure fabric IP address for the partition on the partition summary page of the nonpartitionable enterprise partition platform (NEPP).

  2. Create a file named ifcfg-ib1 in the /etc/sysconfig/network-scripts directory with the following content:

    TYPE=InfiniBand
    BOOTPROTO=none
    IPADDR=172.31.xx.2
    NETMASK=255.255.0.0
    BROADCAST=172.31.255.255
    NAME=ib1
    DEVICE=ib1
    ONBOOT=yes
    

    Where xx is the platform number for your enterprise partition platform.

  3. Execute the following commands to restart all InfiniBand interfaces and apply your changes:

    systemctl restart network
    nmcli con reload

Proceed to configure the FM LAN connection for Red Hat Linux. For more information, see Configuring the FM LAN Connection for Red Hat Linux.