oVirt 4.2.x Install HE (Hosted Engine) (4 Hosts) (2 SAN-HA)

This outlines the Setup for HOST B, C, D of the oVirt 4.2.x Install HE (Hosted Engine) (4 Hosts) (2 SAN-HA)

You will want to make sure that HOST[B][C][D] all match the hardware of HOST A exactly. This includes all BIOS versions and BIOS settings.

Proceed through the following steps for each of the HOSTS you are adding to your oVirt cluster.

Note: Below I will list certain items with [B][C][D] or [1][2][3] etc. This means substitute in the setting for the relevant host you are building.

Config the BIOS to allow the SERVER MGMT (IPMILAN). Using IP 172.16.1.1[2][3][4]. You will need the user/pass below.

Download the latest CentOS7 DVD ISO and burn it to a DVD
Boot the HOST[B][C][D] server to the DVD and on the initial screen do the following (**IMPORTANT**)
1. click tab
2. you should then see the bootline string of the installer
3. add the following to the string after quiet (leaving a space after quiet)
4. biosdevname=0 net.ifnames=0
5. then hit enter and proceed with install
On installer screen, do the following:
1. DISABLE KDUMP
2. SET HOSTNAME: virttestnode[b][c][d].testdomain.com
3. SET TIMEZONE
4. SET LANGUAGE
5. SET PRIMARY NIC (eth0)
  1. SET TO AUTO START ON BOOT
  2. IP: 172.16.1.8[5][6][7]
  3. MASK: 255.255.255.0
  4. GATE: 172.16.1.49
6. DONE
7. SET ROOT PASSWORD

Once installed, click REBOOT

After reboot, do the following:

yum update -y
yum install http://resources.ovirt.org/pub/yum-repo/ovirt-release42.rpm -y

Now we will disable Network Manager as oVirt doesn’t like it, and neither do I 😉

systemctl stop NetworkManager
systemctl disable NetworkManager

Now we will switch to the network configs folder and set each NIC as follows.

cd /etc/sysconfig/network-scripts

vi ifcfg-eth0
#
TYPE=Ethernet
PROXY_METHOD=none
BROWSER_ONLY=no
BOOTPROTO=none
DEFROUTE=yes
IPV4_FAILURE_FATAL=no
IPV6INIT=yes
IPV6_AUTOCONF=yes
IPV6_DEFROUTE=yes
IPV6_FAILURE_FATAL=no
IPV6_ADDR_GEN_MODE=stable-privacy
NAME=eth0
DEVICE=eth0
ONBOOT=yes
ETHTOOL_OPTS="autoneg on"
IPADDR=172.16.1.8[5][6][7] <----- CHANGE THIS
PREFIX=24
GATEWAY=172.16.1.49
DNS1=8.8.8.8
DNS2=8.8.4.4
IPV6_PRIVACY=no
ZONE=public
NM_CONTROLLED=no
#

vi ifcfg-eth1
#
TYPE=Ethernet
PROXY_METHOD=none
BROWSER_ONLY=no
BOOTPROTO=dhcp
DEFROUTE=yes
IPV4_FAILURE_FATAL=no
IPV6INIT=yes
IPV6_AUTOCONF=yes
IPV6_DEFROUTE=yes
IPV6_FAILURE_FATAL=no
IPV6_ADDR_GEN_MODE=stable-privacy
NAME=eth1
DEVICE=eth1
ONBOOT=yes
ETHTOOL_OPTS="autoneg on"
IPV6_PRIVACY=no
ZONE=public
NM_CONTROLLED=no
#

vi ifcfg-eth2
#
DEVICE=eth2
TYPE=Ethernet
BOOTPROTO=none
DEFROUTE=no
ONBOOT=yes
MTU=9000
NM_CONTROLLED=no
#

vi ifcfg-eth2.3
#
VLAN=yes
PROXY_METHOD=none
BROWSER_ONLY=no
BOOTPROTO=none
DEFROUTE=no
IPV4_FAILURE_FATAL=no
IPV6INIT=no
DEVICE=eth2.3
ONBOOT=yes
ETHTOOL_OPTS="autoneg on"
IPADDR=10.10.10.1[2][3][4] <----- CHANGE THIS
PREFIX=24
MTU=9000
NM_CONTROLLED=no
#

vi ifcfg-eth3
#
DEVICE=eth3
TYPE=Ethernet
BOOTPROTO=none
DEFROUTE=no
ONBOOT=yes
MTU=9000
NM_CONTROLLED=no
#

vi ifcfg-eth3.2
#
VLAN=yes
PROXY_METHOD=none
BROWSER_ONLY=no
BOOTPROTO=none
DEFROUTE=no
IPV4_FAILURE_FATAL=no
IPV6INIT=no
DEVICE=eth3.2
ONBOOT=yes
ETHTOOL_OPTS="autoneg on"
IPADDR=10.10.9.1[2][3][4] <----- CHANGE THIS
PREFIX=24
MTU=9000
NM_CONTROLLED=no
#

ifup eth2
ifup eth3
ifup eth2.3
ifup eth3.2

You should now be able to ping using MTU 9000 to your SAN

ping -M do -s 8972 10.10.9.3
ping -M do -s 8972 10.10.10.3

If the above pings work, all is good, if not, double check your settings and your CAT6 connections.

DO NOT PROCEED UNTIL 9000 MTU PING TEST WORKS

Make sure that the DNS is as needed. I adjusted as follows:

vi /etc/resolv.conf
#make sure only nameservers are
nameserver 8.8.8.8
nameserver 8.8.4.4

vi /etc/hosts
#append the following
172.16.1.83   ovirttestmgmt.<yourdomain>.com
172.16.1.84   virttestnodea.<yourdomain>.com
172.16.1.85   virttestnodeb.<yourdomain>.com
172.16.1.86   virttestnodec.<yourdomain>.com
172.16.1.87   virttestnodec.<yourdomain>.com

hostname -I

the above command should return something like:
172.16.1.8[5][6][7] 10.10.10.1[2][3][4] 10.10.9.1[2][3][4]

hostname

confirm above command returns virttestnode[b][c][d].<yourdomain>.com

systemctl reboot

After the new HOST reboots, login to the oVIRT ENGINE WebUI

Compute – Hosts
1. New
  1. Name: virttestnode[b][c][d].<yourdomain>.com
  2. Hostname: virttestnode[b][c][d].<yourdomain>.com
  3. Power Management Tab
    1. Enable
    2. Remove KDUMP Integration
    3. Click + Add Fencing Agent
      1. Address: 172.16.1.1[2][3][4]
      2. Username: admin
      3. Password: pass
      4. Type: IPMILAN
      5. Click TEST
      6. Click OK if TEST passed. If not, diagnose issue.
  4. Hosted Engine (tab)
    1. Set to: DEPLOY !IMPORTANT!
  5. Click OK to save

It will take some time for the new host to be configured and come online. Once it is online and activated, do the following in the WebUI:

Compute – Hosts
1. Click the new HOST[B][C][D]
2. Network Interface (tab)
3. Setup Network Interfaces (button)
  1. drag VMNIC1 to eth1
  2. OK

SSH into the new HOST[B][C][D] as root and do the following:

vi /etc/multipath.conf
#add the following comment to line 2
# VDSM PRIVATE

#add the following to the bottom of array at the bottom of the file
device {
                vendor                  "SYNOLOGY"
                product                 ".*"
                path_grouping_policy    multibus
                failback                immediate
                path_selector           "round-robin 0"
                rr_min_io               100
        }
#

saslpasswd2 -a libvirt yourfavoriteusername

Back - Configure New Hosted Engine

Next - Configure – Re-Install HOST A

Repeat all of the steps above for EACH host that you are adding to your Cluster.

Once done, you should have HOSTA, HOSTB, HOSTC, HOSTD.

oVirt 4.2.x Install HE (Hosted Engine) (4 Hosts) (2 SAN-HA) – Setup HOST B, C, D