Things I had to fix in Proxmox after misconfiguring networking during the install

Proxmox asks for some IPs during install, which I totally misconfigured by bravely trying to get the server quickly working on wifi before bringing it downstairs to the server table.

What the installer wants is the static IP you’ll give the Proxmox host, and the gateway of the network.

It was DNS

The biggest issue, that I didn’t discover until later, was that it writes that IP into /etc/hosts to be able to resolve itself… a lot breaks when the server can’t resolve itself. The main symptom I had here was being able to ssh to the server but not being able to access the web interface.

Setting networking up

After some trial and error I arrived at this /etc/network/interfaces file, which bridges the vms to ethernet while also setting the static ip for that ethernet interface.

auto lo
iface lo inet loopback

iface enp1s0 inet manual

auto vmbr0
iface vmbr0 inet static
        address 192.168.10.82
        netmask 255.255.255.0
        gateway 192.168.10.1
        bridge_ports enp1s0
        bridge_stp off
        bridge_fd 0

When this was wrong the server would either not get an IP or get an IP but not get any connectivity.

Corosync also gets the original static IP written in

Another mistake I made was pressing “create cluster” when I had briefly coerced the interfaces file into giving me web GUI access to Proxmox (this broke on a restart). In /etc/corosync/corosync.conf it had the old wonky IP of the server as the IP of the cluster master! Then, whenever it tried to start VMs / Containers by contacting the cluster it was forever “waiting for quorum”.

Changing this to the actual IP of the server resolved things.

  • It may have also been DNS, but it seems this quorum issue broke my ability to even add CIFS shares to the storage pool

Update: I finally found a relevant post on the forums when the issue of Error 500 No Quorum came up again after a reboot. Corosync.conf gets replaced with the contents of the file in the sqlite3 config database on restart, so the bad config set at installation will persist! It seems like the database record could simply be fixed, but the instructions above are to wipe the VM and corosync config. This did work for me, although it seems to blow away all existing disks too.

Proxmox Is Really Cool

Sorting all that out was completely worth it. Proxmox has so far exceeded my expectations in how close it gets to the spine-tingingly expensive vmware that I have seen in many environments.

  • The console view just works out of the box, and was not too slow on VNC
  • The bridging setup means VMs get their own IPs on your network, which works really well for homelabs and quickly bringing up a VM to try a new thing: it’s just as if it was a seperate physical server
  • The storage pools, clustering, etc is well exposed in the menus
  • Lots of good summary data to see how VM hosts and guests are doing
Written on June 19, 2018