We have two Dell R720s running Proxmox in a cluster.  A third node, a Dell R320, provides quorum and can also run a few VMs if needed.

Shared storage happens via Ceph integration to Proxmox.

As of 2019, each node has two separate 2x10Gb bonded links, one for Ceph and one for VMs and services.

The onboard iDRAC 7 Enterprise is connected to the rack switch via the dedicated iDRAC port.  This allows OOB management and recovery if the pfSense VM dies.

pve1 pve2 quorum
mgmt IP 10.101.21.41 10.101.21.42 10.101.21.40
Storage IP 192.168.254.1 192.168.254.2 192.168.254.3
Proxmox https://10.101.21.41:8006 https://10.101.21.42:8006 https://10.101.21.40:8006
iDRAC https://192.168.100.111 https://192.168.100.112 https://192.168.100.113
OMSA https://10.101.21.41:1311 https://10.101.21.42:1311 https://10.101.21.40:1311
Hardware Dell R720 Dell R320
CPU 2x Intel(R) Xeon(R) CPU E5-2660 @ 2.20GHz
8 cores, 16 threads per CPU Intel(R) Xeon(R) CPU E5-2430 @ 2.20GHz
6 cores, 12 threads
RAM 96GB DDR3 ECC 48GB DDR3 ECC
Storage Dell PERC H710 Mini, 8 2.5" drive bays
OS: 2x 146GB 10k SAS drives in RAID 1
Data: 1x 512GB Samsung 850 Pro SSD Onboard SATA
OS: 2x 240GB Samsung 850 Evo SSD
Data 2x 1TB Crucial MX300 SSD
Power 2x 1100W redundant power supplies 2x 350W redundant power supplies
Management Dell iDRAC 7 Enterprise

Other hardware

Name IP
Synology 10.101.21.156

Containers and VMs

ID Hostname IP Description
100 salt.magevent.net 10.101.22.8
101 repo.magevent.net 10.101.22.155
103 template-centos 10.101.22.254 Container template
106 freeipa.magfe.st DHCP
107 dhcp1.magevent.net 10.101.22.4
108 tftp.magevent.net 10.101.22.9
112 ntp1.magevent.net 10.101.22.6
113 dns1.magevent.net 10.101.22.110
117 freeradius.magevent.net 10.101.22.10
120 freeipa.magevent.net DHCP
153 challenges.magevent.net 10.101.22.53 MAGFest Challenges Server
200 zabbix.magevent.net 10.101.22.200 Zabbix appliance