We have two Dell R720s running Proxmox in a cluster. A third node, a Dell R320, provides quorum and can also run a few VMs if needed.
Shared storage happens via Ceph integration to Proxmox.
As of 2019, each node has two separate 2x10Gb bonded links, one for Ceph and one for VMs and services.
The onboard iDRAC 7 Enterprise is connected to the rack switch via the dedicated iDRAC port. This allows OOB management and recovery if the pfSense VM dies.
pve1 | pve2 | quorum | |
---|---|---|---|
mgmt IP | 10.101.21.41 | 10.101.21.42 | 10.101.21.40 |
Storage IP | 192.168.254.1 | 192.168.254.2 | 192.168.254.3 |
Proxmox | https://10.101.21.41:8006 | https://10.101.21.42:8006 | https://10.101.21.40:8006 |
iDRAC | https://192.168.100.111 | https://192.168.100.112 | https://192.168.100.113 |
OMSA | https://10.101.21.41:1311 | https://10.101.21.42:1311 | https://10.101.21.40:1311 |
Hardware | Dell R720 | Dell R320 | |
CPU | 2x Intel(R) Xeon(R) CPU E5-2660 @ 2.20GHz | ||
8 cores, 16 threads per CPU | Intel(R) Xeon(R) CPU E5-2430 @ 2.20GHz | ||
6 cores, 12 threads | |||
RAM | 96GB DDR3 ECC | 48GB DDR3 ECC | |
Storage | Dell PERC H710 Mini, 8 2.5" drive bays | ||
OS: 2x 146GB 10k SAS drives in RAID 1 | |||
Data: 1x 512GB Samsung 850 Pro SSD | Onboard SATA | ||
OS: 2x 240GB Samsung 850 Evo SSD | |||
Data 2x 1TB Crucial MX300 SSD | |||
Power | 2x 1100W redundant power supplies | 2x 350W redundant power supplies | |
Management | Dell iDRAC 7 Enterprise |
Name | IP |
---|---|
Synology | 10.101.21.156 |
ID | Hostname | IP | Description |
---|---|---|---|
100 | salt.magevent.net | 10.101.22.8 | |
101 | repo.magevent.net | 10.101.22.155 | |
103 | template-centos | 10.101.22.254 | Container template |
106 | freeipa.magfe.st | DHCP | |
107 | dhcp1.magevent.net | 10.101.22.4 | |
108 | tftp.magevent.net | 10.101.22.9 | |
112 | ntp1.magevent.net | 10.101.22.6 | |
113 | dns1.magevent.net | 10.101.22.110 | |
117 | freeradius.magevent.net | 10.101.22.10 | |
120 | freeipa.magevent.net | DHCP | |
153 | challenges.magevent.net | 10.101.22.53 | MAGFest Challenges Server |
200 | zabbix.magevent.net | 10.101.22.200 | Zabbix appliance |