I ran OPNSense on a Proxmox VM for a few months and felt nervous about it the whole time. If you’re running a cluster, unless you can do routing without OPNSense, then you can’t get a quorum with the other nodes so restarting that node can require manually force starting the OPNSense VM. Same with a cold startup after a power outage or such.
Not sure on traffic numbers but I can easily do 3-4TB of data per month externally plus whatever chatter the IoT devices are sending back to China across the network. The cameras record to the NVR and only the substreams are running to Frigate for object detection.
As far as “full speed” goes, my torrents and media files are in a shared ZFS pool and the HDDs that comprise the pool seem to be the limiting factor in transfer speeds. Currently the 2.5Gb port on the server is connected to a 1Gb port on the router anyway as these two cards and the 4-port switch are the only 2.5Gb devices on the network. My ISP speed is only “up to” 1.2Gbps down as well.
I get that a dedicated router is going to be more robust but the market isn’t the best for people in our situation as there’s “cheap consumer grade” and “super expensive prosumer grade” with nothing much in between. As I said this option seems worth exploring since I already have (most?) everything I need but I dont want to go through all the effort if it isn’t going to work in the end or solve one issue only to introduce two new issues. Going with Omada or Ubiquiti means not only a new router but a switch, controller, and AP at the very least.
Opnsense VM proxmox is how I’ve been set up for years now. Whatever you choose now will be a piece of cake to migrate later, either as VM backup/restore or opnsense’s, so don’t fret too much.
I’d use the tiny PC if the 1 Gbps cards are good enough. “Up to 1.2Gbps” that’s pretty close. Reason for tiny PC is to keep internet in separate hardware than the rest. For me, limiting when I could do anything hardware related on the homeserver to when internet outages are OK was too much. I use a mini PC n100 for opnsense and pihole (so the core network stuff, routing firewall dhcp dns).
Whichever hardware you’re on, I would have the wan nic on it’s own bridge in proxmox, cable straight to ISP. Opnsense VM gets a vnic on that bridge for wan. Then lan one is just like your other VMs on the lan/inside bridge. Same setup whichever box you end up on. And backup/restore the VM if you want to migrate or test and compare speeds on both. or explore HA and have both involved.
To parent’s point about skipping the hypervisor: that works great too. Opnsense install on a new drive and restoring cfg backup is super quick, which would be one of the big benefits of using a VM. You can do a lot of add-on stuff in opnsense like adblocking, so possibly eliminate need for running those as side VMs on a “network box” like mine.
If you’ve got the time and desire, test them all out. Once you get migrated to opnsense itll be easy to swap around
Comments
Depends. How much traffic are you actually pushing at any given time? Don’t you want to be able to get full speed when you’re doing a transfer?
Personally I don’t recommend running a virtual router. If something on the hypervisor breaks, your Internet access goes down too.
I ran OPNSense on a Proxmox VM for a few months and felt nervous about it the whole time. If you’re running a cluster, unless you can do routing without OPNSense, then you can’t get a quorum with the other nodes so restarting that node can require manually force starting the OPNSense VM. Same with a cold startup after a power outage or such.
Not sure on traffic numbers but I can easily do 3-4TB of data per month externally plus whatever chatter the IoT devices are sending
back to Chinaacross the network. The cameras record to the NVR and only the substreams are running to Frigate for object detection.As far as “full speed” goes, my torrents and media files are in a shared ZFS pool and the HDDs that comprise the pool seem to be the limiting factor in transfer speeds. Currently the 2.5Gb port on the server is connected to a 1Gb port on the router anyway as these two cards and the 4-port switch are the only 2.5Gb devices on the network. My ISP speed is only “up to” 1.2Gbps down as well.
I get that a dedicated router is going to be more robust but the market isn’t the best for people in our situation as there’s “cheap consumer grade” and “super expensive prosumer grade” with nothing much in between. As I said this option seems worth exploring since I already have (most?) everything I need but I dont want to go through all the effort if it isn’t going to work in the end or solve one issue only to introduce two new issues. Going with Omada or Ubiquiti means not only a new router but a switch, controller, and AP at the very least.
Opnsense VM proxmox is how I’ve been set up for years now. Whatever you choose now will be a piece of cake to migrate later, either as VM backup/restore or opnsense’s, so don’t fret too much.
I’d use the tiny PC if the 1 Gbps cards are good enough. “Up to 1.2Gbps” that’s pretty close. Reason for tiny PC is to keep internet in separate hardware than the rest. For me, limiting when I could do anything hardware related on the homeserver to when internet outages are OK was too much. I use a mini PC n100 for opnsense and pihole (so the core network stuff, routing firewall dhcp dns).
Whichever hardware you’re on, I would have the wan nic on it’s own bridge in proxmox, cable straight to ISP. Opnsense VM gets a vnic on that bridge for wan. Then lan one is just like your other VMs on the lan/inside bridge. Same setup whichever box you end up on. And backup/restore the VM if you want to migrate or test and compare speeds on both. or explore HA and have both involved.
To parent’s point about skipping the hypervisor: that works great too. Opnsense install on a new drive and restoring cfg backup is super quick, which would be one of the big benefits of using a VM. You can do a lot of add-on stuff in opnsense like adblocking, so possibly eliminate need for running those as side VMs on a “network box” like mine.
If you’ve got the time and desire, test them all out. Once you get migrated to opnsense itll be easy to swap around
Sign in to comment. Sign in