It’s not a huge deal with ipv4, quite frankly. The only role of a server needs to be as a dynamic DNS, and the router can open a VPN channel for whatever outside device needs it.
(This can be an automated process that’s simple to set up and secured with long public/private keys.)