Okay, I have painstakingly dropped a bunch of the IPs that are flooding the server at the network firewall. It seems to be just enough to keep the server running without packet loss for the most part. If it gets even more distributed there will be nothing more I can do as I'm limited in the number of firewall rules I can have before the packets reach the server.