Your system may be a monster, but network stack teardown and building is very much a single threaded process. I've worked with far more powerful systems than yours, and I can tell you that it doesn't seem to be any faster when using a top-of-the-line TrueNAS vice an old 5 year old TrueNAS.
It's.... just....slow.....