I will start this off with I am very familiar with the nsmb.conf fix for signing issues with Mac OS. So the details:
On FreeNAS 11.0-U4, everything is normal. I get write speeds around 800Mb/s and read speeds of around 1000Mb/s. These are generated by using AJA system test running 64GB file transfers at 4k. Thats how we have been doing benchmarks for 10Gb ethernet performance since about 9.2.18.
Made the switch to FreeNAS-11.1-RELEASE. Speeds wont go over 70-75Mb/s but write speeds are still up around 1000Mb/s.
I have tried with compression on (default LZ4) and compression off. Same result. This system has 3 vdevs, 8 disks a piece with 0TB used. It is literally what we use for testing.
We also have a media server with 5 vdevs and get the same settings.
Does anyone know why there would be a cap with 11.1 on write speeds? Seems pretty weird. I thought it might be a 10.13.1 Mac issue, but again, ran the same tests on a 10.12 instance and got the same results.
Our next step will be to test on Windows 10 to confirm this is a server side issue. I have debugs saved from both the 11.0-U4 instance and the 11.1-RELEASE instance. The only real difference I found in the 11.1 debug was in the SMB dump.txt file. the field "server MAX protocol = SMB3" is no longer in the global configuration. Nor is there a place in Service > SMB to select the max protocol. On that note, I also tried adding that line in the global configuration in 11.1. That yields no chance. Please let me know if any specific logs would be valuable in diagnosing this further.
I also created an AFP share on the 11.1 instance. Speeds were write = 600Mb/s and read = 800Mb/s. With that, Im guessing then that this has something to do with SMB in 11.1.
On FreeNAS 11.0-U4, everything is normal. I get write speeds around 800Mb/s and read speeds of around 1000Mb/s. These are generated by using AJA system test running 64GB file transfers at 4k. Thats how we have been doing benchmarks for 10Gb ethernet performance since about 9.2.18.
Made the switch to FreeNAS-11.1-RELEASE. Speeds wont go over 70-75Mb/s but write speeds are still up around 1000Mb/s.
I have tried with compression on (default LZ4) and compression off. Same result. This system has 3 vdevs, 8 disks a piece with 0TB used. It is literally what we use for testing.
We also have a media server with 5 vdevs and get the same settings.
Does anyone know why there would be a cap with 11.1 on write speeds? Seems pretty weird. I thought it might be a 10.13.1 Mac issue, but again, ran the same tests on a 10.12 instance and got the same results.
Our next step will be to test on Windows 10 to confirm this is a server side issue. I have debugs saved from both the 11.0-U4 instance and the 11.1-RELEASE instance. The only real difference I found in the 11.1 debug was in the SMB dump.txt file. the field "server MAX protocol = SMB3" is no longer in the global configuration. Nor is there a place in Service > SMB to select the max protocol. On that note, I also tried adding that line in the global configuration in 11.1. That yields no chance. Please let me know if any specific logs would be valuable in diagnosing this further.
I also created an AFP share on the 11.1 instance. Speeds were write = 600Mb/s and read = 800Mb/s. With that, Im guessing then that this has something to do with SMB in 11.1.