I recently had to reinstall freenas 11.1 u7 because the latest version with btx bricked the bootloader. Since I could not transfer settings over I had to redo them all.
Freenas System:
HP Microserver Gen8
Intel(R) Celeron(R) CPU G1610T @ 2.30GHz
16GB Ram
2x WD Red
I was able to import the old pool and am now trying to move data out of it to redo the system once more. The problem I run into however is that the SMB share is not working right. When initiating a transfer at first the speed is over 100mbps as per the gigabit line that it uses, then after about 2-3gb the speed goes down to about the drive speed of the offloading drive I use, around 20-30mbps, which in itself would be fine, but it does not stop getting slower. After about 5gb transferred data the transfer speed is 0. No data is moving at all.
According to reporting when those transfers happen the memory usage, cpu usage and disk io is well below the maximum for the system. Disk transfer is below 5mbps. Arc size immediately goes up to the maximum of vdev cache set and stays there forever, even after stopping the transfer. Hit rates and data requests are all over the place. I searched the old settings db for further changes, but I cannot find what else I had changed before redoing the system. Previously, moving the data I am pulling into the system I observed similar issues of large write operations slowing down or failing entirely, but I was able to move up to 15gb at a time without issues or significant slowdowns.
I tried setting up 3 tunables for vedv cache, kmem and arc max size I had from the previous install, setting them to relatively low values of 500-1500M to discourage use of any caching and simply read directly from the drive. I don't care for speeds, I need these transfer to actually work in the first place.
On the local machine I already upped the buffers and caches of the network driver to encourage it to handle part of the transfer as well as disabling large file offload. I setup a dedicated partition with large block sizes to aid the transfers, but to no avail. All files over 5gb in size effectively fail to transfer at all. Even using a third party software to do the moving rather than windows explorer yields the same results.
I increased the vdev, arc size and kmem to almost the size of the memory on the system to attempt a full caching of the files for the transfer, but that yields the same result as well. I read about 4 dozen threads on smb and what might help, but nothings been conclusive or straight up said what settings to use.
Freenas System:
HP Microserver Gen8
Intel(R) Celeron(R) CPU G1610T @ 2.30GHz
16GB Ram
2x WD Red
I was able to import the old pool and am now trying to move data out of it to redo the system once more. The problem I run into however is that the SMB share is not working right. When initiating a transfer at first the speed is over 100mbps as per the gigabit line that it uses, then after about 2-3gb the speed goes down to about the drive speed of the offloading drive I use, around 20-30mbps, which in itself would be fine, but it does not stop getting slower. After about 5gb transferred data the transfer speed is 0. No data is moving at all.
According to reporting when those transfers happen the memory usage, cpu usage and disk io is well below the maximum for the system. Disk transfer is below 5mbps. Arc size immediately goes up to the maximum of vdev cache set and stays there forever, even after stopping the transfer. Hit rates and data requests are all over the place. I searched the old settings db for further changes, but I cannot find what else I had changed before redoing the system. Previously, moving the data I am pulling into the system I observed similar issues of large write operations slowing down or failing entirely, but I was able to move up to 15gb at a time without issues or significant slowdowns.
I tried setting up 3 tunables for vedv cache, kmem and arc max size I had from the previous install, setting them to relatively low values of 500-1500M to discourage use of any caching and simply read directly from the drive. I don't care for speeds, I need these transfer to actually work in the first place.
On the local machine I already upped the buffers and caches of the network driver to encourage it to handle part of the transfer as well as disabling large file offload. I setup a dedicated partition with large block sizes to aid the transfers, but to no avail. All files over 5gb in size effectively fail to transfer at all. Even using a third party software to do the moving rather than windows explorer yields the same results.
I increased the vdev, arc size and kmem to almost the size of the memory on the system to attempt a full caching of the files for the transfer, but that yields the same result as well. I read about 4 dozen threads on smb and what might help, but nothings been conclusive or straight up said what settings to use.
