Hi,
I'm seeing large slowdowns when reading files from encrypted datasets. When this happens, the TrueNAS WebUI becomes completely inaccessible (I see "Waiting for Active TrueNAS controller to come up..." during the entirety of the transfer). Also, while the CPU (6C 12T) is showing very little usage, the system load jumps up to 16+ (normally when idle it's below 1).
I don't see this slowdown when copying files from unencrypted datasets, even when the destination is an encrypted dataset.
Here's a summary of the behavior (60 GB data transfer between datasets):
Does anyone have any ideas as to why I'm seeing the slowdown? Are there any tweaks I can try that might help?
Is it normal for the TrueNAS WebUI to hang, when there's lots of disk activity (even if that activity isn't in the boot or system/app pool)?
Here's how I tested the transfers above:
Here's my system information:
Thanks!
I'm seeing large slowdowns when reading files from encrypted datasets. When this happens, the TrueNAS WebUI becomes completely inaccessible (I see "Waiting for Active TrueNAS controller to come up..." during the entirety of the transfer). Also, while the CPU (6C 12T) is showing very little usage, the system load jumps up to 16+ (normally when idle it's below 1).
I don't see this slowdown when copying files from unencrypted datasets, even when the destination is an encrypted dataset.
Here's a summary of the behavior (60 GB data transfer between datasets):
- unencrypted->unencrypted (within same dataset): 125MB/s
- unencrypted->encrypted: 121MB/s
- encrypted->encrypted (within same dataset): 18MB/s + inaccessible WebUI
- encrypted->unencrypted: 23MB/s + inaccessible WebUI
Does anyone have any ideas as to why I'm seeing the slowdown? Are there any tweaks I can try that might help?
Is it normal for the TrueNAS WebUI to hang, when there's lots of disk activity (even if that activity isn't in the boot or system/app pool)?
Here's how I tested the transfers above:
- Created 2 test datasets in my "Media" pool (HDD mirrors, see system specs below), 1 unencrypted, 1 encrypted:
dataset options:
sync: disabled compression: off atime: off zfs deduplication: off encrypted datset: passphrase, pbkdf2iters: 350000 (default), algorithm: AES-256-GCM (default)
- Created 3 random 20GB files in each dataset:
for i in {1..3}; do dd if=/dev/urandom of=./20gfile-$i.txt bs=4k iflag=fullblock,count_bytes count=20G; done
- Tested transfer speeds between datasets:
time rsync -avh --progress /path/to/20gfile-* .
(I see similar behavior with cp)
Here's my system information:
TrueNAS-SCALE-22.12.2
ASRock Rack E3C246D2I
Intel Xeon E-2246G @ 3.60 GHz (6C 12T)
32GB RAM (2x16 Kingston KSM26ED8/16MR)
Boot pool:
128GB SSD (M4-CT128M4SSD2)
System/app pool:
VDEV 1 (mirror): 2x 500GB SSD (850 EVO / 870 EVO)
Media pool:
VDEV 1 (mirror): 2x 6TB HDD (2x WD60EFZX - CMR)
VDEV 2 (mirror): 2x 14TB HDD (2x WD140EFGX - CMR)
Network: using onboard Intel i210 (1GbE)
Storage: using onboard OCuLink/SATA ports
Thanks!