TrueNAS SCALE 22.12.1 slow work

[Alex-izh]

Server Configuration:
AMD Ryzen 5 PRO 5650G
64 GB of RAM ECC
8 * Color Gold 20 TB
Arc L2 intel optane p4800x 750 GB hhhl cache
Network 10G intel

On TrueNAS Core, the speed of copying large files is up to 900 megabytes per second
On the TrueNAS Scale, the speed did not rise above 400 megabyte per second

 

[Ericloewe]

Arc L2 intel optane p4800x 750 GB hhhl cache

Start by getting rid of the L2ARC. 750 GB is excessive with a mere 64 GB of RAM with Core and doubly so with Scale. L2ARC is not a free lunch and uses ARC to store its headers.

Beyond that, you will need to provide a lot more detail about what you're doing and how you're testing.

 

[Alex-izh]

Typical copy via SMB on Windows.
The array is the same for CORE and SCALE, all settings are "out of the box"
From observations: CORE works very well with cache
SCALE uses the cache in a different way and this seems to affect performance

 

[morganL]

Typical copy via SMB on Windows.
The array is the same for CORE and SCALE, all settings are "out of the box"
From observations: CORE works very well with cache
SCALE uses the cache in a different way and this seems to affect performance

At the moment Linux/SCALE provides about half of the RAM to act as ARC. This probably also means the dirty-data max is about half and hence the performance might be lower. We consider it a bug, but it's quite a complicated OS issue involved with dynamic memory management.

If you reduced RAM on CORE to 32GB, it would be useful to see whether this brought performance back to similar...

 

[Alex-izh]

That is, do not wait for the SСALE 22.12.2 update, since the problem is global?

 

[morganL]

That is, do not wait for the SСALE 22.12.2 update, since the problem is global?

This specific issue of ARC size is not fixed, but worthwhile to check that no other fixes are relevant.