More information - that I should have thought to gather ahead of time (seems working from home for several months has made my brain numb).
I'm far from an expert on this NAS/SAN, I should have started with what the old system was telling me (beyond that it was reaching it's storage capacity) ... anyway;
I looked closer at the system that I'm replacing and learned a few things, going back a week:
- Neither of the network interfaces logged a max greater than 1.75Gb/s in or out and both averaged under 50Mb/s.
- CPU, in it's max usage column logged 94.36% idle (97.22% Avg idle), and load 1/5/15 max at 4.02/1.78/1.24, with a 1 min Avg of .57
- L2 NVMe logged disk IO max read/write of 15.8Mb/28Mb, Avg read/write 20.9k/57.6k, and total read/write 12GB/33GB over the period
- The iSCSI target logged a max read/write 239MBps/215.8MBps, and and Avg read/write of 5.7MBps/11.6MBps
- I also learned that I have no idea what the ZFS ARC graphs are telling me, so I'm not sure what of that information is most telling to understand how much benefit we may realistically be getting from it.
This chassis is running (2) Xeon E5-2609 v4's (1.7 GHz), and 128GB RAM
That box was initially built after some of
@jgreco's input (
this thread), which was invaluable at the time; and probably a big part of the reason I've never had any complaints about the system until the whole "we're out of space" stuff started. This time, I was just blindly trying to replicate that system on the larger scale, but, I may not need to if the L2 isn't doing a whole lot of contributing here.
What values of the ARC information on the current system teach me the most regarding it's contribution?
