What are your ARC statistics?

[jgreco]

• VM virtual disk storage
• 5:32PM up 49 days, 4:02, 1 user, load averages: 0.84, 0.51, 0.25
• 1.94GiB / 29.8GiB (freenas-boot)
• 1.89TiB / 12.7TiB (storage3)
• 47.23GiB (MRU: 26.54GiB, MFU: 20.69GiB) / 64.00GiB
• Hit ratio -> 93.96% (higher is better)
• Prefetch -> 36.09% (higher is better)
• Hit MFU:MRU -> 74.28%:24.29% (higher ratio is better)
• Hit MRU Ghost -> 0.28% (lower is better)
• Hit MFU Ghost -> 1.21% (lower is better)

This is the VM server I've been playing with. It isn't particularly heavily loaded, but will be going down soon for a bump up to 128GB and later some more L2ARC (256GB right now). I've got a 512GB Samsung 850 Pro on order for L2ARC but that might end up being a pair of them.

 

[HoneyBadger]

• VDI host
• 4:07PM up 238 days, 5:12, 1 user, load averages: 0.47, 0.20, 0.11
• 405GiB / 5.44TiB (badger-vdi)
• 52.81GiB (MRU: 49.46GiB, MFU: 3.38GiB) / 72.00GiB
• Hit ratio -> 98.95% (higher is better)
• Prefetch -> 90.35% (higher is better)
• Hit MFU:MRU -> 78.19%:19.58% (higher ratio is better)
• Hit MRU Ghost -> 0.07% (lower is better)
• Hit MFU Ghost -> 0.14% (lower is better)

 

[ondjultomte]

Been running for awhile now.

• My box is basically a seedbox at home.
• 8:21PM up 23 days, 20:07, 1 user, load averages: 0.89, 1.02, 0.86
• 1.12GiB / 15.9GiB (freenas-boot)
• 4.28TiB / 21.8TiB (tank)
• 15.80GiB (MRU: 14.80GiB, MFU: 1.00GiB) / 24.00GiB
• Hit ratio -> 73.50% (higher is better)
• Prefetch -> 41.91% (higher is better)
• Hit MFU:MRU -> 69.74%:10.16% (higher ratio is better)
• Hit MRU Ghost -> 0.60% (lower is better)
• Hit MFU Ghost -> 3.59% (lower is better)

[mod note- edited for formatting]

 

[nightshade00013]

Been up and running a while longer and have enabled autotune. Changed to a single larger drive(from a pair of laptop drives striped together), hopefully I can afford to start getting the drives to build out a pool.

Movies, Television episodes, Music, pictures, some other files, Jails and some documents. Jails include Murmur, Plex, Syncthing, OpenVPN, PHPvirtualBox without anything running.

• 10:47PM up 15 days, 14:18, 1 user, load averages: 0.11, 0.08, 0.04
• 2.13GiB / 14.5GiB (freenas-boot)
• 1.22TiB / 2.72TiB (tank)
• 36.06GiB (MRU: 33.85GiB, MFU: 2.26GiB) / 48.00GiB
• Hit ratio -> 94.91% (higher is better)
• Prefetch -> 96.27% (higher is better)
• Hit MFU:MRU -> 85.09%:4.05% (higher ratio is better)
• Hit MRU Ghost -> 0.06% (lower is better)
• Hit MFU Ghost -> 0.08% (lower is better)

 

[Bidule0hm]

For the next ones: can you please copy the whole output (including the list tags) because this:

[*] item 1
[*] item 2
[*] item 3

is ugly when you can have this:

• item 1
• item 2
• item 3

Thanks ;)

 

[jgreco]

• VM virtual disk storage
• 1:49PM up 17 days, 17:35, 2 users, load averages: 0.00, 0.00, 0.00
• 1.98TiB / 12.7TiB (storage3)
• 2.30GiB / 460GiB (storage3-ssd)
• 99.11GiB (MRU: 75.35GiB, MFU: 23.79GiB) / 128.00GiB
• Hit ratio -> 90.87% (higher is better)
• Prefetch -> 20.45% (higher is better)
• Hit MFU:MRU -> 60.33%:37.60% (higher ratio is better)
• Hit MRU Ghost -> 0.34% (lower is better)
• Hit MFU Ghost -> 1.38% (lower is better)

Same box as above, but with 128GB and more L2ARC. Interestingly the L2ARC usage has stabilized at some number (~400GB) well below what the box has available (768GB) so I'm guessing it definitely has the entire working set probably plus some crap already cached. Unfortunately this is not the same workload as what was above; there are fewer active VM's on this box because (mumbles: lazy).

 

[Bidule0hm]

Hmm... double post + no list tag... are you trolling me? :P

 

[nightshade00013]

Ok, so my sister server that is in CA, Autotune is enabled.

This one has jails of OpenVPN, Syncthing, PlexMediaServer. Not a lot of storage in use yet a few movies and such but it's up and running. Some movies and pictures and documents on board.

• 6:28PM up 2 days, 20:52, 1 user, load averages: 0.06, 0.09, 0.11
• 2.16GiB / 14.9GiB (freenas-boot)
• 188GiB / 14.5TiB (space)
• 34.59GiB (MRU: 31.90GiB, MFU: 2.69GiB) / 48.00GiB
• Hit ratio -> 93.97% (higher is better)
• Prefetch -> 4.51% (higher is better)
• Hit MFU:MRU -> 95.30%:3.84% (higher ratio is better)
• Hit MRU Ghost -> 0.00% (lower is better)
• Hit MFU Ghost -> 0.00% (lower is better)

 

[JJT211]

Here's my lastest stats

• 3.52GiB / 14.5GiB (freenas-boot)
• 9.90TiB / 21.8TiB (volume)
• 21.41GiB (MRU: 21.94GiB, MFU: 1.68GiB) / 32.00GiB
• Hit ratio -> 89.46% (higher is better)
• Prefetch -> 49.47% (higher is better)
• Hit MFU:MRU -> 93.95%:5.03% (higher ratio is better)
• Hit MRU Ghost -> 0.03% (lower is better)
• Hit MFU Ghost -> 0.14% (lower is better)

 

[jgreco]

Hmm... double post + no list tag... are you trolling me? :p

The double post was actually unintentional. I'm on super crappy wifi. As for the other, you can interpret it as you wish ;-)

 

[Gessi]

[*]Media files, userdata, jails
[*] 4:39PM up 4:22, 0 users, load averages: 0.01, 0.03, 0.10
[*]666MiB / 14.4GiB (freenas-boot)
[*]1.62TiB / 16.2TiB (pool1)
[*]15.13GiB (MRU: 17.08GiB, MFU: 5.42GiB) / 32.00GiB
[*]Hit ratio -> 81.85% (higher is better)
[*]Prefetch -> 0.44% (higher is better)
[*]Hit MFU:MRU -> 60.52%:38.58% (higher ratio is better)
[*]Hit MRU Ghost -> 0.01% (lower is better)
[*]Hit MFU Ghost -> 0.01% (lower is better)

 

[jgreco]

Four hours of uptime probably isn't enough time for the ARC to warm sufficiently to be meaningful...

 

[nightshade00013]

Four hours of uptime probably isn't enough time for the ARC to warm sufficiently to be meaningful...

I think I would worry more about his 3 X 6TB drive stripped pool than uptime at this point. Hope the backups are a lot better than the build plan or someone is in for being the man with no legs and one arm in an ass kicking contest.

 

[jgreco]

I think I would worry more about his 3 X 6TB drive stripped pool than uptime at this point. Hope the backups are a lot better than the build plan or someone is in for being the man with no legs and one arm in an ass kicking contest.

oh dear lord, look at

FreeNAS 9.3 (stable) | Supermicro X10SLH-F | BitFenix Phenom M Micro ATX
Intel Xeon E3-1231v3 | 32GB Crucial CT102472BD160B | 2x16 GB SanDisk Cruzer Fit Ultra (Boot)
3x6000GB WD Red Pro WD6001FFWX (Data) | 2x Samsung MZ-75E250B EVO 850 SSD 250GB (ZIL/L2ARC)

euuuuugggghhhh.... who wants to break it to him that his SLOG and L2ARC devices are bad?

 

[fullspeed]

Looks pretty good aside from prefetch, is that an indicator of an issue?

• 2.24GiB / 136GiB (freenas-boot)
• 5.41TiB / 130TiB (storage01)
• 1MiB / 3.62TiB (testvol)
• 90.55GiB
• (Adaptive)450.71 (MRU: 84.89GiB, MFU: 5.66GiB) / 128.00GiB
• Hit ratio -> 78.38% (higher is better)
• Prefetch -> 0.01% (higher is better)
• Hit MFU:MRU -> 99.51%:0.47% (higher ratio is better)
• Hit MRU Ghost -> 0.03% (lower is better)
• Hit MFU Ghost -> 0.40% (lower is better)

Wow have things changed... mostly in space :P

• 11.3GiB / 136GiB (freenas-boot)
• 616TiB / 672TiB (storage01)
• 88.09GiB
• (Adaptive)1.86 (MRU: 82.57GiB, MFU: 5.52GiB) / 128.00GiB
• Hit ratio -> 71.84% (higher is better)
• Prefetch -> 26.32% (higher is better)
• Hit MFU:MRU -> 46.83%:41.44% (higher ratio is better)
• Hit MRU Ghost -> 0.06% (lower is better)
• Hit MFU Ghost -> 2.00% (lower is better)

 

[Yatti420]

Media(Music/Movies/TV)/Photos/Few PC Backups @Random times/Random Plugins (Transmission/TS3/Kodi-SQL DB/Denyhosts/Syslog collection)/Alot of SMB streaming/NFS from my own main comp..

• 4:48PM up 12 days, 20:57, 1 user, load averages: 0.06, 0.04, 0.00
  
• 694MiB / 7.31GiB (freenas-boot)
  
• 8.43TiB / 10.9TiB (z2pool)
  
• 11.73GiB (MRU: 6.96GiB, MFU: 4.80GiB) / 16.00GiB
  
• Hit ratio -> 91.68% (higher is better)
  
• Prefetch -> 41.12% (higher is better)
  
• Hit MFU:MRU -> 96.05%:2.78% (higher ratio is better)
  
• Hit MRU Ghost -> 0.06% (lower is better)
  
• Hit MFU Ghost -> 0.40% (lower is better)

Note capacity pretty full however!

 

[nightshade00013]

Movies, Television episodes, Music, pictures, some other files, Jails and some documents. Jails include Murmur, Plex, Syncthing, OpenVPN, PHPvirtualBox without anything running.

• 10:47PM up 15 days, 14:18, 1 user, load averages: 0.11, 0.08, 0.04
• 2.13GiB / 14.5GiB (freenas-boot)
• 1.22TiB / 2.72TiB (tank)
• 36.06GiB (MRU: 33.85GiB, MFU: 2.26GiB) / 48.00GiB
• Hit ratio -> 94.91% (higher is better)
• Prefetch -> 96.27% (higher is better)
• Hit MFU:MRU -> 85.09%:4.05% (higher ratio is better)
• Hit MRU Ghost -> 0.06% (lower is better)
• Hit MFU Ghost -> 0.08% (lower is better)

And FINALLY have my pool completely up and running rather than a single drive. The majority of stuff is media files over 1GB. I have all datasets that are holding large media files set to a 1MB record size. Autotune is on. Have started and stopped a couple VirtualBox VM's most of the use has been watching things with plex or moving media around/recoding. The largest SyncThing files are actually backups from a nifty little Android OS powered mobile video recorder, start up the vehicle and drive along it records front and rear, get home stop the recording and let it upload on WiFi and it has updated since the last reboot.

• Movies, Television episodes, Music, pictures, some other files, Jails and some documents. Jails include Murmur, Plex, Syncthing, OpenVPN, PHPvirtualBox without anything running.
• 3:23PM up 7 days, 18:18, 1 user, load averages: 0.12, 0.45, 0.34
• 3.71TiB / 25.2TiB (Zero-One)
• 2.57GiB / 14.5GiB (freenas-boot)
• 34.98GiB (MRU: 32.16GiB, MFU: 2.85GiB) / 48.00GiB
• Hit ratio -> 93.82% (higher is better)
• Prefetch -> 21.08% (higher is better)
• Hit MFU:MRU -> 96.94%:2.54% (higher ratio is better)
• Hit MRU Ghost -> 0.01% (lower is better)
• Hit MFU Ghost -> 0.07% (lower is better)

 

[MrToddsFriends]

• Usage: Shares for my wife and me, backup target for three Windows client PCs
• 10:57PM up 21 days, 16:17, 1 user, load averages: 0.21, 0.16, 0.16
• 4.42GiB / 14.4GiB (freenas-boot)
• 155GiB / 1.81TiB (volrep)
• 415GiB / 2.72TiB (volume0)
• 69.0MiB / 57.5GiB (volvar)
• 20.36GiB (MRU: 19.10GiB, MFU: 3.64GiB) / 32.00GiB
• Hit ratio -> 88.68% (higher is better)
• Prefetch -> 42.60% (higher is better)
• Hit MFU:MRU -> 98.92%:0.22% (higher ratio is better)
• Hit MRU Ghost -> 0.00% (lower is better)
• Hit MFU Ghost -> 0.01% (lower is better)

Additional information:

• Build FreeNAS-9.3-STABLE-201602031011
• volume0: Main pool for shares and daily client PC backups (4 separate datasets in total), 2x WD Red mirrored
• volrep: Internal ZFS replication target for most important data (3x per day), 1x WD Red striped
• volvar: System dataset, UNIX home directories, reserved for jails, 2x SanDisk X300s mirrored
• ARC Hit Ratio reported in FreeNAS GUI didn't change noticeable after upgrading from 16 to 32 GByte RAM (as expected by me)

 

[Beholder101]

• In use as NFS Storage for a semi-production OpenStack environment (Looking forward to FreeNAS V10). VM's, images and back-up.
• 12:27PM up 31 days, 23:12, 1 user, load averages: 0.39, 0.50, 0.48
• 538MiB / 29.8GiB (freenas-boot)
• 1.42TiB / 35.9TiB (tank)
• 93.34GiB (MRU: 87.37GiB, MFU: 6.05GiB) / 128.00GiB
• Hit ratio -> 98.29% (higher is better)
• Prefetch -> 49.21% (higher is better)
• Hit MFU:MRU -> 86.44%:12.73% (higher ratio is better)
• Hit MRU Ghost -> 0.01% (lower is better)
• Hit MFU Ghost -> 0.12% (lower is better)

 

[Dice]

Might be lagging behind a bit on this thread (yet saved it for my first attempt at your excellent newb tutorial in how to put scripts into use!)

Comment: Bidule0hm predicted the machine would work fine on 16gb ram, but "a little bit slow to your liking". Luckily 16gb ddr4 sticks have dropped about 35% in price the last month. 48gb here I come :p

• home storage
• 8:45AM up 28 days, 12:55, 1 user, load averages: 0.00, 0.00, 0.00
• 551MiB / 29.8GiB (freenas-boot)
• 22.0TiB / 38TiB (wd60efrx)
• 12.15GiB (MRU: 11.39GiB, MFU: 777.87MiB) / 16.00GiB
• Hit ratio -> 75.41% (higher is better)
• Prefetch -> 1.48% (higher is better)
• Hit MFU:MRU -> 53.09%:43.33% (higher ratio is better)
• Hit MRU Ghost -> 0.70% (lower is better)
• Hit MFU Ghost -> 2.93% (lower is better)

Cheers,