BUILD First NAS build - AMD plattform

[glotzer]

Thx for the answeres. So i will just ignore it and go on.

Block sizes for ZFS are NOT 512-bytes. ZFS' block size is variable based on the zpool propertie(I forget what it's called). But the default is powers of two from 512-bytes to 128kB.

Yes i did know that, but the results will be the same (= no full nummber) for any multiple of 512, that is why i choose the base nummber. Thx anyway.

 

[Starpulkka]

Remember to test your hardware and hdds before even try run freenas.. And then if you like you can test your setups and speeds 8hdd raidz3 versus 8 raidz2 etc. Before you gonna stick your selection. Heres some info what you could have. https://calomel.org/zfs_raid_speed_capacity.html
As for lz4 its too new for my eyes so i still stick older compression. Edit: Looks like z3 its going to be lilbit slowwich. testing recommended.

 

[glotzer]

All tests are done with 64gb of data.

-------------------------------------------------------------------

RaidZ3

[root@AndyNas ~]# dd count=65536 bs=1m if=/dev/zero of=/mnt/tank/abc.txt 65536+0 records in 65536+0 records out 68719476736 bytes transferred in 29.608799 secs (2320914022 bytes/sec)
= 2,16GB/s

[root@AndyNas ~]# dd count=65536 bs=1m if=/dev/urandom of=/mnt/tank/abc.txt 65536+0 records in 65536+0 records out 68719476736 bytes transferred in 766.885670 secs (89608503 bytes/sec)
= 85,46MB/s

-------------------------------------------------------------------

RaidZ2
[root@AndyNas ~]# dd count=65536 bs=1m if=/dev/zero of=/mnt/tank/abc.txt 65536+0 records in 65536+0 records out 68719476736 bytes transferred in 24.837061 secs (2766811940 bytes/sec)
= 2,58GB/s

[root@AndyNas ~]# dd count=65536 bs=1m if=/dev/urandom of=/mnt/tank/abc.txt 65536+0 records in 65536+0 records out 68719476736 bytes transferred in 751.110488 secs (91490504 bytes/sec)
= 87,25MB/s
-------------------------------------------------------------------
I know this is not the best test, but its good enought for mee.
2MB/s more is not enought for me to switch to RaidZ2, i will stay with RaidZ3.
Now i just need to get the cooling of my hdds better, right now they get up to 38°C
and thats too much, i want them belowe 35°C. i think another fan blowing on them
will do the job. im at 70W idle without any standby/spin down stuff.

I'm playing around with power mode S3 right now, combined with wake on lan.
It seems to work well, the system gets down to 5W like that. If i can make sure it will
always work, im going to use that.

Once again i want to thank all here for the great help!

edit:
Over a samba share i get 115 mb/s write and read, so my gbit network is maxed out anyway. Unless i upgrade to 10gbit network any time soon (will not happen) i will stay with RaidZ3.

 

[cyberjock]

random is pointless.. completely pointless. Your CPU is heavily taxed with the random number generator generating chars.. and it looks like it maxes out at 85MB/sec or so. This is why we *never* use random on this forum. So thinking it's 2MB/sec faster is a farse...

Using dev/zero when you have compression on your pool is pointless.. completely pointless. You're just testing your CPUs ability to compress zeros.

So all that info, if you are using it to determine the best performing pool layout, is somewhat laughable since you're just taking numbers that mean nothing and applying them.. ;)

Do the /dev/zero test with compression disabled and *then* you'll see something worth noting.

 

[glotzer]

the cpu wasn't maxed out at all, it was belowe 10% all the time. the zeros are pointless, that i know. anyway it doesn't matter, over network copys i get the speed i need, i don't realy cae about how fast the NAS itself is, as long as its fast enought to max out my gbit connection

 

[cyberjock]

Yeah, both RAIDZ2 and Z3 with more than 4 disks will saturate Gb without breaking a sweat. ZFS is sweet like that.