latigid
Cadet
- Joined
- Oct 7, 2019
- Messages
- 2
Hello ix and freenas community!
I have been tasked with building a backup storage solution for my family. that includes only devices that connect to the local network. they run linux, android and sadly windows. For that I bought a helios4 and two 4TB Toshiba drives. Because they looked so nice I bought a second one for myself. My initial plan was to run a linux distro and plug some software together but after listening to some techsnap episodes I got really curious about freenas. My only experience with bsd is openbsd which was too unfamiliar (coming from linux) and strict for me. The helios wiki states that it can run freebsd but you have to compile it yourself. Assuming the freebsd build requirements are similar to the freenas build requirements, I am hesistant to compiling either of them without knowing what I'm doing and how to fix possible problems. For me encryption is mandatory. Here are two questions I have:
the helios has hardware crypto acceleration. if cryptsetup (linux thingy for disk encryption) is tuned for the hw crypto, this increases write speeds (see attached benchmarks). is it possible for freenas to make use of the hw crypto module?
when comparing the write speeds to a raw disk, ext4 and zfs (two disks mirrored, see benchmarks), zfs was slower. during that time, the machine was not doing anything else and neither ram nor cpu where used to their full capacity. zfs sounds awesome and I'd like to use it. do you think zfs performance can get better by running it under freenas or tuning it better?
here are some benchmarks I have done. in case you want other or more detailed benchmarks I'll do that as soon as I'm done moving some data between hard drives:
I have been tasked with building a backup storage solution for my family. that includes only devices that connect to the local network. they run linux, android and sadly windows. For that I bought a helios4 and two 4TB Toshiba drives. Because they looked so nice I bought a second one for myself. My initial plan was to run a linux distro and plug some software together but after listening to some techsnap episodes I got really curious about freenas. My only experience with bsd is openbsd which was too unfamiliar (coming from linux) and strict for me. The helios wiki states that it can run freebsd but you have to compile it yourself. Assuming the freebsd build requirements are similar to the freenas build requirements, I am hesistant to compiling either of them without knowing what I'm doing and how to fix possible problems. For me encryption is mandatory. Here are two questions I have:
the helios has hardware crypto acceleration. if cryptsetup (linux thingy for disk encryption) is tuned for the hw crypto, this increases write speeds (see attached benchmarks). is it possible for freenas to make use of the hw crypto module?
when comparing the write speeds to a raw disk, ext4 and zfs (two disks mirrored, see benchmarks), zfs was slower. during that time, the machine was not doing anything else and neither ram nor cpu where used to their full capacity. zfs sounds awesome and I'd like to use it. do you think zfs performance can get better by running it under freenas or tuning it better?
here are some benchmarks I have done. in case you want other or more detailed benchmarks I'll do that as soon as I'm done moving some data between hard drives:
to a zfs fileset
to a zfs fileset from memory
from memory to ext4
from memory to unoptimized md raid1
from memory to the raw disks
from memory to zfs and I still know how I created the pool
from memory to unoptimized cryptsetup
from memory to optimized cryptsetup
as mentioned earlier, I'm dding an old 1TB drive to a zfs volume (two disk mirror made of 4TB drives). this is going incredibly slow at ~10MB/s
Code:
$ dd if=/dev/urandom of=/srv/cave/media/tempfile bs=1048576 count=1024 1024+0 records in 1024+0 records out 1073741824 bytes (1.1 GB, 1.0 GiB) copied, 25.1251 s, 42.7 MB/s
to a zfs fileset from memory
Code:
$ dd if=/tmp/tmpfile of=/srv/cave/media/tempfile bs=1M count=1024 1007+1 records in 1007+1 records out 1056886784 bytes (1.1 GB, 1008 MiB) copied, 14.0393 s, 75.3 MB/s
from memory to ext4
Code:
$ dd if=/tmp/tmpfile of=/mnt/a/tempfile bs=1M count=1024 1007+1 records in 1007+1 records out 1056886784 bytes (1.1 GB, 1008 MiB) copied, 5.88011 s, 180 MB/s
from memory to unoptimized md raid1
Code:
$ dd if=/tmp/tmpfile of=/mnt/a/tempfile bs=1M count=512 512+0 records in 512+0 records out 536870912 bytes (537 MB, 512 MiB) copied, 2.99716 s, 179 MB/s
from memory to the raw disks
Code:
queen@peace ~ $ doas dd if=/tmp/tmpfile of=/dev/sdc1 bs=1M count=512 512+0 records in 512+0 records out 536870912 bytes (537 MB, 512 MiB) copied, 3.30379 s, 163 MB/s queen@peace ~ $ doas dd if=/tmp/tmpfile of=/dev/sdd1 bs=1M count=512 512+0 records in 512+0 records out 536870912 bytes (537 MB, 512 MiB) copied, 3.31884 s, 162 MB/s
from memory to zfs and I still know how I created the pool
Code:
$ doas zpool create -o ashift=12 cave -m /srv/cave mirror /dev/sdc /dev/sdd [...] $ dd if=/tmp/tmpfile of=/srv/cave/tempfile bs=1M count=512 512+0 records in 512+0 records out 536870912 bytes (537 MB, 512 MiB) copied, 6.88816 s, 77.9 MB/s
from memory to unoptimized cryptsetup
Code:
$ doas dd if=/tmp/tmpfile of=/dev/mapper/vroom bs=1M count=512 512+0 records in 512+0 records out 536870912 bytes (537 MB, 512 MiB) copied, 9.08432 s, 59.1 MB/s
from memory to optimized cryptsetup
Code:
$ doas dd if=/tmp/tmpfile of=/dev/mapper/vroom bs=1M count=512 512+0 records in 512+0 records out 536870912 bytes (537 MB, 512 MiB) copied, 4.12934 s, 130 MB/s
as mentioned earlier, I'm dding an old 1TB drive to a zfs volume (two disk mirror made of 4TB drives). this is going incredibly slow at ~10MB/s
Code:
$ doas dd if=/dev/sdc of=/dev/zvol/moon/original-data status=progress bs=1M 703813648384 bytes (704 GB, 655 GiB) copied, 64827 s, 10.9 MB/s
