Hello Everyone,
This is my first experience moving to Truenas Scale from the old traditional hardware raid and running everything myself in hand made containers.
Below is my hardware:
Supermicro X10DRH-IT
2x Xeon E5-2699v4
512GB DDR4-2400T ECC REG RAM
(12) 8TB HGST SAS3 Drives configured in RAIDZ2
(1) LSI 9300-8i firmware 16.00.12.00
(1) LSI 9300-8e firmware 16.00.12.00
(1) Intel X520 Dual 10GB SFP+ NIC
(1) Chelsio T520 Dual 10GB SFP+ NIC
MTU on all networking: 9000
Autotune: On
Samba service Auxiliary Parameters tried:
aio write size = 0
server multi channel support = yes
No cache drives etc.
I am having big problems with SMB and iSCSI read/writes.
Initially if I go to copy a 100GB test file over SMB from my windows host (also using the X520 direct connection) the speeds are 1250MB/s for the first 30 seconds or so then they drop to around 200MB/s.
Reads are poor in my opinion at only around 220MB/s.
This is my first experience with non hardware raid and using truenas so my question is what is the performance expected to be like?
root@black[/mnt/data1/media]# dd if=/dev/random of=/mnt/data1/media/large-file-10gb.txt count=1024 bs=10485760
1024+0 records in
1024+0 records out
10737418240 bytes (11 GB, 10 GiB) copied, 51.0364 s, 210 MB/s
root@black[/mnt/data1/media]#
I am only hitting 210MB/s over 10 drives? Am I missing something here with the way zfs does it raid vs tradition raid? This same hardware here would max 1200+MB/s in a hardware raid 10 all day long prior to switching to TrueNAS. Is this to be expected with this kind of setup?
Any help is appreciated, thank you.
This is my first experience moving to Truenas Scale from the old traditional hardware raid and running everything myself in hand made containers.
Below is my hardware:
Supermicro X10DRH-IT
2x Xeon E5-2699v4
512GB DDR4-2400T ECC REG RAM
(12) 8TB HGST SAS3 Drives configured in RAIDZ2
(1) LSI 9300-8i firmware 16.00.12.00
(1) LSI 9300-8e firmware 16.00.12.00
(1) Intel X520 Dual 10GB SFP+ NIC
(1) Chelsio T520 Dual 10GB SFP+ NIC
MTU on all networking: 9000
Autotune: On
Samba service Auxiliary Parameters tried:
aio write size = 0
server multi channel support = yes
No cache drives etc.
I am having big problems with SMB and iSCSI read/writes.
Initially if I go to copy a 100GB test file over SMB from my windows host (also using the X520 direct connection) the speeds are 1250MB/s for the first 30 seconds or so then they drop to around 200MB/s.
Reads are poor in my opinion at only around 220MB/s.
This is my first experience with non hardware raid and using truenas so my question is what is the performance expected to be like?
root@black[/mnt/data1/media]# dd if=/dev/random of=/mnt/data1/media/large-file-10gb.txt count=1024 bs=10485760
1024+0 records in
1024+0 records out
10737418240 bytes (11 GB, 10 GiB) copied, 51.0364 s, 210 MB/s
root@black[/mnt/data1/media]#
I am only hitting 210MB/s over 10 drives? Am I missing something here with the way zfs does it raid vs tradition raid? This same hardware here would max 1200+MB/s in a hardware raid 10 all day long prior to switching to TrueNAS. Is this to be expected with this kind of setup?
Any help is appreciated, thank you.