Hoeser
Dabbler
- Joined
- Sep 23, 2016
- Messages
- 23
Hi Guys,
Long time user, first time poster. I ran FreeNAS for years as a fiber channel SAN for a couple of ESXi hosts but I have recently just built a new FreeNAS box for that purpose, plus a little more. I've switched to 10GB NIC's instead of the FC setup, as the FC setup wasn't really supported and was annoying to maintain.
Anyway, I'm getting what I feel is less than expected performance from this box and I'm really not sure why it's so slow. I must be missing something simple (I hope).
Hardware:
2x Intel E5-2670 v2 (2.5GHz x 10cores)
Supermicro X9DRi-LN4+
64GB ECC PC8500
3x LSI 9211-8i in IT mode
Intel X540-T2
FreeNAS 11.2U1 (latest at the time of posting)
Supermicro 24 drive chassis
Currently running 3 zpools -
Chops - Two vdevs of raidz2 6x12TB Western Digital HC520 (12 drives total)
Vern - Single vdev raidz1 4x4TB HGST 7200rpm (4 drives total)
SSD - Single vdev raidz1 5x500GB Samsung Evo 860 SATA (5 drives total)
For the sake testing, I've set all pools to sync=disabled. This is all happening directly on the FreeNAS box, though the performance is roughly the same from a VM mounting an NFS share from the box over the 10GB storage network. The file is a standard h264 mkv on a ramdisk.
Results:
root@neutron[/tmpfs]# rsync -av --info=progress2 testfile.mkv /mnt/Chops/test
sending incremental file list
testfile.mkv
2,844,230,150 100% 196.17MB/s 0:00:13 (xfr#1, to-chk=0/1)
sent 2,844,924,632 bytes received 35 bytes 210,735,160.52 bytes/sec
total size is 2,844,230,150 speedup is 1.00
root@neutron[/tmpfs]# rsync -av --info=progress2 testfile.mkv /mnt/Vern/test
sending incremental file list
testfile.mkv
2,844,230,150 100% 200.06MB/s 0:00:13 (xfr#1, to-chk=0/1)
sent 2,844,924,632 bytes received 35 bytes 210,735,160.52 bytes/sec
total size is 2,844,230,150 speedup is 1.00
root@neutron[/tmpfs]# rsync -av --info=progress2 testfile.mkv /mnt/SSD/test
sending incremental file list
testfile.mkv
2,844,230,150 100% 205.85MB/s 0:00:13 (xfr#1, to-chk=0/1)
sent 2,844,924,632 bytes received 35 bytes 210,735,160.52 bytes/sec
total size is 2,844,230,150 speedup is 1.00
root@neutron[/tmpfs]#
It seems I can only write out about 200MB/sec with rsync to any of the 3 pools. I really expected far better performance for sequential writes, especially on the Chops and SSD pools.
I hope someone can give me some insight on what I'm doing wrong.
Long time user, first time poster. I ran FreeNAS for years as a fiber channel SAN for a couple of ESXi hosts but I have recently just built a new FreeNAS box for that purpose, plus a little more. I've switched to 10GB NIC's instead of the FC setup, as the FC setup wasn't really supported and was annoying to maintain.
Anyway, I'm getting what I feel is less than expected performance from this box and I'm really not sure why it's so slow. I must be missing something simple (I hope).
Hardware:
2x Intel E5-2670 v2 (2.5GHz x 10cores)
Supermicro X9DRi-LN4+
64GB ECC PC8500
3x LSI 9211-8i in IT mode
Intel X540-T2
FreeNAS 11.2U1 (latest at the time of posting)
Supermicro 24 drive chassis
Currently running 3 zpools -
Chops - Two vdevs of raidz2 6x12TB Western Digital HC520 (12 drives total)
Vern - Single vdev raidz1 4x4TB HGST 7200rpm (4 drives total)
SSD - Single vdev raidz1 5x500GB Samsung Evo 860 SATA (5 drives total)
For the sake testing, I've set all pools to sync=disabled. This is all happening directly on the FreeNAS box, though the performance is roughly the same from a VM mounting an NFS share from the box over the 10GB storage network. The file is a standard h264 mkv on a ramdisk.
Results:
root@neutron[/tmpfs]# rsync -av --info=progress2 testfile.mkv /mnt/Chops/test
sending incremental file list
testfile.mkv
2,844,230,150 100% 196.17MB/s 0:00:13 (xfr#1, to-chk=0/1)
sent 2,844,924,632 bytes received 35 bytes 210,735,160.52 bytes/sec
total size is 2,844,230,150 speedup is 1.00
root@neutron[/tmpfs]# rsync -av --info=progress2 testfile.mkv /mnt/Vern/test
sending incremental file list
testfile.mkv
2,844,230,150 100% 200.06MB/s 0:00:13 (xfr#1, to-chk=0/1)
sent 2,844,924,632 bytes received 35 bytes 210,735,160.52 bytes/sec
total size is 2,844,230,150 speedup is 1.00
root@neutron[/tmpfs]# rsync -av --info=progress2 testfile.mkv /mnt/SSD/test
sending incremental file list
testfile.mkv
2,844,230,150 100% 205.85MB/s 0:00:13 (xfr#1, to-chk=0/1)
sent 2,844,924,632 bytes received 35 bytes 210,735,160.52 bytes/sec
total size is 2,844,230,150 speedup is 1.00
root@neutron[/tmpfs]#
It seems I can only write out about 200MB/sec with rsync to any of the 3 pools. I really expected far better performance for sequential writes, especially on the Chops and SSD pools.
I hope someone can give me some insight on what I'm doing wrong.