brando56894
Wizard
- Joined
- Feb 15, 2014
- Messages
- 1,537
I've finally decided to benchmark my current setup after getting everything in place and have been noticing relatively slow write speeds to my mirrored pool. I just ran a DD test on an uncompressed dataset and the speeds are pretty weak for 4 pairs connected to a PCI SAS controller. Granted most of the drives are 5400 RPM (2x1 TB WD Red 2.5", 3x3 TB WD Green) and 3 are 7200 RPM are 4 TB HGST Deskstar NAS drives, but that shouldn't affect performance that much. Transferring large files (a gigabyte to a few gigabytes) from one pool to another (inside a jail) is even worse, and hovers around 20-30 MB/sec, SMB transfers hover around 50 MB/sec also. As can be seen below, read speeds are pretty good at 370 MB/sec but write speeds are about 15% of that.
Multimedia Write
Multimedia Read
For comparison sake I did the same test on my Striped Pool of 2x74 GB WD Raptors (10K RPM, attached to Intel Sata Controller on Motherboard) and a single Toshiba drive that I have, and it doesn't look like the problem is with the pool or the SAS controller, but maybe with FreeNAS itself (? can't think of what else could be the issue). Instead of being identical, shouldn't write speeds be vastly different between a mirrored pool of 4 sets, a stripe with 2 10K drives in it, and a single drive, connected to different controllers?
Downloads Write
Downloads Read
Stuff Write
Stuff Read
Multimedia Write
Code:
[root@freenas] /mnt/Multimedia/Test# dd if=/dev/random of=test.img bs=2048k count=50k 51200+0 records in 51200+0 records out 107.3741824 GB transferred in 37.12 minutes (48.211989 MB/sec) [root@freenas] /mnt/Multimedia/Test#
Multimedia Read
Code:
[root@freenas] /mnt/Multimedia/Test# dd if=test.img of=/dev/null bs=2048k 51200+0 records in 51200+0 records out 107.3741824 GB transferred in 4.84 Minutes (370.076911 MB/sec)
For comparison sake I did the same test on my Striped Pool of 2x74 GB WD Raptors (10K RPM, attached to Intel Sata Controller on Motherboard) and a single Toshiba drive that I have, and it doesn't look like the problem is with the pool or the SAS controller, but maybe with FreeNAS itself (? can't think of what else could be the issue). Instead of being identical, shouldn't write speeds be vastly different between a mirrored pool of 4 sets, a stripe with 2 10K drives in it, and a single drive, connected to different controllers?
Downloads Write
Code:
[root@freenas] /mnt/Downloads/Nzbget# dd if=/dev/random of=test.img bs=2048k count=25k 25600+0 records in 25600+0 records out 53.6870912 GB transferred in 18.53 minutes secs (48.296524 MB/sec)
Downloads Read
Code:
[root@freenas] /mnt/Downloads/Nzbget# dd if=test.img of=/dev/null bs=2048k 25600+0 records in 25600+0 records out 53.6870912 GB transferred in 6.97 minutes (128.438269 MB/sec)
Stuff Write
Code:
dd if=/dev/random of=test.img bs=2048k count=25k 25600+0 records in 25600+0 records out 53.6870912 GB transferred in 18.52 minutes (48.320039 MB/sec)
Stuff Read
Code:
[root@freenas] /mnt/Stuff/Downloads# dd if=test.img of=/dev/null bs=2048k 25600+0 records in 25600+0 records out 53.6870912 GB transferred in 13.42 minutes (66.663005 MB/sec)
Last edited: