Register for the iXsystems Community to get an ad-free experience and exclusive discounts in our eBay Store.

Freenas Slow iscsi/fibre channel

Western Digital Drives - The Preferred Drives of FreeNAS and TrueNAS CORE

levinet

Cadet
Joined
Jan 9, 2021
Messages
9
Hey!

I want to try out Freenas fibre channel capabilities and i set it up.

The current freenas TEST configuration is this:

Intel Xeon E5-2450L
8GB memory
LSI 9207-8i HBA card
WD Blue 250GB for freenas
Seagate savvio 300GB 15K SAS for data test
Qlogic QLE2562 FC card

Here are the results:

SMB: 120-125MB/s. Its okay
ISCSI: starting with 120MB/s and after a while drops down to 20-60MB/s
FC: ~230MB/s and after a while drops down to 30-70 MB/s after a while went up to 150-250MB/s


I tried to disable compressing,set the sync all with of their options but nothing.

Any idea?
 

Herr_Merlin

Patron
Joined
Oct 25, 2019
Messages
200
please go into deeper details for your system. pool layout etc.
First thing I noticed, you are running 8GB of memory.. how many sas drives for data set?
What are you doing with this san?
Running VMs?
etc.
please go into deeper details.
 

levinet

Cadet
Joined
Jan 9, 2021
Messages
9
Hey!

Because it is a TEST configuration. I have 1 disk to test fibre channel capabilities as I've mentioned before.(Seagate savvio 300GB 15K SAS for data test)

I have one dataset and one zpool for TEST

I don't have any VM's.

In the future I'm going to connect this SAN for two ESXi hosts.
 

HoneyBadger

Mushroom! Mushroom!
Joined
Feb 6, 2014
Messages
3,801
You have 8GB of RAM and a single disk. Those numbers are expected.

Quite simply your 8Gbps FC line is far faster than the single spindle in your pool and as such the transfer rate rapidly chokes off to your pool speed.

You should leave compression on (LZ4 probably, ZSTD may have value going forward) and add much more RAM (the answer to "how much should I add?" is "how much can you fit?") as well as more spindle drives.

Since you are using ESXi you will also want to look at the potential of using an SLOG device and setting sync=always on your ZVOLs to ensure write safety. A fast SSD (the threads below will help to determine what is required to make an SSD a fast SLOG device) is expected here.


 

arankaspar1

Dabbler
Joined
Apr 7, 2020
Messages
25
Qlogic QLE2562 8Gb
32GB RAM
Opteron 6128
(4) 2TB WD Enterprise in Z10 mirrors
787MB/s is where it tops out... 24MB I/O size (in ATTO)
Drivers works fine on FreeNAS-11.3-U4.1
 
Top