Simultaneous zpool read from multiple nodes

mxtrck

Cadet
Joined
Jan 19, 2019
Messages
5
Hello to all, got a theoretical question while trying to understand what to do to help my Freenas respond better.

Got a hot storage with mirrored SSDs (x6) (Sata III). Those are being backed up to a cold storage of regular hdds.

The hot storage at times during the day is accessed simultaneously by 6+ nodes , all attacking the same file ( that can range from 500MB to 2GB size). All that is happening over Gigabit lan connections, via a switch with 48Gbps bandwidth, which to my understanding is enough to serve on full Gigabit rate each node.

Upgrading to 10Gbe network , is on the to-do list of next week.

My question is, when resolving the 10Gbe switch upgrade, the theoretical transfer speed that we will get per node will it be something like

(zpool read speed)/(number of nodes)

when accessing the directory?

Or is there any more sophisticated way that the system responds to simultaneous data reads?

Please forgive my crude , non-poetic attempt to quantify the issue. Any ideas will be appreciated :)
 

SweetAndLow

Sweet'NASty
Joined
Nov 6, 2013
Messages
6,421
Well if the data is read once then it will be in arc. So all following reads will come straight from memory. Is the data being modified or just read? If it's just read then each node could probably get 10gbps each(probably won't because of other bottlenecks not related to networking or pool speed).
 

mxtrck

Cadet
Joined
Jan 19, 2019
Messages
5
SweetAndLow , thank you.

For the arc, i guess i will be dependent on ram speed then?

As for the process, the data is just read, then each node runs a task locally (takes from mins to hours) and in the end saves new data in another location of the Freenas.

What would be the other bottlenecks, if networking and pool speed are taken out of the way.

Honestly, i was looking into changing the sata III striped SSDs to a set of 4 Intel M2 drives ( 660P Series 2TB) each on one Raidsonic PCIe 3.0 controller.
The cpu is this xeon , with 40pci lanes and hopefully enough GT/s.
Trying to pin point what upgrade would help the most since i am on the upgrade train><
 
Top