Going over 1 gigabit

[mactsk]

My freeness happily goes to the 1 gigabit speed, and i'm quite sure it can go wit higher, i searched for link aggregation and found it can't be used to send data faster to a single pc, but only to serve multiple pc's.
So the only option is going to 10GBE spending tons of money?

Is there a cheaper way to do that?
Tnx

 

[DrKK]

My freeness happily goes to the 1 gigabit speed, and i'm quite sure it can go wit higher, i searched for link aggregation and found it can't be used to send data faster to a single pc, but only to serve multiple pc's.
So the only option is going to 10GBE spending tons of money?

Is there a cheaper way to do that?
Tnx

This is a complicated question. But the simple answer is "no, not really". If you want to go to 10 GbE, it'll cost you some money, and you'll need a pretty good amount of know-how.

 

[gpsguy]

If you don't need 10 GbE, you might want to look at fibre channel. FreeNAS 9.3 includes the QLogic driver. Used cards can be found on eBay for cheap.

Search the forum for: QLogic

 

[gdreade]

Do we have much of a baseline with FreeNAS doing 10 GbE? I've got a situation where I have exactly one MacBook Pro that needs as much throughput as it can get to the FreeNAS server and could easily saturate a 10 GbE link for hours. With only one client I shouldn't even need a 10 GbE switch, but rather just do a direct (crossover) connection using a thunderbolt/10GbE adapter.

With the current config it would be using AFP.

 

[gdreade]

And replying to myself, I see that a lot of information on the topic is already in one of the pinned conversations. *sigh*

 

[ideal2545]

If you don't mind responding, what does your freenas setup look like?

 

[gdreade]

I don't happen to have the full info for that system right at this moment, but going by memory:

• Intel S1200V3RPS w/ a fast Intel CPU
• 32 GB ECC memory
• six 6 TB WD Red NAS drives in a RAID-Z2 configuration for a total of 24 TB usable, using the integrated SATA ports
  
• currently using a single integrated Intel 1 GbE controller, connected to an unmanaged 1 GbE switch

The problematic client is a MacBook Pro (I don't have the exact model handy) which is currently using a Thunderbolt to 1 GbE adapter.

I don't have any 10 GbE hardware for this system as yet.

 

[RchGrav]

I'm using ethernet across passive direct attach copper (SFP+ to SFP+)... About $350 if you buy the cards on eBay.

Here's my recipe.. I'm using an Intel X520-DA2 in my FreeNAS box and single port X520-DA1 in my desktop.. eBay prices $175 for the dual port card, $125 for the single port card, and about $50 for a 10Gbe Direct Attach Copper 3-Meter cable (Part number SFP-H10GB-CU3M).

This is a good solution @ home if you want to be able to copy data back and forth from your desktop to the NAS at 10GBe speeds and your NAS is in the same room. (You can't go much further than 20 feet with a passive cable)

 

[Ben Bliss]

Correct me if I am wrong but using iSCSI with multi-pathing will allow for more than 1gbe assuming both side are a capable. I currently use iSCSI with my Hackintosh and my MBP. Works great, however I am not using multi-pathing as the 1gbe is plenty for my needs which is only time machine and media storage. At work I am using 8gbe FC with freenas and saturating that is actually pretty tough with a single host. Not to mention you freenas hardware will be the bottleneck at 8gbe or 10gbe. I would wager that the config you posted would only do about ~300-400mb after write cache is saturated.

FYI I use GlobalSan for the OSX iSCSI.

 

[RchGrav]

Correct me if I am wrong but using iSCSI with multi-pathing will allow for more than 1gbe assuming both side are a capable. I currently use iSCSI with my Hackintosh and my MBP. Works great, however I am not using multi-pathing as the 1gbe is plenty for my needs which is only time machine and media storage. At work I am using 8gbe FC with freenas and saturating that is actually pretty tough with a single host. Not to mention you freenas hardware will be the bottleneck at 8gbe or 10gbe. I would wager that the config you posted would only do about ~300-400mb after write cache is saturated.

FYI I use GlobalSan for the OSX iSCSI.

I'm getting a bit over 1GB per second transfer rate over my 10Gbe connection.. network transfer speed (RAM to RAM transfer speed). It has no problem keeping up with my Samsung 850 Pro @ 500MB/s transferring large 8GB files over. I recommend disabling "Interrupt Moderation" on the Intel 10Gbe adapter if you want to go fast. I'm also running Jumbo Frames on that link. I think multipathing only benefits multiple connections.. you will never see a single connection exceed what a single link is capable of... you won't ever see anything much greater than 125mb/s on a single file copy regardless of how you bond 1Gbe adapters.. seems counter-intuitive but thats my understanding.

here is a video of me playing around with my 10Gbe link attempting to saturate the connection. (jump to around 6 mins)

 

[Ben Bliss]

I'm getting a bit over 1GB per second transfer rate over my 10Gbe connection.. network transfer speed (RAM to RAM transfer speed). It has no problem keeping up with my Samsung 850 Pro @ 500MB/s transferring large 8GB files over. I recommend disabling "Interrupt Moderation" on the Intel 10Gbe adapter if you want to go fast. I'm also running Jumbo Frames on that link.

I should have quoted the op as that was where my reply was directed.


Sent from my iPhone using Tapatalk

 

[RchGrav]

I should have quoted the op as that was where my reply was directed.


Sent from my iPhone using Tapatalk

I added some other info re Multipathing & iSCSI..