10GB adaptor Choice?

[sheld0r]

Hey all,

We are finally moving to a 10GB SAN network, and I was just wondering what 10GB NICs you guys recommend? I'm stuck around the $450.00 per NIC budget.

So far I've come across a few, such as Emulex, QLogic, Intel, and Supermicro. I've mainly focused on the Emulex and Supermicro. The Supermicro AOC-STGN-I2S Dual port 10GB adaptor would go in my Supermicro 846E16-R1200B w/ the X10DRi mobo. And the Emulex OCE14101-NX single port adaptor.

We are running a Server 2012 R2 Hyper-V environment. We'll also have a couple FreeNAS arrays in the mix too.

I was just looking for some advice and direction on 10GB adaptors.

Cheers,

 

[cyberjock]

The only cards I can vouch that work properly and completely are the Intel and Chelsio. The Chelsio cards will give you a true 10Gb throughput, but they are about $1k each... used. The Intel cards will only give you 8-9Gb/sec and can be purchased for $75-$150 used. Keep in mind that Intel's are often rebranded as other models, so buying from ebay (which is how I got my Intel 10Gb card) can require some searching if you are looking for the absolute cheapest price.

 

[bestboy]

When this topic comes up, then there are usually only 2 names: Chelsio and Intel.

Chelsio NICs are the go-to solution. They are also used for the TrueNAS products and are well tested.

Intel NICs were supported for a long time but had driver problems. With 9.2.1.8 these issues have been resolved and Intel NICs should be ok now, too.

 

[sheld0r]

I see the Chelsio are quite pricey, but as you guys stated there is a reason for it. You get the true performance. This might take some convincing upstairs. You guys know how it goes, they always challenge us on cost but they want the best performance.

I found the Intel X520-DA2 adaptor for $385.00(new). I'm just a little worried, as I don't want to order the wrong card and get poor performance. Because you truly get what you pay for, but my hands are tied on that cost.

Thanks for pointing me in the right direction guys!

 

[cyberjock]

You can't buy from ebay used? No joke, most people around here go that route because the cost is so low. At $75 you could buy 5 cards used for the price of the 1 new.

 

[sheld0r]

I was trying to avoid it, just because I figured it be best to buy the cards new at least. We did purchase the switched used, but that was a large cost even used. You've had no issues getting used cards? I'm just a little paranoid releasing used adaptors into production. I trust Cisco stuff used. I'm just being cautious. Maybe I should, we would save quite a bit of money.

 

[cyberjock]

I'm not worried about used, especially when you see the price differential. If it were just $100 different I'd recommend new. But we're talking 1/5th the cost. ;)

 

[Ericloewe]

I'm not worried about used, especially when you see the price differential. If it were just $100 different I'd recommend new. But we're talking 1/5th the cost. ;)

Well, 1/4 after you account for time spent screening for fakes that fell off a truck behind the shadiest alley of the shadiest block in Shenzhen. Still worth it in most scenarios.

 

[cyberjock]

Honestly, many people have bought Intel cards from ebay and such, and I think we've only had one case of a bad NIC. Even then, it was never proven to be a fake or anything.

 

[vikingboy]

The Chelsio cards will give you a true 10Gb throughput, but they are about $1k each... used. The Intel cards will only give you 8-9Gb/sec and can be purchased for $75-$150 used.

The Intel x520 can hit 9gbps+ under Freenas with some slight tweaking IME. Its a no brainer with the cost differences pointed out by CJ ^^^^

 

[sheld0r]

So now that I'm settled on the Intel X520-DA2, it appears I might get a surprise with the SFP+ Twinaxial cable. From my understanding I want to make sure the Twinaxial cable I choose is compliant with SFF 8431. So I was looking at going with the Cisco brand(SFP-H10GB-CU5M) or Intel brand(XDACBL5M) to be safe in terms of compatibility. I came across some other older forums where people had issues with the Cisco cables on Intel cards, and issues with Intel cables on the Cisco switches. Go figure! I was just wonder what Twinaxial cables you guys run on the Nexus 5ks?

I found Diablo, Startech, and Trip-lite cables too. I really thought if it complies by the SFF-8431 standard, they would work. I'm just worried I get the cables and plug them into the adaptors and switch, and one end doesn't work.

 

[cyberjock]

I bought mine from Monoprice and they worked.. LOL.

 

[sheld0r]

I bought mine from Monoprice and they worked.. LOL.

What brand though? And you have them connected to a Nexus 5k?

 

[cyberjock]

I didn't connect it to a Nexus 5k. It was Monoprice brand if I remember correctly. I can't give models or parts since I'm not at home to check for you. :/

 

[sheld0r]

No worries. I appreciate all the help and advice, I can't thank you enough.

 

[Mlovelace]

I have the Intel X520-da2 connected with the Intel twinax cable XDACBL3M to an extreme networks x670v-48x and get about 8300-8400 Mbits/sec. The switch port shows an unknown sfp carrier but it hasn't had any problems. I also have the Chelsio T520-CR connected with an extreme networks twinax 10305 cable to the x670v-48x and I get 9700+ Mbits/sec. If you ask me the extra speed isn't really worth the price difference, but at the time the Chelsio cards were the only ones known not to have issues.

Edit: I have seen several posts here suggesting the Solarflare SFN 5162F as an alternative to the Chelsio. I don't have any experience with them but they cost a bit less then the Intel. Solarflare SFN5162F Dual Port 10GbE SFP+ Server Adapter http://www.newegg.com/Product/Product.aspx?Item=33-615-007

 

[jgreco]

Note to those buying X520's (or various other Intel products), there should be a Yottamark sticker on it that'll help authenticate the card as genuine.

 

[sheld0r]

Note to those buying X520's (or various other Intel products), there should be a Yottamark sticker on it that'll help authenticate the card as genuine.

You are absolutely correct jgreco!! We just got in the 10GB adaptors, and I see the verify.yottamark.com blue sparkling sticker :) Thanks for informing us about that, as I know many vendors try to cheat you on the card.

 

[jgreco]

Check the country, datecode, and MAC address Yottamark gives you, don't just blindly trust it.

 

[sheld0r]

Check the country, datecode, and MAC address Yottamark gives you, don't just blindly trust it.

Oh most definitely, I checked all 10 of them!