BUILD Supermicro X9SRL-F Build Check

[jgreco]

The Idea I came up with myself, because I didn't like the active cooler idea. If you seen supermicro shipping that cooler with 1600 CPU in already build server it's easy to put the idea together, that these two will work , but is not something that is documented by them, and here are the too methods I used:

1. I went on their website http://www.supermicro.com/ResourceApps/Heatsink_Matrix.aspx and looked all cpu coolers for socket 2011 and the only option for 1600 was SNK-P0048AP4 not SNK-P0048P. I added picture so you can see yourself.

2. I contacted supermicro to ask them , and they send me this file.Here is the pic of that too.

So these are the only 2 options I know and use to get the ideas for the heatsink for 1620 v2 and non of them indicates the possibility of using passive heatsink for 2u.

Am I missing something ? Was there 3th option I neglected to check ?

Don't know. I walked through what would have probably happened here.

 

[Black Ninja]

By the way. I notice X9SRL-F has 4 SKU sata2 ports. What are these ports ? It seem they are not part of Intel chipset(2xSata3 and 4xSAta2)

All I was able to find out is that they are additional sata 2 ports that can't be used to cd-roms. Should I use them or disable in BIOS?

 

[jgreco]

That is true in this example.(see how I agree with you when you are right):) BUT
Here is another example based on actual events:
My freenas in my signature had 2x800W PSUs(not even silver rated). On idle my freenas with only 1 ssd was around 80W , when I put 2x500W Platinum PSUs on the same machine power on idle was 47W. That are actual facts.

Besides the power efficiency for the load attached , the platinum 500W PSU's had different fans(single), that were 3 times more quiet and burn less watts compared to the fans(dual) that 800W had. So that factor came in play to make such a huge difference on power consumption.

Not that unusual. I've been advocating high efficiency supplies for years. I don't even really care that much if they ever cover the additional capex, it's the opex savings I like.

You have to remember that the efficiency of EACH of those 800W PSU's is pretty poor when running at a low wattage, because you're not expected to do that "silly thing" (run at low wattage). Then you're running both PSU's in parallel, effectively putting half the load again on each, which results in your running a ~40 watt load on 1600 watts of PSU. That's around 2.5% loading, which is just way too low, especially for a non-high-efficiency PSU.

 

[jgreco]

By the way. I notice X9SRL-F has 4 SKU sata2 ports. What are these ports ? It seem they are not part of Intel chipset(2xSata3 and 4xSAta2)

All I was able to find out is that they are additional sata 2 ports that can't be used to cd-roms. Should I use them or disable in BIOS?

The SATA2 ports are driven by the C602 PCH's Storage Controller Unit (SCU). See section 5.18. The C602 does not support SAS, alas.

 

[Black Ninja]

Not that unusual. I've been advocating high efficiency supplies for years. I don't even really care that much if they ever cover the additional capex, it's the opex savings I like.

You have to remember that the efficiency of EACH of those 800W PSU's is pretty poor when running at a low wattage, because you're not expected to do that "silly thing" (run at low wattage). Then you're running both PSU's in parallel, effectively putting half the load again on each, which results in your running a ~40 watt load on 1600 watts of PSU. That's around 2.5% loading, which is just way too low, especially for a non-high-efficiency PSU.

And the twin turbo fans on older 800W PSU ads probably 30W and lot more noise compareto to single quiet fans on new 500W Platinum PSU. I just got it new with 800W older PSU on great deal , and cause I knew it has the same power distributor like the with platinum PSU I just purchase 2 platinum 500W PSUs, swap the old 800W PSU and still save a bunch.

My idea of efficiency is so I can run more servers for the same money. Not to lower the bill with $2-3 but when you add switches andetc. thing adds up. My router which is 1u server 16GB ram burns 22W. It's not a good idea to get old poweredge 2950 for almost nothing from ebay with redundant hdds and used it as router burning 200W.

 

[Black Ninja]

The SATA2 ports are driven by the C602 PCH's Storage Controller Unit (SCU). See section 5.18. The C602 does not support SAS, alas.

I'll read that. On new Windows 2008 r2 install it shows as unknown SAS controler ?!?
In a nutshell are you using these ports ? Are they any good ?

 

[Ericloewe]

I'll read that. On new Windows 2008 r2 install it shows as unknown SAS controler ?!?
In a nutshell are you using these ports ? Are they any good ?

Intel SATA. It's 3Gb/s only, but it'll work well, unlike "6Gb/s" Marvell.

 

[Black Ninja]

Intel SATA. It's 3Gb/s only, but it'll work well, unlike "6Gb/s" Marvell.

I was gonna say that on my desktop (Socket 2011)I have 2 additional Sata6(more like sata4 in reality) on ASMedia controller but not impressed either.
So this one is as good as the other 4 sata2 on the Intel chipset ?

 

[Ericloewe]

I was gonna say that on my desktop (Socket 2011)I have 2 additional Sata6(more like sata4 in reality) on ASMedia controller but not impressed either.
So this one is as good as the other 4 sata2 on the Intel chipset ?

If I still have my Sandy Bridge-EP PCH knowledge right, there's something like up to 10 SATA ports (max. 2 6Gb/s), all from the same controller. So yeah.

 

[Black Ninja]

Are these ports good for freenas ? Good I mean as far as stability and driver support out of the box goes?

 

[Black Ninja]

The passive cooler works great. (X9SRL-F with 1620 v2) I've prime95 it for 2 hours and max core temp I got was 70 C. I call that great success on the cooling part. Probably even better than the active cooler since it's almost half it's size.

 

[Black Ninja]

I borrow 2 sticks of memory (Kingston KVR16E11/8) from another machine just so I can assemble my X9SRL-F and 1620 v2 just to see if they work , before the 30 days return are gone. Now I have to give the memory back and order the proper 64GB memory for this machine.

I know I have been asking this a lot, but I promise it's almost over.:)
Now I understand it has to be registered ecc, not LRDIMM (thanks for pointing that out). I narrow it down to just to few more choices 1.5V or Low Voltage 1.35V and 1600Mhz or 1866Mhz.

What would you get jgreco if you were me ? I promises I'll help you steal Christmas in return, when the time comes.:D

 

[jgreco]

Are these ports good for freenas ? Good I mean as far as stability and driver support out of the box goes?

They should be fine.

The passive cooler works great. (X9SRL-F with 1620 v2) I've prime95 it for 2 hours and max core temp I got was 70 C. I call that great success on the cooling part. Probably even better than the active cooler since it's almost half it's size.

Yeah, passive coolers are great, when used correctly. I was looking at options for socket 1155 in a 1U this morning and happened across the following reviews on NewEgg:

http://www.newegg.com/Product/Product.aspx?Item=N82E16835114095

Two out of three reviewers == morons trying to use it for something other than the intended application, and are idiotic enough to post bad reviews when it doesn't work the way they want.

I swear, some of the reviews I see, I just sit here muttering "moron..." "idiot..." "retard..!"

I have absolutely nothing against abusing a product in a way that it wasn't designed for, but when you start posting reviews based on your own idiocy causing failures, you're a waste of space.

 

[jgreco]

I borrow 2 sticks of memory (Kingston KVR16E11/8) from another machine just so I can assemble my X9SRL-F and 1620 v2 just to see if they work , before the 30 days return are gone. Now I have to give the memory back and order the proper 64GB memory for this machine.

I know I have been asking this a lot, but I promise it's almost over.:)
Now I understand it has to be registered ecc, not LRDIMM (thanks for pointing that out). I narrow it down to just to few more choices 1.5V or Low Voltage 1.35V and 1600Mhz or 1866Mhz.

What would you get jgreco if you were me ? I promises I'll help you steal Christmas in return, when the time comes.:D

The low voltage 1.35v and 1866 are probably preferable, but I seem to recall that there's not much in the way of DDR3L (1.35v) for 1866. 1600 is probably fine, that might be something like

http://www.amazon.com/dp/B008BPYKPM/?tag=ozlp-20

Your DDR3-1866 part is probably

http://www.memoryamerica.com/16gb-1866mhz-ecc-registered-1-5v-2rx4-mem-dr316l-sl03-er18-memory.html

Look at that, Supermicro approved and $84 per 16GB. Not bad.

 

[Black Ninja]

Yeah, passive coolers are great, when used correctly. I was looking at options for socket 1155 in a 1U this morning and happened across the following reviews on NewEgg:

http://www.newegg.com/Product/Product.aspx?Item=N82E16835114095

What I coincidence. I did look the same product a year ago and bought it.
My intention was to be able to bring my 1155 in 1u around 3-4 Degrees down compared to the stock supermicro 1u heatsink. What happened was the oposit: My CPU (1230 v2) temp when up 3-4 Degrees C instead of down. So despite the look , being copper and the specs from manufacture web(you read them too I am sure), I can guarantee you that the supermicro 1u stock cooler for 1155 will cool better. Dont buy it you can have mine.

 

[Black Ninja]

The low voltage 1.35v and 1866 are probably preferable, but I seem to recall that there's not much in the way of DDR3L (1.35v) for 1866. 1600 is probably fine, that might be something like

http://www.amazon.com/dp/B008BPYKPM/?tag=ozlp-20

Your DDR3-1866 part is probably

http://www.memoryamerica.com/16gb-1866mhz-ecc-registered-1-5v-2rx4-mem-dr316l-sl03-er18-memory.html

Look at that, Supermicro approved and $84 per 16GB. Not bad.

Thank you for the reply on this very important matter for me.
I just never had a 1.35V memory ( except my router-atom) and always scared that will run slower. Like the way CPU is , you know low volts (1220L) make it huuuuuuuge difference on speed.

So basically you are saying that with memory going 1.35V it will not have any penalty on speed or reliability ?

 

[Bidule0hm]

It's the same chips... they are tested at the factory: the ones who works ok with 1.35 V or less are sold as 1.35 V and the others as 1.5 V sticks :)

So the 1.35 V sticks should be better quality and they are the same regarding the perfs ;)

 

[Black Ninja]

It's the same chips... they are tested at the factory: the ones who works ok with 1.35 V or less are sold as 1.35 V and the others as 1.5 V sticks :)

So the 1.35 V sticks should be better quality and they are the same regarding the perfs ;)

Thanks a lot

 

[Bidule0hm]

Bonus if you take the 1.35 V ones: you can still use them at 1.5 V ;)

 

[Black Ninja]

Bonus if you take the 1.35 V ones: you can still use them at 1.5 V ;)

That's what I read:

Low Voltage (LV) DDR3 operates at 1.35 volts or 1.5 volts. At 1.35 volts the memory can consume less power and reduce heat, but can still be boosted to 1.5V when the memory channel requires additional voltage to help maintain maximum speed. With the introduction of our 13th-generation servers.

I hope this boosting it will not cause latency like CPU clock boosting.