Burnin During Build

[rfielder]

Spent the time today removing lots of bits and pieces from an old Lian Li case today, so that I can start building my FreeNAS box tomorrow.

First steps are to install the motherboard, CPU and RAM.

Next step is to see if they boot.

Next step is to run Memtest, to verify the memory. I thin this can be done before adding drives or anything, as long as the system will boot from USB.

Burn in test have been mentioned here, and elsewhere. Can someone point me to a list of apps or a guide to doing burnin? This part of building a system is new to me, and I would to be as thorough as possible.

Thanks in advance!

 

[Redcoat]

Try the Resource section from the masthead - see https://www.ixsystems.com/community/resources/building-burn-in-and-testing-your-freenas-system.38/ and https://www.ixsystems.com/community/resources/uncle-festers-freenas-beginners-guide.120/ for starters.

"Search" on the masthead should be able to help you if you need more.

 

[rfielder]

Redcoat - thanks!

The server booted successfully, so I am ready through your stuff to see what can be done.

I am surprised that I can not find a page in the bios which shows CPU temps, etc. First time I have not seen one of these - or maybe just not been able to find it. Then again, first time booting a Supermimcro product, and first time booting a server class motherboard. Lots of settings I don't understand, which was expected.

 

[myoung]

Redcoat - thanks!

The server booted successfully, so I am ready through your stuff to see what can be done.

I am surprised that I can not find a page in the bios which shows CPU temps, etc. First time I have not seen one of these - or maybe just not been able to find it. Then again, first time booting a Supermimcro product, and first time booting a server class motherboard. Lots of settings I don't understand, which was expected.

Server class motherboards usually have BMC/IPMI for monitoring temps, fan speeds etc. You haven't mentioned your motherboard model, but I think most Supermicro boards have IPMI. There should be an ethernet port dedicated to IPMI connections. Plug it in to your network, and you should be able to find all that info in the IPMI web interface. Once you have FreeNAS installed, you can use ipmitool from the cli to monitor as well.

Code:

# ipmitool sensor list all
CPU1 Temp        | 42.000     | degrees C  | ok    | 0.000     | 0.000     | 0.000     | 90.000    | 93.000    | 95.000
CPU2 Temp        | 44.000     | degrees C  | ok    | 0.000     | 0.000     | 0.000     | 90.000    | 93.000    | 95.000
System Temp      | 39.000     | degrees C  | ok    | -9.000    | -7.000    | -5.000    | 80.000    | 85.000    | 90.000
Peripheral Temp  | 42.000     | degrees C  | ok    | -9.000    | -7.000    | -5.000    | 80.000    | 85.000    | 90.000
PCH Temp         | 46.000     | degrees C  | ok    | -11.000   | -8.000    | -5.000    | 90.000    | 95.000    | 100.000
P1-DIMMA1 TEMP   | 38.000     | degrees C  | ok    | 1.000     | 2.000     | 4.000     | 80.000    | 85.000    | 90.000
P1-DIMMA2 TEMP   | na         |            | na    | na        | na        | na        | na        | na        | na
P1-DIMMB1 TEMP   | 39.000     | degrees C  | ok    | 1.000     | 2.000     | 4.000     | 80.000    | 85.000    | 90.000
P1-DIMMB2 TEMP   | na         |            | na    | na        | na        | na        | na        | na        | na
P1-DIMMC1 TEMP   | 36.000     | degrees C  | ok    | 1.000     | 2.000     | 4.000     | 80.000    | 85.000    | 90.000
P1-DIMMC2 TEMP   | na         |            | na    | na        | na        | na        | na        | na        | na
P1-DIMMD1 TEMP   | 37.000     | degrees C  | ok    | 1.000     | 2.000     | 4.000     | 80.000    | 85.000    | 90.000
P1-DIMMD2 TEMP   | na         |            | na    | na        | na        | na        | na        | na        | na
P2-DIMME1 TEMP   | 40.000     | degrees C  | ok    | 1.000     | 2.000     | 4.000     | 80.000    | 85.000    | 90.000
P2-DIMME2 TEMP   | na         |            | na    | na        | na        | na        | na        | na        | na
P2-DIMMF1 TEMP   | 41.000     | degrees C  | ok    | 1.000     | 2.000     | 4.000     | 80.000    | 85.000    | 90.000
P2-DIMMF2 TEMP   | na         |            | na    | na        | na        | na        | na        | na        | na
P2-DIMMG1 TEMP   | 39.000     | degrees C  | ok    | 1.000     | 2.000     | 4.000     | 80.000    | 85.000    | 90.000
P2-DIMMG2 TEMP   | na         |            | na    | na        | na        | na        | na        | na        | na
P2-DIMMH1 TEMP   | 39.000     | degrees C  | ok    | 1.000     | 2.000     | 4.000     | 80.000    | 85.000    | 90.000
P2-DIMMH2 TEMP   | na         |            | na    | na        | na        | na        | na        | na        | na
FAN1             | 9225.000   | RPM        | ok    | 300.000   | 450.000   | 600.000   | 18975.000 | 19050.000 | 19125.000
FAN2             | 9825.000   | RPM        | ok    | 300.000   | 450.000   | 600.000   | 18975.000 | 19050.000 | 19125.000
FAN3             | 9225.000   | RPM        | ok    | 300.000   | 450.000   | 600.000   | 18975.000 | 19050.000 | 19125.000
FAN4             | 9750.000   | RPM        | ok    | 300.000   | 450.000   | 600.000   | 18975.000 | 19050.000 | 19125.000
FAN5             | 9150.000   | RPM        | ok    | 300.000   | 450.000   | 600.000   | 18975.000 | 19050.000 | 19125.000
FAN6             | 9675.000   | RPM        | ok    | 300.000   | 450.000   | 600.000   | 18975.000 | 19050.000 | 19125.000
FAN7             | 9000.000   | RPM        | ok    | 300.000   | 450.000   | 600.000   | 18975.000 | 19050.000 | 19125.000
FAN8             | na         |            | na    | na        | na        | na        | na        | na        | na
VTT              | 0.992      | Volts      | ok    | 0.816     | 0.864     | 0.912     | 1.344     | 1.392     | 1.440
CPU1 Vcore       | 0.816      | Volts      | ok    | 0.480     | 0.512     | 0.544     | 1.488     | 1.520     | 1.552
CPU2 Vcore       | 0.800      | Volts      | ok    | 0.480     | 0.512     | 0.544     | 1.488     | 1.520     | 1.552
VDIMM AB         | 1.472      | Volts      | ok    | 1.104     | 1.152     | 1.200     | 1.648     | 1.696     | 1.744
VDIMM CD         | 1.472      | Volts      | ok    | 1.104     | 1.152     | 1.200     | 1.648     | 1.696     | 1.744
VDIMM EF         | 1.472      | Volts      | ok    | 1.104     | 1.152     | 1.200     | 1.648     | 1.696     | 1.744
VDIMM GH         | 1.472      | Volts      | ok    | 1.104     | 1.152     | 1.200     | 1.648     | 1.696     | 1.744
+1.5 V           | 1.472      | Volts      | ok    | 1.248     | 1.296     | 1.344     | 1.648     | 1.696     | 1.744
3.3V             | 3.312      | Volts      | ok    | 2.640     | 2.784     | 2.928     | 3.648     | 3.792     | 3.936
+3.3VSB          | 3.312      | Volts      | ok    | 2.640     | 2.784     | 2.928     | 3.648     | 3.792     | 3.936
5V               | 4.928      | Volts      | ok    | 4.096     | 4.288     | 4.480     | 5.504     | 5.696     | 6.912
12V              | 11.872     | Volts      | ok    | 10.176    | 10.494    | 10.812    | 13.250    | 13.568    | 13.886
VBAT             | 3.168      | Volts      | ok    | 2.400     | 2.544     | 2.688     | 3.312     | 3.456     | 3.600
HDD Status       | 0x0        | discrete   | 0x0000| na        | na        | na        | na        | na        | na
Chassis Intru    | 0x1        | discrete   | 0x0100| na        | na        | na        | na        | na        | na
PS1 Status       | 0x1        | discrete   | 0x0100| na        | na        | na        | na        | na        | na
PS2 Status       | 0x1        | discrete   | 0x0100| na        | na        | na        | na        | na        | na
PS3 Status       | 0x1        | discrete   | 0x0100| na        | na        | na        | na        | na        | na

 

[rfielder]

Server class motherboards usually have BMC/IPMI for monitoring temps, fan speeds etc. You haven't mentioned your motherboard model, but I think most Supermicro boards have IPMI. There should be an ethernet port dedicated to IPMI connections. Plug it in to your network, and you should be able to find all that info in the IPMI web interface.

There is IPMI stuff on this motherboard, including on ethernet port.

How do I find it, once plugged into my network? There is nothing set for IP address at this point, and I don't recall seeing anyplace to set an address in the BIOS.

At one point during boot, it does show IP 0.0.0.0, but I don't see how that can be used.

 

[Redcoat]

There is IPMI stuff on this motherboard, including on ethernet port.

Do please tell us which SM motherboard you have so we can be sure that our advice is relevant.

How do I find it, once plugged into my network?

I assume that your router is acting as a DHCP server. Look at its allocation table and you should be able to see what IP address has been allocated to your MB's Ethernet port and /or the IPMI port (whichever one((s) you have an Ethernet cable plugged in to). I recommend that you reserve an IP address specifically for the server and IPMI ports (one each) against their MAC addresses - I assume that your router offers that facility - this essentially provides static IP addresses to these without requiring you to specify them in the BIOS.

 

[rfielder]

Do please tell us which SM motherboard you have so we can be sure that our advice is relevant.

My apologies - this should have been posted from the start.

Supermicro X11SSH-F-O with a Xeon E3-1245V2 processor.

Yes, one of the ethernet ports is flagged as an IPMI port.

I assume that your router is acting as a DHCP server. Look at its allocation table and you should be able to see what IP address has been allocated to your MB's Ethernet port and /or the IPMI port (whichever one((s) you have an Ethernet cable plugged in to). I recommend that you reserve an IP address specifically for the server and IPMI ports (one each) against their MAC addresses - I assume that your router offers that facility - this essentially provides static IP addresses to these without requiring you to specify them in the BIOS.

Yes, to all the above.

Thank you for the advice, and your patience in explaining things that are likely otherwise considered basic knowledge around here.

My testing has hit a roadblock - the MB requires all power connectors to be attached. The power supply I was using is old, and does not have the connector for JPWR2, the +12V 8-pin CPU power. The system boots without it, but I will wait until I can pick up a new power supply.

This is what happens when you try to recycle an old system that is actually still in perfect working condition.....

 

[ethereal]

My apologies - this should have been posted from the start.

Supermicro X11SSH-F-O with a Xeon E3-1245V2 processor.

Yes, one of the ethernet ports is flagged as an IPMI port.


Yes, to all the above.

Thank you for the advice, and your patience in explaining things that are likely otherwise considered basic knowledge around here.

My testing has hit a roadblock - the MB requires all power connectors to be attached. The power supply I was using is old, and does not have the connector for JPWR2, the +12V 8-pin CPU power. The system boots without it, but I will wait until I can pick up a new power supply.

This is what happens when you try to recycle an old system that is actually still in perfect working condition.....

i can't find anything at the moment but i think you can damage your m/b if you don't have all the power connected.
i'm sure somebody said that you cannot rma to supermicro if you have not connected the m/b correctly.
so supermicro think this could damage the m/b.

i'd definitely get a proper psu

 

[rfielder]

i can't find anything at the moment but i think you can damage your m/b if you don't have all the power connected.
i'm sure somebody said that you cannot rma to supermicro if you have not connected the m/b correctly.
so supermicro think this could damage the m/b.

i'd definitely get a proper psu

That will be purchased this afternoon. Old power supply is now in the recycle bin.

Just a side-whine - I am disposing of SO MANY working parts! Motherboards, cpus, ram, add in cards, power supplies, all working well, but old.

It gets depressing - all this stuff that can build functional computers that work and would likely be reliable, but can no longer do what we need.

Such is the cycle of life - in the computer field.

With effort and thought, at least we can ensure that the same does not befall us!