just a heads up, finally ASUS w680 available.

[Davvo]

Unfortunately I am not getting past the first step
admin@tn1[~]$ kldload ipmi.ko
zsh: command not found: kldload
I'm on Trueness scale, maybe this was written for core?

Just skip that step, on X11 (and I suppose newer) boards it's not needed.

 

[Ericloewe]

It's not a Hardware thing, IIRC some people back in the day had the module disabled (9.2 days, so ancient history). Both Core and Scale should ship with full IPMI support out of the box.

 

[a.dresner]

Having never looked at this before... bummed

admin@tn1[~]$ ipmitool sensor list all
Could not open device at /dev/ipmi0 or /dev/ipmi/0 or /dev/ipmidev/0: No such file or directory
admin@tn1[~]$

 

[a.dresner]

got it, had to sudo

Code:

admin@tn1[~]$ sudo ipmitool sensor list all
CPU Temp         | 26.000     | degrees C  | ok    | 5.000     | 5.000     | na        | na        | 100.000   | 100.000
Inlet Temp       | na         |            | na    | na        | na        | na        | na        | na        | na     
PCH Temp         | 38.000     | degrees C  | ok    | 5.000     | 5.000     | na        | na        | 90.000    | 105.000
System Temp      | 24.000     | degrees C  | ok    | 5.000     | 5.000     | na        | na        | 85.000    | 90.000 
Peripheral Temp  | 26.000     | degrees C  | ok    | 5.000     | 5.000     | na        | na        | 85.000    | 90.000 
CPU_VRMIN Temp   | 23.000     | degrees C  | ok    | 5.000     | 5.000     | na        | na        | 100.000   | 105.000
CPU_VRMIO Temp   | 26.000     | degrees C  | ok    | 5.000     | 5.000     | na        | na        | 100.000   | 105.000
M2SSD1 Temp      | na         |            | na    | na        | na        | na        | na        | na        | na     
DIMMAB Temp      | 26.000     | degrees C  | ok    | 5.000     | 5.000     | na        | na        | 85.000    | 90.000 
FAN1             | 1960.000   | RPM        | ok    | 280.000   | 420.000   | na        | na        | 35560.000 | 35700.000
FAN2             | 1960.000   | RPM        | ok    | 280.000   | 420.000   | na        | na        | 35560.000 | 35700.000
FAN3             | 1960.000   | RPM        | ok    | 280.000   | 420.000   | na        | na        | 35560.000 | 35700.000
FAN4             | 1260.000   | RPM        | ok    | 280.000   | 420.000   | na        | na        | 35560.000 | 35700.000
FANA             | 1960.000   | RPM        | ok    | 280.000   | 420.000   | na        | na        | 35560.000 | 35700.000
FANB             | 1960.000   | RPM        | ok    | 280.000   | 420.000   | na        | na        | 35560.000 | 35700.000
12V              | 11.920     | Volts      | ok    | 10.900    | 10.815    | na        | na        | 13.280    | 13.195 
5VCC             | 4.952      | Volts      | ok    | 4.573     | 4.573     | na        | na        | 5.541     | 5.583   
3.3VCC           | 3.275      | Volts      | ok    | 2.994     | 2.971     | na        | na        | 3.650     | 3.650   
VBAT             | 0x4        | discrete   | 0x0400| na        | na        | na        | na        | na        | na     
5VSB             | 4.948      | Volts      | ok    | 4.485     | 4.485     | na        | na        | 5.495     | 5.495   
3.3VSB           | 3.306      | Volts      | ok    | 2.977     | 3.000     | na        | na        | 3.635     | 3.635   
1.8V PCH         | 1.791      | Volts      | ok    | 1.635     | 1.635     | na        | na        | 1.973     | 1.973   
PVNN PCH         | 1.789      | Volts      | ok    | 1.620     | 1.620     | na        | na        | 1.984     | 1.971   
1.05V PCH        | 1.051      | Volts      | ok    | 0.943     | 0.943     | na        | na        | 1.149     | 1.149   
2.5V BMC         | 2.555      | Volts      | ok    | 2.263     | 2.243     | na        | na        | 2.770     | 2.770   
1.8V BMC         | 1.810      | Volts      | ok    | 1.641     | 1.641     | na        | na        | 1.992     | 2.005   
P1V2_VDDQ        | 1.201      | Volts      | ok    | 1.084     | 1.084     | na        | na        | 1.319     | 1.329   
PVCC_CPU         | 0.385      | Volts      | ok    | 0.013     | 0.013     | na        | na        | 1.894     | 1.894   
P3V3_BMC_RGM     | 3.351      | Volts      | ok    | 3.000     | 3.000     | na        | na        | 3.655     | 3.655   
PVCC_VCCSA       | 0.984      | Volts      | ok    | 0.013     | 0.013     | na        | na        | 1.669     | 1.669   
PVCC_VCCIO       | 1.055      | Volts      | ok    | 0.006     | 0.006     | na        | na        | 1.163     | 1.163   
Chassis Intru    | 0x0        | discrete   | 0x0000| na        | na        | na        | na        | na        | na

So happy ... my ears!! thank you

 

[Ericloewe]

Weird, I would have expected a more mundane "permission denied" message.

 

[a.dresner]

Weird, I would have expected a more mundane "permission denied" message.

Don't know, was trying to do it without thinking and finally had some free time tonight to plug away at it. Was a bit nervous but after testing one sensor, I couldn't change the rest fast enough.

 

[a.dresner]

Back to the discussion about this Asus board, it's now in its box and on a shelf. I replaced it with a much better designed Supermicro X13SAE-F-O which has BMC/IMPI that actually works. The Asus BMC/IMPI was awful to implement with that separate card and the remote console didn't work after installing a GPU. Finally got tired of having to reset the CMOS all the time, unable to Remote Desktop, it was so unreliable..no trust. The Asus experiment comes to an end for me.

 

[Daniel15]

Like so many before me, looking to lower those thresholds and adjust fan speeds to decrease noise.

On the Asus board, you can adjust alert thresholds through the IPMI web interface. I have a Noctua NH-D15 CPU cooler and its fans only spin at 480RPM at the slowest speed. The default threshold was not happy with that :)

You can also adjust fan curves in the IPMI by going to Settings then Fan Control then Customized.

The Asus BMC/IMPI was awful to implement with that separate card

IPMI on the MicroATX version seems to work well, but on that board it's integrated into the motherboard instead of being a separate card.

the remote console didn't work after installing a GPU

This is common even with Supermicro boards (1, 2). The issue is that the IPMI only sees content rendered using its onboard graphics chip - there's physically no way for it to get the video output from the GPU. If the GPU is your primary video output, nothing will be rendered via the IPMI, and thus the remote console will be blank. You need to either configure the BIOS to use the IPMI's display adapter as the default screen, or enable the dual screen mode so that it outputs to both the GPU and the onboard graphics at the same time.

 

[mtl]

Anyone have success with 128GB of RAM? I thought max is 128GB and should be a given? I installed 4 32GB of ECC RAM and it could not work... not sure if its the last RAM slot or what cause i tried to test out 2 slots at a time and found one of the slots some how register code 55 - no ram.

 

[a.dresner]

128GB worked for me

 

[mtl]

Looks like i might be having a slot issue, tested all RAMS from Micron all working, all slots tested seems the last one B2 slot is causing the 55 error. Waiting to hear Asus reply.

 

[mmokrejs]

Anyone have success with 128GB of RAM? I thought max is 128GB and should be a given? I installed 4 32GB of ECC RAM and it could not work... not sure if its the last RAM slot or what cause i tried to test out 2 slots at a time and found one of the slots some how register code 55 - no ram.

In ASUS W680-ACE IPMI works for me:
Kingston FURY BEAST KF556C40BBK2-64 1.25V https://www.kingston.com/datasheets/KF556C40BBK2-64.pdf

 

[chmod777]

Looks like i might be having a slot issue, tested all RAMS from Micron all working, all slots tested seems the last one B2 slot is causing the 55 error. Waiting to hear Asus reply.

That is too bad. This board or the Supermicro is what I am giving strong consideration too but also with 128GB of ECC memory. Asus told me the newest 14th gen refresh is not supported, but I don't know if they will update that since the socket is the same. I am having a hard time figuring out exactly what performance I need for what I plan to do in the next year. Let us know if you fix that 55 error. I don't know if this is useful but in another forum someone said "error 55 is Memory not installed, error 53 Memory initialization error. " Have you tried every memory module in that slot giving issues to rule out a module or rule out the slot?

 

[Kharig]

Hi there, it looks like ASUS updated the BIOS to support 14th gen in their latest 2802 version (link):
PRO WS W680-ACE BIOS
Version 2802
1. Update Microcode for Intel® Core™ 14th gen processors
2. Update ME to version 16.1.30.2264 for Intel® Core™ 14th gen processors

That is too bad. This board or the Supermicro is what I am giving strong consideration too but also with 128GB of ECC memory. Asus told me the newest 14th gen refresh is not supported, but I don't know if they will update that since the socket is the same. I am having a hard time figuring out exactly what performance I need for what I plan to do in the next year. Let us know if you fix that 55 error. I don't know if this is useful but in another forum someone said "error 55 is Memory not installed, error 53 Memory initialization error. " Have you tried every memory module in that slot giving issues to rule out a module or rule out the slot?

 

[chmod777]

Hi there, it looks like ASUS updated the BIOS to support 14th gen in their latest 2802 version (link):
PRO WS W680-ACE BIOS
Version 2802
1. Update Microcode for Intel® Core™ 14th gen processors
2. Update ME to version 16.1.30.2264 for Intel® Core™ 14th gen processors

Thanks for confirming. This board is a strong contender for me along with the Supermicro.

 

[Etorix]

But what's the use case for a last generation Core CPU in a NAS? For serving files, it's massive overkill. And for a so-called "hyperconverged" server with many services alongside NAS duties, EPYC or previous generation Xeon Scalable with lots of DDR4 RDIMM both look more attractive.

 

[chmod777]

But what's the use case for a last generation Core CPU in a NAS? For serving files, it's massive overkill. And for a so-called "hyperconverged" server with many services alongside NAS duties, EPYC or previous generation Xeon Scalable with lots of DDR4 RDIMM both look more attractive.

I am planning to start another thread with this as I don't want to hijack someone else's thread. I am still doing more research so I don't waste time on basic questions like how people use a mini SAS connecter. I am still figuring out exactly what would be best for me. Data integrity is the most important so that is why I am strongly considering ECC. Initially the server will be a NAS for a ton of storage and plex server with at most 3 clients using data from it. However, in the future I want to add up to four 4k camera streams and want to do basic and then more advanced live video object detection through a containerized process. This is why I want room for a PCIe slot for a future GPU. It isn't exactly a hyperconverged server, but there are a few other potentially high CPU/GPU workload use cases I am trying to account for. I really don't know exactly what processing power I need TBH. I hope this can last me at least 6 years replacing drives that fail as I need to.

I started my investigation a couple months ago and in that time have determined that ECC memory, IPMI access to a server hopefully with a KVM over IP, and ZFS with raid-z2 all with truenas are all things I am sure I want. The processor and motherboard are still big open, but I am leaning towards Intel 14th gen with the Asus. I'll probably turn off the e-cores until the newer Linux kernel comes out. The supermicro boards looks great too, so I am researching that as well. I am also considering the xeon's. A 3rd gen xeon workstation setup might be my best most cost effective solution.

 

[Etorix]

Well, if you don't even intend to use the iGPU but to have a dGPU for… whatever, I cannot think of any reason to go for a Core CPU in the first place, save for fearful avoidance of anything which does not look like gamer hardware.
Go for for Xeon Scalable (or EPYC) then. But make it first or second generation to be cost effective.

 

[chmod777]

Well, if you don't even intend to use the iGPU but to have a dGPU for… whatever, I cannot think of any reason to go for a Core CPU in the first place, save for fearful avoidance of anything which does not look like gamer hardware.
Go for for Xeon Scalable (or EPYC) then. But make it first or second generation to be cost effective.

That's the dilemma I am dealing with. Eventually I *think* I want a discreet GPU but will not have it initially and maybe not even for a year.

 

[t0maz]

I went through the whole thread but I'm still not 100% sure.
Can anyone please confirm if Asus or other motherboard based on Intel W680 chipset is working fine with physically (bare metal / non-virtual) installed TrueNAS Core - the one based on FreeBSD?
I'm thinking of using such W680 equipped motherboard with Intel Core 12500T CPU (no E cores in this one) and ECC DDR.
Thanks