Register for the iXsystems Community to get an ad-free experience

Out of my league: How do I adjust fan speed (Supermicro CSE-846, X9DRi-F) - fans quiet with hot disks

esamett

Patron
Joined
May 28, 2011
Messages
345
lists different numbers to try... will report back:

ipmitool raw 0x30 0x91 0x5A 0x3 0x11 0x7f sets FANA-B to half speed.
ipmitool raw 0x30 0x91 0x5A 0x3 0x10 0x7f sets FAN1-4 to half speed.
ipmitool raw 0x30 0x91 0x5A 0x3 0x10 0xff sets FAN1-4 to full speed.
 

esamett

Patron
Joined
May 28, 2011
Messages
345
I found the Rosetta Stone of fan speed commands for my X9 motherboard:

the basic command for "half speed" is: ipmitool raw 0x30 0x91 0x5A 0x3 0x10 0x7f which works out to about 4300 RPM for system fans. The last two digits are hexadecimal for fan speed, 0-256.

I started a disk scrub on both arrays to stress the system and then cycled through the disks and found the hottest:
smartctl -a /dev/da13 | grep -i temperature.

When temps exceeded 34' I increased the fan speed (table below) to af (175) and left overnight. Disk temp this morning was 32-33'C with scrub still running. Noise is tolerable. The server is in the basement and is not noticeable with door closed.

I presume that the fan speed will reset to Max when I reboot so my next task will be to figure out how to make the fan command part of the bootup script:
ipmitool raw 0x30 0x91 0x5A 0x3 0x10 0xaf

-------------------------------------
hex.dec.fan speed.ratio
8f 143 5000/143=35
9f 159 5175/159=32.5
af 175 5700/175=32.6 overnight disk temp 32-33'C
bf 191
cf 207
df 223
ef 239
ff 255 7000/255=27.5
 

esamett

Patron
Joined
May 28, 2011
Messages
345

Fail: I entered the ipmitool command as a preinit startup command and rebooted. Fans running full speed.


Success: Running IPMITOOL as a startup command requires the full path. This is found with:
[root@freenas ~]# which ipmitool
/usr/local/bin/ipmitool
With information above I modified command to include the full path to command. Rebooted to proper fan speed.
/usr/local/bin/ipmitool raw 0x30 0x91 0x5A 0x3 0x10 0xaf

Thanks to all for your help. If I get inspired I can try to use the speed sensing scripts.

would get my script journey started I think.

For now i am satisfied with the relative quiet and coolness of my "simple" solution.
 

mikedeissler

Dabbler
Joined
Aug 26, 2011
Messages
18
Please excuse my inexperience. This is my first excursion into using server hardware. I just "finished" moving my FreeNAS from consumer hardware to the server case. 2x11-Z3 disk arrays, 2 spares. dual SSD boot drives inside case powered from extra Molex connector from power distributor. Set up network NIC.

When I turn on system the 5 big case fans spin up loudly initially and then get rather quiet when Motherboard boots. I promptly got disk overheat errors from FreeNAS, even when I replaced the case cover to promote air flow. I rebooted several times and got similar disk overtemperature warnings. Since the system fans currently spin slowly and quietly I want to adjust the speed to increase cooling. Its my guess that the fans can cool my disks when spun up to speed. I looked through the BIOS menus and found no fan control options. I search the forum and found discussions about "scripts" and "IPMI" of which I have no knowledge.

Please guide me in the right direction about fan control. I would hate to have to go back to my consumer frankenstein build.

I had this problem and it ended up being the CPU cooler. TrueNAS monitors the sensors on your MB (fanspeed, temp etc.) you can see what temp TN is getting by typing :

sysctl -a | grep temperature

in the shell. Note those values and boot to your BIOS and compare the temps and fanspeeds the BIOS is reporting with the values TN is seeing. If they are the same, address the hardware with the high temps
 

jgreco

Resident Grinch
Moderator
Joined
May 29, 2011
Messages
16,507
My SuperMicro BIOS most certainly does have fan speed control. Its under Advanced tab, Hardware heath Configuration/System Fan Monitor

View attachment 35133

Your Supermicro BIOS does not have fan speed control. This is just exposing the information from the IPMI subsystem, which is what controls the fan speed.
 

ptyork

Dabbler
Joined
Jun 23, 2021
Messages
16
Your Supermicro BIOS does not have fan speed control. This is just exposing the information from the IPMI subsystem, which is what controls the fan speed.
Sorry to crap on a super-old super-micro thread here (trying to remind myself how to slow my fans back down after they went berserk), but Supermicro makes workstation and server boards. Workstation boards (e.g., X9DAi) do NOT have IPMI and thus have fan controls in the BIOS. Server boards (e.g., X9DRi) do have IPMI and no controls in the BIOS. I much preferred the BIOS based controls. IPMI fan control on these boards suck. Or blow. Or whatever. Benefit is remote access and control without reboot, but the implementation is so half-rate it's painful to work with.
 

jgreco

Resident Grinch
Moderator
Joined
May 29, 2011
Messages
16,507
Sorry to crap on a super-old super-micro thread here (trying to remind myself how to slow my fans back down after they went berserk), but Supermicro makes workstation and server boards. Workstation boards (e.g., X9DAi) do NOT have IPMI and thus have fan controls in the BIOS. Server boards (e.g., X9DRi) do have IPMI and no controls in the BIOS. I much preferred the BIOS based controls. IPMI fan control on these boards suck. Or blow. Or whatever. Benefit is remote access and control without reboot, but the implementation is so half-rate it's painful to work with.

Yes, but the X10DRI and X10SRM being discussed are server boards. You tell the difference because when you go to their product page, they have the terms "BMC" (the actual thing that handles the fans) and "IPMI" (the user interface). Supermicro also makes gaming boards and desktop boards, in addition to workstation boards, but we're not talking about any of those either.

The main problem with fan controls on the X9 IPMI is that Supermicro's boards are primarily designed to work in Supermicro rack mount chassis, and are pre-optimized towards that use case. This is hardly limited to Supermicro, though. Dell and HP both have weird fan speed issues when stuff like adding certain card configurations are added. It's very tweakable, but not as flexible as it could be.

I would note that when I first came to these forums, they were very heavy on users with crappy AMD APU's and janky desktop mainboard setups. My shop has been building bespoke custom servers based around Supermicro mainboards for probably around two decades, and I brought along with me a push towards server-grade boards, and when I finally wrote the original Hardware Recommendations thread, I pushed Supermicro -- hard. There are so many benefits to server-grade boards that some mild difficulties with fan control for people who want quiet servers is really not a big deal. It involves arcane knowledge, but so does SAS enclosure status, or crossflashing HBA's, or 10 Gig ethernet networking. That's what the forums are here to help out with.
 

C8Z06

Cadet
Joined
Sep 18, 2022
Messages
1
Thanks for this thread. I had the same issue, logged in with IPMI, and was able to change the setting from max to optimal and it's doing great now! Thanks!
 
Top