USB Kernel Disconnect messages filling up log (UPS)

[Fox]

It originally started out many months ago with an occasional COMMBAD/NOCOMM errors from the NUT/UPS processes. Being busy, I didn't have time to fuss with it, and since it worked, i let it be. Then one night I started to get 1 email a minute from nut about the commbad and such. Cursory inspection didn't indicate any obvious new problems, so I turned off the emails but this didn't solve it, as the logs were filling up, and now I was worried it would not shutdown the server in case of power failure. So I generally kept the NAS server off when I wasn't home and turned off the NUT service in FreeNAS. UPS was used for power, but I kept the USB cable unplugged from the server to keep the logs empty.

I have had some time to investigate, and I found that I'm getting an USB HID error every 15 seconds in the log, even with the NUT/UPS services disabled (off) in FREENAS, I see the following (below) in the logs, only when the UPS is plugged in via USB. Serial port is not an option for this device, no NUT driver. I have tried different USB ports, and I have tried different/better cables. I have tried plugging in other USB HID devices (keyboards, mice, etc) and I get no errors. I have tried plugging the UPS into my windows box, and it works fine, no disconnects. Tripplite doesn't think it is their problem because it works in Windows. I am somewhat frustrated.

I have tried running the usbhidctl program (with options) from the command line on the FreeNAS server and I can see the UPS is reporting the correct data (with some decoding on my part) when i have it plugged in. So this seems to be a FreeBSD problem, not a UPS problem...I think.

My setup:
CASE: SUPERMICRO CSE-846A-R1200B Black 4U R
PROCESSOR: Intel Xeon E5-2609 v2 Ivy Bridge-EP 2.5GHz 10MB L3
MOTHERBOARD: SUPERMICRO X9SRI-F ATX Server Motherboard LGA 2011
MEMORY: 16GB
FreeNAS v9.2.1.3 ( I do plan to upgrade, but I have my doubts it will solve this problem, since it is somewhat low level)
UPS: Tripp Lite TRIPP LITE SMART1500RM2U
HD CONTROLLERS: IBM ServeRAID M1015 SAS/SATA Controller (x3)
Hard Drives: TOSHIBA 3TB DT01ACA3 (x6)

Note also the messages seem to come every 15 seconds.

Code:

# usbconfig                                                                                  
ugen0.1: <EHCI root HUB Intel> at usbus0, cfg=0 md=HOST spd=HIGH (480Mbps) pwr=SAVE (0mA)
ugen1.1: <EHCI root HUB Intel> at usbus1, cfg=0 md=HOST spd=HIGH (480Mbps) pwr=SAVE (0mA)
ugen0.2: <product 0x0024 vendor 0x8087> at usbus0, cfg=0 md=HOST spd=HIGH (480Mbps) pwr=SAVE (0mA)
ugen1.2: <product 0x0024 vendor 0x8087> at usbus1, cfg=0 md=HOST spd=HIGH (480Mbps) pwr=SAVE (0mA)
ugen0.3: <Hermon USB hidmouse Device Winbond Electronics Corp> at usbus0, cfg=0 md=HOST spd=FULL (12Mbps) pwr=ON (100mA)
ugen1.3: <Cruzer SanDisk> at usbus1, cfg=0 md=HOST spd=HIGH (480Mbps) pwr=ON (200mA)               
ugen1.4: <TRIPP LITE SMART1500RM2U Tripp Lite> at usbus1, cfg=0 md=HOST spd=LOW (1.5Mbps) pwr=ON (0mA)

Code:

Dec 13 12:35:50 freenas kernel: ugen1.4: <Tripp Lite> at usbus1
Dec 13 12:35:50 freenas kernel: uhid0: <Tripp Lite TRIPP LITE SMART1500RM2U, class 0/0, rev 1.10/2.0a, addr 4> on usbus1
Dec 13 12:36:04 freenas kernel: ugen1.4: <Tripp Lite> at usbus1 (disconnected)
Dec 13 12:36:04 freenas kernel: uhid0: at uhub3, port 2, addr 4 (disconnected)
Dec 13 12:36:05 freenas kernel: ugen1.4: <Tripp Lite> at usbus1
Dec 13 12:36:05 freenas kernel: uhid0: <Tripp Lite TRIPP LITE SMART1500RM2U, class 0/0, rev 1.10/2.0a, addr 4> on usbus1
Dec 13 12:36:19 freenas kernel: ugen1.4: <Tripp Lite> at usbus1 (disconnected)
Dec 13 12:36:19 freenas kernel: uhid0: at uhub3, port 2, addr 4 (disconnected)
Dec 13 12:36:20 freenas kernel: ugen1.4: <Tripp Lite> at usbus1
Dec 13 12:36:20 freenas kernel: uhid0: <Tripp Lite TRIPP LITE SMART1500RM2U, class 0/0, rev 1.10/2.0a, addr 4> on usbus1
Dec 13 12:36:34 freenas kernel: ugen1.4: <Tripp Lite> at usbus1 (disconnected)
Dec 13 12:36:34 freenas kernel: uhid0: at uhub3, port 2, addr 4 (disconnected)
Dec 13 12:36:36 freenas kernel: ugen1.4: <Tripp Lite> at usbus1
Dec 13 12:36:36 freenas kernel: uhid0: <Tripp Lite TRIPP LITE SMART1500RM2U, class 0/0, rev 1.10/2.0a, addr 4> on usbus1
Dec 13 12:36:50 freenas kernel: ugen1.4: <Tripp Lite> at usbus1 (disconnected)
Dec 13 12:36:50 freenas kernel: uhid0: at uhub3, port 2, addr 4 (disconnected)
Dec 13 12:36:51 freenas kernel: ugen1.4: <Tripp Lite> at usbus1
Dec 13 12:36:51 freenas kernel: uhid0: <Tripp Lite TRIPP LITE SMART1500RM2U, class 0/0, rev 1.10/2.0a, addr 4> on usbus1
Dec 13 12:37:05 freenas kernel: ugen1.4: <Tripp Lite> at usbus1 (disconnected)
Dec 13 12:37:05 freenas kernel: uhid0: at uhub3, port 2, addr 4 (disconnected)
Dec 13 12:37:06 freenas kernel: ugen1.4: <Tripp Lite> at usbus1
Dec 13 12:37:06 freenas kernel: uhid0: <Tripp Lite TRIPP LITE SMART1500RM2U, class 0/0, rev 1.10/2.0a, addr 4> on usbus1
Dec 13 12:37:20 freenas kernel: ugen1.4: <Tripp Lite> at usbus1 (disconnected)
Dec 13 12:37:20 freenas kernel: uhid0: at uhub3, port 2, addr 4 (disconnected)
Dec 13 12:37:21 freenas kernel: ugen1.4: <Tripp Lite> at usbus1
Dec 13 12:37:22 freenas kernel: uhid0: <Tripp Lite TRIPP LITE SMART1500RM2U, class 0/0, rev 1.10/2.0a, addr 4> on usbus1
Dec 13 12:37:36 freenas kernel: ugen1.4: <Tripp Lite> at usbus1 (disconnected)
Dec 13 12:37:36 freenas kernel: uhid0: at uhub3, port 2, addr 4 (disconnected)
Dec 13 12:37:37 freenas kernel: ugen1.4: <Tripp Lite> at usbus1
Dec 13 12:37:37 freenas kernel: uhid0: <Tripp Lite TRIPP LITE SMART1500RM2U, class 0/0, rev 1.10/2.0a, addr 4> on usbus1
Dec 13 12:37:51 freenas kernel: ugen1.4: <Tripp Lite> at usbus1 (disconnected)
Dec 13 12:37:51 freenas kernel: uhid0: at uhub3, port 2, addr 4 (disconnected)
Dec 13 12:37:52 freenas kernel: ugen1.4: <Tripp Lite> at usbus1
Dec 13 12:37:52 freenas kernel: uhid0: <Tripp Lite TRIPP LITE SMART1500RM2U, class 0/0, rev 1.10/2.0a, addr 4> on usbus1
Dec 13 12:38:06 freenas kernel: ugen1.4: <Tripp Lite> at usbus1 (disconnected)
Dec 13 12:38:06 freenas kernel: uhid0: at uhub3, port 2, addr 4 (disconnected)
Dec 13 12:38:07 freenas kernel: ugen1.4: <Tripp Lite> at usbus1
Dec 13 12:38:07 freenas kernel: uhid0: <Tripp Lite TRIPP LITE SMART1500RM2U, class 0/0, rev 1.10/2.0a, addr 4> on usbus1
Dec 13 12:38:21 freenas kernel: ugen1.4: <Tripp Lite> at usbus1 (disconnected)
Dec 13 12:38:21 freenas kernel: uhid0: at uhub3, port 2, addr 4 (disconnected)
Dec 13 12:38:22 freenas kernel: ugen1.4: <Tripp Lite> at usbus1
Dec 13 12:38:22 freenas kernel: uhid0: <Tripp Lite TRIPP LITE SMART1500RM2U, class 0/0, rev 1.10/2.0a, addr 4> on usbus1
Dec 13 12:38:37 freenas kernel: ugen1.4: <Tripp Lite> at usbus1 (disconnected)
Dec 13 12:38:37 freenas kernel: uhid0: at uhub3, port 2, addr 4 (disconnected)
Dec 13 12:38:38 freenas kernel: ugen1.4: <Tripp Lite> at usbus1
Dec 13 12:38:38 freenas kernel: uhid0: <Tripp Lite TRIPP LITE SMART1500RM2U, class 0/0, rev 1.10/2.0a, addr 4> on usbus1
Dec 13 12:38:52 freenas kernel: ugen1.4: <Tripp Lite> at usbus1 (disconnected)
Dec 13 12:38:52 freenas kernel: uhid0: at uhub3, port 2, addr 4 (disconnected)
Dec 13 12:38:53 freenas kernel: ugen1.4: <Tripp Lite> at usbus1
Dec 13 12:38:53 freenas kernel: uhid0: <Tripp Lite TRIPP LITE SMART1500RM2U, class 0/0, rev 1.10/2.0a, addr 4> on usbus1
Dec 13 12:39:07 freenas kernel: ugen1.4: <Tripp Lite> at usbus1 (disconnected)
Dec 13 12:39:07 freenas kernel: uhid0: at uhub3, port 2, addr 4 (disconnected)
Dec 13 12:39:08 freenas kernel: ugen1.4: <Tripp Lite> at usbus1
Dec 13 12:39:08 freenas kernel: uhid0: <Tripp Lite TRIPP LITE SMART1500RM2U, class 0/0, rev 1.10/2.0a, addr 4> on usbus1
Dec 13 12:39:23 freenas kernel: ugen1.4: <Tripp Lite> at usbus1 (disconnected)
Dec 13 12:39:23 freenas kernel: uhid0: at uhub3, port 2, addr 4 (disconnected)
Dec 13 12:39:24 freenas kernel: ugen1.4: <Tripp Lite> at usbus1
Dec 13 12:39:24 freenas kernel: uhid0: <Tripp Lite TRIPP LITE SMART1500RM2U, class 0/0, rev 1.10/2.0a, addr 4> on usbus1
Dec 13 12:39:38 freenas kernel: ugen1.4: <Tripp Lite> at usbus1 (disconnected)
Dec 13 12:39:38 freenas kernel: uhid0: at uhub3, port 2, addr 4 (disconnected)
Dec 13 12:39:39 freenas kernel: ugen1.4: <Tripp Lite> at usbus1
Dec 13 12:39:39 freenas kernel: uhid0: <Tripp Lite TRIPP LITE SMART1500RM2U, class 0/0, rev 1.10/2.0a, addr 4> on usbus1
Dec 13 12:39:53 freenas kernel: ugen1.4: <Tripp Lite> at usbus1 (disconnected)
Dec 13 12:39:53 freenas kernel: uhid0: at uhub3, port 2, addr 4 (disconnected)

 

[dlavigne]

Other forum posts indicate that Tripp Lite is problematic on FreeBSD/FreeNAS.

 

[Fox]

Hmm.. I always searched for "Tripplite" instead of "Tripp Lite". Now I see.. :-(

Anyway, a guy on the FreeBSD USB mailing list says there may be a fix.. Looks like he may have coded part of these USB routines for FreeBSD. Problem is that it looks like it involves a kernel rebuild, I am not sure at this point though.. He mentioned perhaps it was a new feature that is unsupported in the OS. At least in our version of FreeBSD..

I am still actively researching it though.

 

[dlavigne]

If you find in your research a patch or an indication that a fix has been backported to 9.3, please create a feature request at bugs.freenas.org so that it can be added.

 

[Fox]

Here is what I know, and yes, there is now a code fix that, according to the coder, will work on FREEBSD versions 9/10/11

The kernel will need to rebuilt, and we need to update /etc/devd/usb.conf .
The issue: The problem is that the different USB vendors are using some undefined ID's without talking to each other getting standard values in there instead.
I also asked what version the fix will be eventually included in, and he said it will be in 9/10/11..

Here is are the patches that should fix the problem:
https://svnweb.freebsd.org/changeset/base/275790
https://svnweb.freebsd.org/changeset/base/275791

I will repost this as a feature request at bugs.freenas.org

 

[superwad]

I'm willing to test a private build of this kernel and usb.conf to verify if it works before committing it to production. I have the same issue with Tripp Lite as Fox does ( https://forums.freenas.org/index.php?threads/tripp-lite-ups-keeps-disconnecting-reconnecting.25325 )

 

[superwad]

I ran the submitted fix on a nightly build of 9.3, and I saw no disconnects over a 36 hour period.

 

[Fox]

Lucky you.. I just tried it, and I am still getting the disconnect messages.