After upgrade from 9.3 -> 9.10 a variety of problems with TS140

[Baenwort]

I upgraded from FreeNAS-9.3-STABLE-201604150515 to 9.10 using the built in GUI by changing the train to 9.10-STABLE.

The system is a Lenovo TS140 with Intel(R) Core(TM) i3-4130 CPU and 24435MB (24GB) of ECC memory in four sticks. It has two WD RED 6TB hard drives in a mirror. The intention, and reason for 24GB of ram, is to add another pair of 6TB drives to form a stripped mirror when I can next score a pair for <$200 each.

Upon rebooting after the upgrade I got the following in a continuous loop:

Code:

May  8 16:17:25 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
May  8 16:17:25 thing ugen0.5: <Unknown> at usbus0 (disconnected)
May  8 16:17:25 thing uhub_reattach_port: could not allocate new device
May  8 16:17:26 thing usb_alloc_device: set address 5 failed (USB_ERR_IOERROR, ignored)
May  8 16:17:32 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
May  8 16:17:32 thing usbd_req_re_enumerate: addr=5, set address failed! (USB_ERR_IOERROR, ignored)
May  8 16:17:37 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
May  8 16:17:38 thing usbd_req_re_enumerate: addr=5, set address failed! (USB_ERR_IOERROR, ignored)
May  8 16:17:44 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
May  8 16:17:44 thing usbd_req_re_enumerate: addr=5, set address failed! (USB_ERR_IOERROR, ignored)
May  8 16:17:50 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
May  8 16:17:51 thing usbd_req_re_enumerate: addr=5, set address failed! (USB_ERR_IOERROR, ignored)
May  8 16:17:57 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
May  8 16:17:57 thing ugen0.5: <Unknown> at usbus0 (disconnected)
May  8 16:17:57 thing uhub_reattach_port: could not allocate new device
May  8 16:17:58 thing usb_alloc_device: set address 5 failed (USB_ERR_IOERROR, ignored)
May  8 16:18:03 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
May  8 16:18:04 thing usbd_req_re_enumerate: addr=5, set address failed! (USB_ERR_IOERROR, ignored)
May  8 16:18:09 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
May  8 16:18:10 thing usbd_req_re_enumerate: addr=5, set address failed! (USB_ERR_IOERROR, ignored)
May  8 16:18:16 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
May  8 16:18:16 thing usbd_req_re_enumerate: addr=5, set address failed! (USB_ERR_IOERROR, ignored)
May  8 16:18:22 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
May  8 16:18:23 thing usbd_req_re_enumerate: addr=5, set address failed! (USB_ERR_IOERROR, ignored)
May  8 16:18:29 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
May  8 16:18:29 thing ugen0.5: <Unknown> at usbus0 (disconnected)
May  8 16:18:29 thing uhub_reattach_port: could not allocate new device
May  8 16:18:29 thing usb_alloc_device: set address 5 failed (USB_ERR_IOERROR, ignored)

and an email describing a problem with a controller that I don't have (all drives are connected directly to the MBs SATA headers)

Code:

Checking status of 3ware RAID controllers:
Alarms (most recent first):
++++/var/log/3ware_raid_alarms.today  2016-05-03 03:01:00.401603070
-0500
@@ -0,0 +1 @@
+

-- End of daily output --

I also have a Cyberpower UPS (model CP1500PFCLCD) that is no longer seen by the NAS and the UPS service will no longer turn on. It is connected via USB to port /dev/ugen0.5 which corresponds with the above.

However, when I unplug the UPS from the NAS the error message scrolling through the log does not stop. It just changes to:

Code:

May  8 16:39:10 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
May  8 16:39:10 thing ugen0.5: <Unknown> at usbus0 (disconnected)
May  8 16:39:10 thing uhub_reattach_port: could not allocate new device
May  8 16:39:10 thing usb_alloc_device: set address 5 failed (USB_ERR_IOERROR, ignored)
May  8 16:39:16 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
May  8 16:39:16 thing usbd_req_re_enumerate: addr=5, set address failed! (USB_ERR_IOERROR, ignored)
May  8 16:39:22 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
May  8 16:39:23 thing usbd_req_re_enumerate: addr=5, set address failed! (USB_ERR_IOERROR, ignored)
May  8 16:39:28 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
May  8 16:39:29 thing usbd_req_re_enumerate: addr=5, set address failed! (USB_ERR_IOERROR, ignored)
May  8 16:39:35 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
May  8 16:39:36 thing usbd_req_re_enumerate: addr=5, set address failed! (USB_ERR_IOERROR, ignored)
May  8 16:39:41 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
May  8 16:39:41 thing ugen0.5: <Unknown> at usbus0 (disconnected)
May  8 16:39:41 thing uhub_reattach_port: could not allocate new device
May  8 16:39:41 thing ugen0.2: <CP1500PFCLCD> at usbus0 (disconnected)
May  8 16:39:42 thing usb_alloc_device: set address 2 failed (USB_ERR_IOERROR, ignored)
May  8 16:39:47 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
May  8 16:39:48 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
May  8 16:39:54 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
May  8 16:39:55 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
May  8 16:40:00 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
May  8 16:40:01 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
May  8 16:40:06 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
May  8 16:40:07 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
May  8 16:40:13 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
May  8 16:40:13 thing ugen0.2: <Unknown> at usbus0 (disconnected)
May  8 16:40:13 thing uhub_reattach_port: could not allocate new device
May  8 16:40:13 thing usb_alloc_device: set address 2 failed (USB_ERR_IOERROR, ignored)
May  8 16:40:19 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
May  8 16:40:19 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
May  8 16:40:25 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
May  8 16:40:26 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
May  8 16:40:31 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
May  8 16:40:32 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
May  8 16:40:38 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
May  8 16:40:38 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
May  8 16:40:44 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
May  8 16:40:44 thing ugen0.2: <Unknown> at usbus0 (disconnected)
May  8 16:40:44 thing uhub_reattach_port: could not allocate new device
May  8 16:40:44 thing usb_alloc_device: set address 2 failed (USB_ERR_IOERROR, ignored)
May  8 16:40:49 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
May  8 16:40:50 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
May  8 16:40:55 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
May  8 16:40:56 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)

As you can guess by the fact that it took me a week to reach the point of asking for help this has not stopped our ability to access CFS shares nor to use the Emby plugin that is running in a jail. However, I would like to restore the UPS service so that I can be assured that the NAS will turn off before the battery runs down.

My desire for cleanliness would also like to see the error message leave the log.

Will you help me Obi-wan?

 

[joeschmuck]

Well there is this lunar phenomenon which caused everything to got to crap on a Sunday.

Okay, seriously, I just upgraded yesterday from 9.3 to 9.10 and it wasn't good for me either. I didn't have the same problems as you but I only found one solution and that was to delete all my jails/plugins, do a clean install of 9.10, import my 9.3 configuration file, then after everything looked good, recreate my plugins. Since I only have one plugin the time it took wasn't bad for me to recover.

If I were you then I would try a clean install of 9.10 first, see if you have any errors, load your config file from 9.3, see if you have any errors. And if that didn't work, roll back to 9.3. Honestly 9.3 runs great.

 

[SweetAndLow]

What driver is nut using to talk with your ups?

 

[jkh]

I'm guessing your Lenovo is declaring itself USB3 capable yet isn't actually USB3.0 capable as far as FreeBSD's USB 3.0 (XHCI) driver is concerned. Is there an option in this machine's BIOS to make the USB devices conform only to 2.0?

 

[Baenwort]

What driver is nut using to talk with your ups?

I am using the "Cyber Power Systems ups 2 CP1000PFCLCD USB (usbhid-ups)" as that is what worked under 9.3.1 for the last year.

 

[Baenwort]

I'm guessing your Lenovo is declaring itself USB3 capable yet isn't actually USB3.0 capable as far as FreeBSD's USB 3.0 (XHCI) driver is concerned. Is there an option in this machine's BIOS to make the USB devices conform only to 2.0?

There is and I had already switched it to disabled (USB3 turned off)when I first configured the machine as 9.3 did not support USB3 and I was informed it could be a problem otherwise.

Do you recommend I go back and enable it?

 

[jkh]

Do you recommend I go back and enable it?

Give it a shot. What harm could it do? ;)

 

[Baenwort]

Well, I'm back as I found time to mess with this again over the holiday weekend.

Enabling USB 3.0 did not help. (much).

After updating the BIOS on the TS140 to the latest one and enabling USB3.0 I did not see any change. I moved the UPS from the USB3 port that can be changed to 2.0 and placed it on a regular 3.0 port. This fixed part of the problem with the UPS in that the nut driver sees it again. Unfortunately this wasn't enough as now the nut driver refuses to talk with it. As you can see below:

Code:

Jul  5 21:41:52 thing devd: Executing 'kldload -n uhid'
Jul  5 21:41:52 thing ugen0.2: <CP1500PFCLCD> at usbus0
Jul  5 21:42:15 thing notifier: nut not running? (check /var/db/nut/upsd.pid).
Jul  5 21:42:15 thing notifier: nut_upsmon not running? (check /var/db/nut/upsmon.pid).
Jul  5 21:42:15 thing notifier: nut_upslog not running? (check /var/db/nut/upslog.pid).
Jul  5 21:42:15 thing notifier: nut not running? (check /var/db/nut/upsd.pid).
Jul  5 21:42:15 thing notifier: Duplicate driver instance detected! Terminating other driver!
Jul  5 21:42:15 thing notifier: Network UPS Tools - Generic HID driver 0.39 (2.7.3)
Jul  5 21:42:15 thing notifier: USB communication driver 0.32
Jul  5 21:42:15 thing notifier: No matching HID UPS found
Jul  5 21:42:15 thing notifier: nut_upsmon not running? (check /var/db/nut/upsmon.pid).
Jul  5 21:42:15 thing notifier: Starting nut_upsmon.
Jul  5 21:42:15 thing notifier: kill: No such process
Jul  5 21:42:15 thing notifier: UPS: CP_1500_PFC (master) (power value 1)
Jul  5 21:42:15 thing notifier: Using power down flag file /etc/nokillpower
Jul  5 21:42:15 thing upsmon[9376]: UPS [CP_1500_PFC]: connect failed: Connection failure: Connection refused
Jul  5 21:42:15 thing upsmon[9376]: Communications with UPS CP_1500_PFC lost
Jul  5 21:42:15 thing notifier: nut_upslog not running? (check /var/db/nut/upslog.pid).
Jul  5 21:42:15 thing notifier: Starting nut_upslog.
Jul  5 21:42:15 thing notifier: Warning: initial connect failed: Connection failure: Connection refused
Jul  5 21:42:16 thing notifier: Stopping nut_upslog.
Jul  5 21:42:16 thing notifier: Waiting for PIDS: 9404.
Jul  5 21:42:16 thing notifier: Stopping nut_upsmon.
Jul  5 21:42:41 thing upsmon[9375]: upsmon parent: read
Jul  5 21:42:41 thing notifier: Waiting for PIDS: 9376, 9376, 9376, 9376, 9376, 9376, 9376, 9376, 9376, 9376, 9376, 9376, 9376, 9376, 9376, 9376, 9376, 9376, 9376, 9376, 9376, 9376, 9376, 9376, 9376.
Jul  5 21:42:41 thing notifier: nut not running? (check /var/db/nut/upsd.pid).
Jul  5 21:43:00 thing notifier: Startup timer elapsed, continuing...
Jul  5 21:43:00 thing notifier: Network UPS Tools - UPS driver controller 2.7.3
Jul  5 21:43:00 thing root: /usr/local/etc/rc.d/nut: WARNING: failed precmd routine for nut
Jul  5 21:43:00 thing notifier: /usr/local/etc/rc.d/nut: WARNING: failed precmd routine for nut
Jul  5 21:48:02 thing notifier: Using subdriver: CyberPower HID 0.4
Jul  5 21:48:02 thing notifier: Network UPS Tools - Generic HID driver 0.39 (2.7.3)
Jul  5 21:48:02 thing notifier: USB communication driver 0.32
Jul  5 21:48:02 thing notifier: Cannot 'restart' nut_upsmon. Set nut_upsmon_enable to YES in /etc/rc.conf or use 'onerestart' instead of 'restart'.
Jul  5 21:48:02 thing notifier: Cannot 'restart' nut_upslog. Set nut_upslog_enable to YES in /etc/rc.conf or use 'onerestart' instead of 'restart'.
Jul  5 21:48:02 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
Jul  5 21:48:02 thing ugen0.5: <Unknown> at usbus0 (disconnected)

However I still have this repeating through my log constantly that is not for the UPS port nor does it change when I unplug all my USB devices except the pair of boot sticks. I've deleted it from the above log to make the UPS issue easier to see. If you want the raw log let me know.

Code:

Jul  5 21:58:17 thing ugen0.5: <Unknown> at usbus0 (disconnected)
Jul  5 21:58:17 thing uhub_reattach_port: could not allocate new device
Jul  5 21:58:17 thing usb_alloc_device: set address 5 failed (USB_ERR_IOERROR, ignored)
Jul  5 21:58:22 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
Jul  5 21:58:22 thing usbd_req_re_enumerate: addr=5, set address failed! (USB_ERR_IOERROR, ignored)
Jul  5 21:58:28 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
Jul  5 21:58:29 thing usbd_req_re_enumerate: addr=5, set address failed! (USB_ERR_IOERROR, ignored)
Jul  5 21:58:35 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
Jul  5 21:58:35 thing usbd_req_re_enumerate: addr=5, set address failed! (USB_ERR_IOERROR, ignored)
Jul  5 21:58:41 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
Jul  5 21:58:42 thing usbd_req_re_enumerate: addr=5, set address failed! (USB_ERR_IOERROR, ignored)
Jul  5 21:58:48 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
Jul  5 21:58:48 thing ugen0.5: <Unknown> at usbus0 (disconnected)
Jul  5 21:58:48 thing uhub_reattach_port: could not allocate new device
Jul  5 21:58:48 thing usb_alloc_device: set address 5 failed (USB_ERR_IOERROR, ignored)
Jul  5 21:58:54 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
Jul  5 21:58:54 thing usbd_req_re_enumerate: addr=5, set address failed! (USB_ERR_IOERROR, ignored)
Jul  5 21:59:00 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
Jul  5 21:59:01 thing usbd_req_re_enumerate: addr=5, set address failed! (USB_ERR_IOERROR, ignored)
Jul  5 21:59:04 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
Jul  5 21:59:04 thing usbd_req_re_enumerate: addr=5, set address failed! (USB_ERR_IOERROR, ignored)
Jul  5 21:59:10 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
Jul  5 21:59:11 thing usbd_req_re_enumerate: addr=5, set address failed! (USB_ERR_IOERROR, ignored)
Jul  5 21:59:16 thing usbd_setup_device_desc: getting device descriptor at addr 5 failed, USB_ERR_TIMEOUT
Jul  5 21:59:16 thing ugen0.5: <Unknown> at usbus0 (disconnected)
Jul  5 21:59:16 thing uhub_reattach_port: could not allocate new device

So 9.10 is still giving me streaming logs full of errors. Any more ideas?

 

[Baenwort]

So continuing my quest to figure out what is going on I've been diving around the BIOS and rebooting frequently.

I noticed that my two (identical model number and appearance) Sandisk USB drives show up differently in the BIOS. One shows as a USB HD and the other as a USB KEY. Could this be the source of the scrolling USB error? Even when they are the only USB devices plugged in the error occurs.

 

[Baenwort]

So, after alternatively pulling one and than the other USB stick (otherwise identical SANDISK Extreme 32GB that report as USB HDD and USB KEY in BIOS) I find that it does not matter which stick I have in. Both individually and together the repeated USB IOERRORs scroll past.

I did ID a new behavior that can be seen the below log. I start with just the USB HD identifying stick and a USB keyboard plugged in. I disconnect the keyboard and which addr gives the error changes from 4 to 2. I then plug in a Samsung USB stick that IDs as USB Key in BIOS and the addr of the error changes back to 4. When I remove the USB Stick it goes back to 2.

I find it difficult to figure out the source of this error. Can anyone suggest another step?

Code:

Jul 17 20:12:26 thing devd: Executing '/etc/rc.d/syscons setkeyboard /dev/kbd0'
Jul 17 20:12:26 thing devd: Executing '/etc/rc.d/moused stop ums0'
Jul 17 20:12:26 thing usbd_setup_device_desc: getting device descriptor at addr 4 failed, USB_ERR_TIMEOUT
Jul 17 20:12:26 thing ugen0.4: <Unknown> at usbus0 (disconnected)
Jul 17 20:12:26 thing uhub_reattach_port: could not allocate new device
Jul 17 20:12:26 thing ugen0.2: <CM Storm> at usbus0 (disconnected)
Jul 17 20:12:26 thing ukbd0: at uhub0, port 1, addr 1 (disconnected)
Jul 17 20:12:26 thing ums0: at uhub0, port 1, addr 1 (disconnected)
Jul 17 20:12:27 thing usb_alloc_device: set address 2 failed (USB_ERR_IOERROR, ignored)
Jul 17 20:12:31 thing netcli: [py.warnings:791] /usr/local/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:791: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html
  InsecureRequestWarning)
Jul 17 20:12:32 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:12:33 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:12:38 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:12:39 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:12:43 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:12:44 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:12:50 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:12:50 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:12:56 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:12:56 thing ugen0.2: <Unknown> at usbus0 (disconnected)
Jul 17 20:12:56 thing uhub_reattach_port: could not allocate new device
Jul 17 20:12:57 thing usb_alloc_device: set address 2 failed (USB_ERR_IOERROR, ignored)
Jul 17 20:13:02 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:13:03 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:13:08 thing kernel: arp: 192.168.1.113 moved from 02:ff:20:00:05:0a to 44:39:c4:55:77:52 on epair1b
Jul 17 20:13:08 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:13:09 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:13:14 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:13:15 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:13:17 thing autosnap.py: [tools.autosnap:61] Popen()ing: /sbin/zfs snapshot "cousin_itt/Visual@auto-20160717.2013-3w"
Jul 17 20:13:18 thing autosnap.py: [tools.autosnap:61] Popen()ing: /sbin/zfs snapshot -r "cousin_itt/Audio@auto-20160717.2013-3w"
Jul 17 20:13:18 thing autosnap.py: [tools.autosnap:61] Popen()ing: /sbin/zfs destroy -r -d "cousin_itt/Audio@auto-20160626.2006-3w"
Jul 17 20:13:20 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:13:21 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:13:26 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:13:26 thing ugen0.2: <Unknown> at usbus0 (disconnected)
Jul 17 20:13:26 thing uhub_reattach_port: could not allocate new device
Jul 17 20:13:27 thing usb_alloc_device: set address 2 failed (USB_ERR_IOERROR, ignored)
Jul 17 20:13:31 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:13:31 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:13:37 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:13:38 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:13:43 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:13:44 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:13:50 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:13:50 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:13:56 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:13:56 thing ugen0.2: <Unknown> at usbus0 (disconnected)
Jul 17 20:13:56 thing uhub_reattach_port: could not allocate new device
Jul 17 20:13:57 thing usb_alloc_device: set address 2 failed (USB_ERR_IOERROR, ignored)
Jul 17 20:14:03 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:14:03 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:14:08 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:14:09 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:14:13 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:14:14 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:14:19 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:14:20 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:14:21 thing smbd[7364]: [2016/07/17 20:14:21.607045,  1] ../source3/smbd/service.c:552(make_connection_snum)
Jul 17 20:14:21 thing smbd[7364]:   create_connection_session_info failed: NT_STATUS_ACCESS_DENIED
Jul 17 20:14:21 thing smbd[7365]: [2016/07/17 20:14:21.617878,  1] ../source3/smbd/service.c:552(make_connection_snum)
Jul 17 20:14:21 thing smbd[7365]:   create_connection_session_info failed: NT_STATUS_ACCESS_DENIED
Jul 17 20:14:26 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:14:26 thing ugen0.2: <Unknown> at usbus0 (disconnected)
Jul 17 20:14:26 thing uhub_reattach_port: could not allocate new device
Jul 17 20:14:27 thing ugen0.2: <Samsung> at usbus0
Jul 17 20:14:27 thing umass1: <Samsung Flash Drive, class 0/0, rev 3.00/11.00, addr 10> on usbus0
Jul 17 20:14:27 thing umass1:  SCSI over Bulk-Only; quirks = 0x4000
Jul 17 20:14:27 thing umass1:6:1:-1: Attached to scbus6
Jul 17 20:14:27 thing devd: Executing '[ -e /tmp/.sync_disk_done ] && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/sync_disks.py da1'
Jul 17 20:14:27 thing da1 at umass-sim1 bus 1 scbus6 target 0 lun 0
Jul 17 20:14:27 thing da1: <Samsung Flash Drive 1100> Removable Direct Access SPC-4 SCSI device
Jul 17 20:14:27 thing da1: Serial Number 0373416020014663
Jul 17 20:14:27 thing da1: 400.000MB/s transfers
Jul 17 20:14:27 thing da1: 30592MB (62652416 512 byte sectors)
Jul 17 20:14:27 thing da1: quirks=0x2<NO_6_BYTE>
Jul 17 20:14:27 thing usb_alloc_device: set address 4 failed (USB_ERR_IOERROR, ignored)
Jul 17 20:14:33 thing usbd_setup_device_desc: getting device descriptor at addr 4 failed, USB_ERR_TIMEOUT
Jul 17 20:14:33 thing usbd_req_re_enumerate: addr=4, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:14:39 thing usbd_setup_device_desc: getting device descriptor at addr 4 failed, USB_ERR_TIMEOUT
Jul 17 20:14:40 thing usbd_req_re_enumerate: addr=4, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:14:46 thing usbd_setup_device_desc: getting device descriptor at addr 4 failed, USB_ERR_TIMEOUT
Jul 17 20:14:46 thing usbd_req_re_enumerate: addr=4, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:14:52 thing usbd_setup_device_desc: getting device descriptor at addr 4 failed, USB_ERR_TIMEOUT
Jul 17 20:14:53 thing usbd_req_re_enumerate: addr=4, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:14:58 thing usbd_setup_device_desc: getting device descriptor at addr 4 failed, USB_ERR_TIMEOUT
Jul 17 20:14:58 thing ugen0.4: <Unknown> at usbus0 (disconnected)
Jul 17 20:14:58 thing uhub_reattach_port: could not allocate new device
Jul 17 20:14:58 thing usb_alloc_device: set address 4 failed (USB_ERR_IOERROR, ignored)
Jul 17 20:15:04 thing usbd_setup_device_desc: getting device descriptor at addr 4 failed, USB_ERR_TIMEOUT
Jul 17 20:15:04 thing usbd_req_re_enumerate: addr=4, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:15:10 thing usbd_setup_device_desc: getting device descriptor at addr 4 failed, USB_ERR_TIMEOUT
Jul 17 20:15:11 thing usbd_req_re_enumerate: addr=4, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:15:15 thing usbd_setup_device_desc: getting device descriptor at addr 4 failed, USB_ERR_TIMEOUT
Jul 17 20:15:16 thing usbd_req_re_enumerate: addr=4, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:15:21 thing usbd_setup_device_desc: getting device descriptor at addr 4 failed, USB_ERR_TIMEOUT
Jul 17 20:15:22 thing usbd_req_re_enumerate: addr=4, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:15:28 thing devd: Executing '[ -e /tmp/.sync_disk_done ] && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/sync_disks.py && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/smart_alert.py -d da1'
Jul 17 20:15:28 thing usbd_setup_device_desc: getting device descriptor at addr 4 failed, USB_ERR_TIMEOUT
Jul 17 20:15:28 thing ugen0.4: <Unknown> at usbus0 (disconnected)
Jul 17 20:15:28 thing uhub_reattach_port: could not allocate new device
Jul 17 20:15:28 thing ugen0.2: <Samsung> at usbus0 (disconnected)
Jul 17 20:15:28 thing umass1: at uhub0, port 16, addr 10 (disconnected)
Jul 17 20:15:28 thing da1 at umass-sim1 bus 1 scbus6 target 0 lun 0
Jul 17 20:15:28 thing da1: <Samsung Flash Drive 1100> s/n 0373416020014663 detached
Jul 17 20:15:28 thing (da1:umass-sim1:1:0:0): Periph destroyed
Jul 17 20:15:29 thing usb_alloc_device: set address 2 failed (USB_ERR_IOERROR, ignored)
Jul 17 20:15:34 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:15:35 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:15:40 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:15:41 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:15:47 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:15:47 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:15:53 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:15:54 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:15:59 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:15:59 thing ugen0.2: <Unknown> at usbus0 (disconnected)
Jul 17 20:15:59 thing uhub_reattach_port: could not allocate new device
Jul 17 20:15:59 thing usb_alloc_device: set address 2 failed (USB_ERR_IOERROR, ignored)
Jul 17 20:16:03 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:16:04 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:16:09 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:16:10 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:16:15 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:16:16 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:16:21 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:16:21 thing smbd[7957]: [2016/07/17 20:16:21.630196,  1] ../source3/smbd/service.c:552(make_connection_snum)
Jul 17 20:16:21 thing smbd[7957]:  create_connection_session_info failed: NT_STATUS_ACCESS_DENIED
Jul 17 20:16:21 thing smbd[7958]: [2016/07/17 20:16:21.652484,  1] ../source3/smbd/service.c:552(make_connection_snum)
Jul 17 20:16:21 thing smbd[7958]:  create_connection_session_info failed: NT_STATUS_ACCESS_DENIED
Jul 17 20:16:22 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:16:27 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:16:27 thing ugen0.2: <Unknown> at usbus0 (disconnected)
Jul 17 20:16:27 thing uhub_reattach_port: could not allocate new device
Jul 17 20:16:28 thing usb_alloc_device: set address 2 failed (USB_ERR_IOERROR, ignored)
Jul 17 20:16:34 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:16:34 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:16:40 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:16:41 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:16:46 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:16:46 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:16:52 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:16:53 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:16:59 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:16:59 thing ugen0.2: <Unknown> at usbus0 (disconnected)
Jul 17 20:16:59 thing uhub_reattach_port: could not allocate new device
Jul 17 20:16:59 thing usb_alloc_device: set address 2 failed (USB_ERR_IOERROR, ignored)
Jul 17 20:17:04 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:17:04 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:17:09 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:17:10 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:17:16 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:17:16 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:17:22 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:17:23 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:17:28 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:17:28 thing ugen0.2: <Unknown> at usbus0 (disconnected)
Jul 17 20:17:28 thing uhub_reattach_port: could not allocate new device
Jul 17 20:17:29 thing usb_alloc_device: set address 2 failed (USB_ERR_IOERROR, ignored)
Jul 17 20:17:35 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:17:35 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:17:41 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:17:42 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:17:48 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:17:48 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:17:54 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:17:54 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:18:00 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:18:00 thing ugen0.2: <Unknown> at usbus0 (disconnected)
Jul 17 20:18:00 thing uhub_reattach_port: could not allocate new device
Jul 17 20:18:01 thing usb_alloc_device: set address 2 failed (USB_ERR_IOERROR, ignored)
Jul 17 20:18:07 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:18:07 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:18:12 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:18:13 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:18:19 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:18:19 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:18:21 thing smbd[8227]: [2016/07/17 20:18:21.657029,  1] ../source3/smbd/service.c:552(make_connection_snum)
Jul 17 20:18:21 thing smbd[8227]:  create_connection_session_info failed: NT_STATUS_ACCESS_DENIED
Jul 17 20:18:21 thing smbd[8228]: [2016/07/17 20:18:21.667689,  1] ../source3/smbd/service.c:552(make_connection_snum)
Jul 17 20:18:21 thing smbd[8228]:  create_connection_session_info failed: NT_STATUS_ACCESS_DENIED
Jul 17 20:18:25 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:18:26 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:18:31 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:18:31 thing ugen0.2: <Unknown> at usbus0 (disconnected)
Jul 17 20:18:31 thing uhub_reattach_port: could not allocate new device
Jul 17 20:18:32 thing usb_alloc_device: set address 2 failed (USB_ERR_IOERROR, ignored)
Jul 17 20:18:38 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:18:38 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:18:43 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:18:44 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:18:49 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:18:50 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:18:56 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:18:56 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:19:02 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:19:02 thing ugen0.2: <Unknown> at usbus0 (disconnected)
Jul 17 20:19:02 thing uhub_reattach_port: could not allocate new device
Jul 17 20:19:03 thing usb_alloc_device: set address 2 failed (USB_ERR_IOERROR, ignored)
Jul 17 20:19:08 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:19:08 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:19:14 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:19:15 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:19:20 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:19:21 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:19:27 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:19:27 thing usbd_req_re_enumerate: addr=2, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:19:33 thing usbd_setup_device_desc: getting device descriptor at addr 2 failed, USB_ERR_TIMEOUT
Jul 17 20:19:33 thing ugen0.2: <Unknown> at usbus0 (disconnected)
Jul 17 20:19:33 thing uhub_reattach_port: could not allocate new device
Jul 17 20:19:35 thing devd: Executing '[ -e /tmp/.sync_disk_done ] && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/sync_disks.py da1'
Jul 17 20:19:35 thing ugen0.2: <SanDisk> at usbus0
Jul 17 20:19:35 thing umass1: <SanDisk Extreme, class 0/0, rev 3.00/0.10, addr 21> on usbus0
Jul 17 20:19:35 thing umass1:  SCSI over Bulk-Only; quirks = 0x0100
Jul 17 20:19:35 thing umass1:6:1:-1: Attached to scbus6
Jul 17 20:19:35 thing da1 at umass-sim1 bus 1 scbus6 target 0 lun 0
Jul 17 20:19:35 thing da1: <SanDisk Extreme 0001> Removable Direct Access SPC-4 SCSI device
Jul 17 20:19:35 thing da1: Serial Number AA010923141442433556
Jul 17 20:19:35 thing da1: 400.000MB/s transfers
Jul 17 20:19:35 thing da1: 30533MB (62533296 512 byte sectors)
Jul 17 20:19:35 thing da1: quirks=0x2<NO_6_BYTE>
Jul 17 20:19:35 thing usb_alloc_device: set address 4 failed (USB_ERR_IOERROR, ignored)
Jul 17 20:19:41 thing usbd_setup_device_desc: getting device descriptor at addr 4 failed, USB_ERR_TIMEOUT
Jul 17 20:19:41 thing devd: Executing 'logger -p kern.notice -t ZFS 'vdev state changed, pool_guid=8106824598351290285 vdev_guid=85465884673041108''
Jul 17 20:19:41 thing ZFS: vdev state changed, pool_guid=8106824598351290285 vdev_guid=85465884673041108
Jul 17 20:19:42 thing usbd_req_re_enumerate: addr=4, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:19:47 thing usbd_setup_device_desc: getting device descriptor at addr 4 failed, USB_ERR_TIMEOUT
Jul 17 20:19:48 thing usbd_req_re_enumerate: addr=4, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:19:54 thing usbd_setup_device_desc: getting device descriptor at addr 4 failed, USB_ERR_TIMEOUT
Jul 17 20:19:54 thing usbd_req_re_enumerate: addr=4, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:19:59 thing usbd_setup_device_desc: getting device descriptor at addr 4 failed, USB_ERR_TIMEOUT
Jul 17 20:20:00 thing usbd_req_re_enumerate: addr=4, set address failed! (USB_ERR_IOERROR, ignored)
Jul 17 20:20:06 thing usbd_setup_device_desc: getting device descriptor at addr 4 failed, USB_ERR_TIMEOUT
Jul 17 20:20:06 thing ugen0.4: <Unknown> at usbus0 (disconnected)
Jul 17 20:20:06 thing uhub_reattach_port: could not allocate new device
Jul 17 20:20:06 thing usb_alloc_device: set address 4 failed (USB_ERR_IOERROR, ignored)
Jul 17 20:20:12 thing usbd_setup_device_desc: getting device descriptor at addr 4 failed, USB_ERR_TIMEOUT
Jul 17 20:20:12 thing usbd_req_re_enumerate: addr=4, set address failed! (USB_ERR_IOERROR, ignored)

I think the proble may be with the TS140's USB host and the driver used by FreeNAS but if that was so why am I the only person with a TS140 who is reporting this problem?

 

[Baenwort]

A last thought. Can I boot FreeNAS and pull the last remaining USB Stick out without it freaking? I can move the syslog and other items to write to the SSD_pool so in theory it should keep running.

 

[SweetAndLow]

Why haven't you tried a new usb stick yet? Looks like your are dead.

 

[Baenwort]

Why haven't you tried a new usb stick yet? Looks like your are dead.

I have tried a new stick. The Samsung one mention in the log above is a new one. This stick also shows as a USB KEY in the BIOS and when I have only the Sandisk and the Samsung that both ID as USB KEY inserted as my boot pool I stil get the repeated error message.

However, none of mine are dead. I can scrub the boot pool (I have a pair in mirror) and the scrub completes fine. I also do not see any errors from verifying install. Both of these lead me to believe my USB sticks are fine. Also, the fact that if I roll back to 9.3 these errors go away. (And I love the snapshots and roll back function!)