Did I crash my FreeNAS?

[ChrisNAS]

Hello,

I had just finished building this thing out with jail, webserver, apps, etc and took a long time.

My last to do was to try to get ubuntu to use hardware and research lead me to adding devices with passthrough. For example: iohyve set ubuntuguest pcidev:1=passthru,2/0/0

I did this for wifi, hd graphics, non vga, and audio. 4 devices. After setting those and restarting ubuntu guest, freenas access disappeared. No web interface or ssh access.

I don't know what happened. I didn't try to pass through the ethernet, which is realtek, only wifi which is intel.

Immediately looking at monitor there's just lines of re0: watchdog timeout. Soft reset did nothing. Had to power down and back up.

Everything looked normal (to my noob eyes) on screen with booting up. Once I get the line about accessing inteface IP, shortly after the errors start popping up.

Kinda freaking out here! :( I snapped some pictures of errors.




If anyone could help out I would be tremendously grateful.

 

[nojohnny101]

You need to provide full hardware specs. We have no idea what you're running.

CAM status usually indicates a hardware problem but even saying that is shooting in the dark without more information from you.

 

[ChrisNAS]

Sorry, didn't even think about that. System been running great for about a month no issues. But I guess it could be a hardware problem. Are there any particular specs that I should list?

FN 11 Nightlies
2 x Seagate HDs
1 x Samsung SSD
1 x King Dian (small ssd for OS)
16gb Memory
i5-6400T

System is an asus mini pc. Not yet found system spec details on asus site other than features. But I do have in terminal history output of pciconf.

hostb0@pci0:0:0:0: class=0x060000 card=0x191f8086 chip=0x191f8086 rev=0x07 hdr=0x00
vendor = 'Intel Corporation'
device = 'Skylake Host Bridge/DRAM Registers'
class = bridge
subclass = HOST-PCI
pcib1@pci0:0:1:0: class=0x060400 card=0x19018086 chip=0x19018086 rev=0x07 hdr=0x01
vendor = 'Intel Corporation'
device = 'Skylake PCIe Controller (x16)'
class = bridge
subclass = PCI-PCI
vgapci0@pci0:0:2:0: class=0x030000 card=0x19128086 chip=0x19128086 rev=0x06 hdr=0x00
vendor = 'Intel Corporation'
device = 'HD Graphics 530'
class = display
subclass = VGA
none0@pci0:0:19:0: class=0x000000 card=0xa1358086 chip=0xa1358086 rev=0x31 hdr=0x00
vendor = 'Intel Corporation'
device = 'Sunrise Point-H Integrated Sensor Hub'
class = old
subclass = non-VGA display device
xhci0@pci0:0:20:0: class=0x0c0330 card=0x86941043 chip=0xa12f8086 rev=0x31 hdr=0x00
vendor = 'Intel Corporation'
device = 'Sunrise Point-H USB 3.0 xHCI Controller'
class = serial bus
subclass = USB
none1@pci0:0:20:2: class=0x118000 card=0xa1318086 chip=0xa1318086 rev=0x31 hdr=0x00
vendor = 'Intel Corporation'
device = 'Sunrise Point-H Thermal subsystem'
class = dasp
none2@pci0:0:22:0: class=0x078000 card=0xa13a8086 chip=0xa13a8086 rev=0x31 hdr=0x00
vendor = 'Intel Corporation'
device = 'Sunrise Point-H CSME HECI'
class = simple comms
ahci0@pci0:0:23:0: class=0x010601 card=0xa1028086 chip=0xa1028086 rev=0x31 hdr=0x00
vendor = 'Intel Corporation'
device = 'Sunrise Point-H SATA controller [AHCI mode]'
class = mass storage
subclass = SATA
pcib2@pci0:0:28:0: class=0x060400 card=0xa1148086 chip=0xa1148086 rev=0xf1 hdr=0x01
vendor = 'Intel Corporation'
device = 'Sunrise Point-H PCI Express Root Port'
class = bridge
subclass = PCI-PCI
pcib3@pci0:0:28:5: class=0x060400 card=0xa1158086 chip=0xa1158086 rev=0xf1 hdr=0x01
vendor = 'Intel Corporation'
device = 'Sunrise Point-H PCI Express Root Port'
class = bridge
subclass = PCI-PCI
isab0@pci0:0:31:0: class=0x060100 card=0xa1448086 chip=0xa1448086 rev=0x31 hdr=0x00
vendor = 'Intel Corporation'
device = 'Sunrise Point-H LPC Controller'
class = bridge
subclass = PCI-ISA
none3@pci0:0:31:2: class=0x058000 card=0xa1218086 chip=0xa1218086 rev=0x31 hdr=0x00
vendor = 'Intel Corporation'
device = 'Sunrise Point-H PMC'
class = memory
none4@pci0:0:31:3: class=0x040300 card=0x86b61043 chip=0xa1708086 rev=0x31 hdr=0x00
vendor = 'Intel Corporation'
device = 'Sunrise Point-H HD Audio'
class = multimedia
subclass = HDA
none5@pci0:0:31:4: class=0x0c0500 card=0xa1238086 chip=0xa1238086 rev=0x31 hdr=0x00
vendor = 'Intel Corporation'
device = 'Sunrise Point-H SMBus'
class = serial bus
subclass = SMBus
none6@pci0:2:0:0: class=0x028000 card=0x50108086 chip=0x095a8086 rev=0x59 hdr=0x00
vendor = 'Intel Corporation'
device = 'Wireless 7265'
class = network
re0@pci0:3:0:0: class=0x020000 card=0x86771043 chip=0x816810ec rev=0x15 hdr=0x00
vendor = 'Realtek Semiconductor Co., Ltd.'
device = 'RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller'
class = network
subclass = ethernet


In the first errors pic, I see "ada0 King Dian...... detached" and that is the small SSD that FN is installed on. Maybe that is failing? But why does system boot every time I power it up?

I feel like during the boot process, iohyve boots up ubuntu with the device passthrough and that causes FN to lose its connectivity.

Please let me know what else I can provide.

Thank you

 

[ChrisNAS]

I just tried boot options, selecting a previous instance. Booted up and am able to use FN. However, I have no clue what's been lost. Previous instance is couple weeks old and a LOT has been done since.

What can/should I do?

 

[Stux]

Try booting up with the latest install, but in single user (or whatever mode) and see if that boots.

 

[ChrisNAS]

Man I was on the verge of freaking out...

I booted to previous instance, ssh'd to FN, and was able to remove the properties I added with iohyve, rebooted to the latest FN instance, and it worked! I'm now checking out to determine if any losses.

SO... for anyone who does not know exactly what they're doing in regards to iohyve with pcidev/passthru, make sure you do know what you're doing FIRST. Even if you think you got it, make sure.

Removed properties:

[me@freenas ~]# iohyve rmpci guestos pcidev:1
[me@freenas ~]# iohyve rmpci guestos pcidev:2
etc...

And returned bargs back:

[me@freenas ~]# iohyve guestos set bargs="-A_-H_-P"

First move now... BACKUP!!!!

 

[Stux]

First move now... BACKUP!!!!

Setup a config backup email script too...

Iohyve properties are stored in your pool, and the config backup can be used to restore your freenas install. Your data should've been safe the whole time.