Hi
So this is my first post on freenas forums (sorry long one) and i have some trouble with old hardware that i want to try to run Freenas on but i hit a brick wall :/ I work as a sysadmin with Unix/Linux since well a long time and one of the reasons that i opted for Freenas was that i have never used freebsd so a lot of new commands and stuff to learn :) and this was my thoughts to ease in to it...
So about my problem(s)
I have errors with multipathing and CAM status.
All of a sudden one path fails and never recovers and to top it off kernel panic and the system takes a dive... I have multiple boxes like this so i switchet around cables HBA's Disk Shellfs and so on but i cant seam to get a stabel system out of my hardware :/.
Errors like this popps in and out
Its stated that Freenas should have suport for PMC Sierra 8001 cards and i see it pop up in dmesg
pcib11: <ACPI PCI-PCI bridge> at device 9.0 on pci0
pci11: <ACPI PCI bus> on pcib11
pmspcv0: <PMC Sierra SPC SAS-SATA Card> mem 0xdf6f0000-0xdf6fffff,0xdf6e0000-0xdf6effff,0xdf6d0000-0xdf6dffff,0xdf6c0000-0xdf6cffff irq 32 at device 0.0 on pci11
pci0: <base peripheral, interrupt controller> at device 20.0 (no driver attached)
(noperiph\:mspcbsd0:0:-1:ffffffff): rescan already queued
(noperiph\:mspcbsd0:0:-1:ffffffff): rescan already queued
pci0: <base peripheral, interrupt controller> at device 20.1 (no driver attached)
pci0: <base peripheral, interrupt controller> at device 20.2 (no driver attached)
pci0: <base peripheral, interrupt controller> at device 20.3 (no driver attached)
does pmspcv0: <PMC.... means i have suport for the card im guessing so ?
But when i look with
kldstat: can't find file pmspcv.ko: No such file or directory
I found some page hinting on load it as a module in loader.conf
still the same output on kldstat -n pmspcv.ko
kldstat: can't find file pmspcv.ko: No such file or directory
To load a module dosent it need to be present under /boot/kernel/ or /boot/modules ???
Disk/HW info
P.S sorry for long post :/
So this is my first post on freenas forums (sorry long one) and i have some trouble with old hardware that i want to try to run Freenas on but i hit a brick wall :/ I work as a sysadmin with Unix/Linux since well a long time and one of the reasons that i opted for Freenas was that i have never used freebsd so a lot of new commands and stuff to learn :) and this was my thoughts to ease in to it...
So about my problem(s)
I have errors with multipathing and CAM status.
All of a sudden one path fails and never recovers and to top it off kernel panic and the system takes a dive... I have multiple boxes like this so i switchet around cables HBA's Disk Shellfs and so on but i cant seam to get a stabel system out of my hardware :/.
Errors like this popps in and out
Code:
May 6 09:06:50 freenas (da20:pmspcbsd0:0:20:0): CAM status: SCSI Status Error May 6 09:06:50 freenas (da20:pmspcbsd0:0:20:0): SCSI status: Check Condition May 6 09:06:50 freenas (da20:pmspcbsd0:0:20:0): SCSI sense: ABORTED COMMAND asc:4b,5 (Data offset error) May 6 23:39:33 freenas.local GEOM_MULTIPATH: Error 5, da27 in disk8 marked FAIL May 6 23:39:33 freenas.local GEOM_MULTIPATH: da5 is now active path in disk8 May 6 23:42:41 freenas.local swap_pager: indefinite wait buffer: bufobj: 0, blkno: 15184, size: 20480
Its stated that Freenas should have suport for PMC Sierra 8001 cards and i see it pop up in dmesg
pcib11: <ACPI PCI-PCI bridge> at device 9.0 on pci0
pci11: <ACPI PCI bus> on pcib11
pmspcv0: <PMC Sierra SPC SAS-SATA Card> mem 0xdf6f0000-0xdf6fffff,0xdf6e0000-0xdf6effff,0xdf6d0000-0xdf6dffff,0xdf6c0000-0xdf6cffff irq 32 at device 0.0 on pci11
pci0: <base peripheral, interrupt controller> at device 20.0 (no driver attached)
(noperiph\:mspcbsd0:0:-1:ffffffff): rescan already queued
(noperiph\:mspcbsd0:0:-1:ffffffff): rescan already queued
pci0: <base peripheral, interrupt controller> at device 20.1 (no driver attached)
pci0: <base peripheral, interrupt controller> at device 20.2 (no driver attached)
pci0: <base peripheral, interrupt controller> at device 20.3 (no driver attached)
does pmspcv0: <PMC.... means i have suport for the card im guessing so ?
But when i look with
kldstat -n pmspcv.ko
kldstat: can't find file pmspcv.ko: No such file or directory
Code:
# kldstat -d Id Refs Address Size Name 1 72 0xffffffff80200000 20a0000 kernel 2 1 0xffffffff82631000 ffe3c ispfw.ko 3 1 0xffffffff82731000 7f2a freenas_sysctl.ko 4 1 0xffffffff82811000 84a6 ipmi.ko 5 1 0xffffffff8281a000 ef2 smbus.ko 6 1 0xffffffff8281b000 333885 vmm.ko 7 1 0xffffffff82b4f000 3108 nmdm.ko 8 1 0xffffffff82b53000 101c6 geom_mirror.ko 9 1 0xffffffff82b64000 46c3 geom_stripe.ko 10 1 0xffffffff82b69000 fbad geom_raid3.ko 11 1 0xffffffff82b79000 16e56 geom_raid5.ko 12 1 0xffffffff82b90000 59c9 geom_gate.ko 13 1 0xffffffff82b96000 4d68 geom_multipath.ko 14 1 0xffffffff82b9b000 837 dtraceall.ko 15 9 0xffffffff82b9c000 41e31 dtrace.ko 16 1 0xffffffff82bde000 48f4 dtmalloc.ko 17 1 0xffffffff82be3000 5b4e dtnfscl.ko 18 1 0xffffffff82be9000 67f3 fbt.ko 19 1 0xffffffff82bf0000 58e8a fasttrap.ko 20 1 0xffffffff82c49000 1741 sdt.ko 21 1 0xffffffff82c4b000 bf02 systrace.ko 22 1 0xffffffff82c57000 c082 systrace_freebsd32.ko 23 1 0xffffffff82c64000 5452 profile.ko 24 1 0xffffffff82c6a000 1bbc9 hwpmc.ko 25 1 0xffffffff82c86000 d006 t3_tom.ko 26 2 0xffffffff82c94000 4626 toecore.ko 27 1 0xffffffff82c99000 15e3a t4_tom.ko
I found some page hinting on load it as a module in loader.conf
Code:
vi /boot/loader.conf pmspcv_load="YES"
still the same output on kldstat -n pmspcv.ko
kldstat: can't find file pmspcv.ko: No such file or directory
To load a module dosent it need to be present under /boot/kernel/ or /boot/modules ???
Disk/HW info
Code:
# camcontrol devlist <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 0 lun 0 (da0,pass2) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 1 lun 0 (da1,pass3) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 2 lun 0 (da2,pass4) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 3 lun 0 (da3,pass5) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 4 lun 0 (da4,pass6) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 5 lun 0 (da5,pass7) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 6 lun 0 (da6,pass8) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 7 lun 0 (da7,pass9) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 8 lun 0 (da8,pass10) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 9 lun 0 (da9,pass11) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 10 lun 0 (da10,pass12) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 11 lun 0 (da11,pass13) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 12 lun 0 (da12,pass14) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 13 lun 0 (da13,pass15) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 14 lun 0 (da14,pass16) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 15 lun 0 (da15,pass17) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 16 lun 0 (da16,pass18) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 17 lun 0 (da17,pass19) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 18 lun 0 (da18,pass20) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 19 lun 0 (da19,pass21) <STEC ZeusIOPs G3 E12B> at scbus0 target 20 lun 0 (da20,pass22) <STEC ZeusIOPs G3 E12B> at scbus0 target 21 lun 0 (da21,pass23) <SUN Storage J4410 3529> at scbus0 target 22 lun 0 (pass24,ses0) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 23 lun 0 (da22,pass25) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 24 lun 0 (da23,pass26) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 25 lun 0 (da24,pass27) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 26 lun 0 (da25,pass28) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 27 lun 0 (da26,pass29) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 28 lun 0 (da27,pass30) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 29 lun 0 (da28,pass31) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 30 lun 0 (da29,pass32) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 31 lun 0 (da30,pass33) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 32 lun 0 (da31,pass34) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 33 lun 0 (da32,pass35) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 34 lun 0 (da33,pass36) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 35 lun 0 (da34,pass37) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 36 lun 0 (da35,pass38) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 37 lun 0 (da36,pass39) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 38 lun 0 (da37,pass40) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 39 lun 0 (da38,pass41) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 40 lun 0 (da39,pass42) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 41 lun 0 (da40,pass43) <SEAGATE ST32000SSSUN2.0T 061A> at scbus0 target 42 lun 0 (da41,pass44) <STEC ZeusIOPs G3 E12B> at scbus0 target 43 lun 0 (da42,pass45) <STEC ZeusIOPs G3 E12B> at scbus0 target 44 lun 0 (da43,pass46) <SUN Storage J4410 3529> at scbus0 target 45 lun 0 (pass47,ses1) <SEAGATE ST95000NSSUN500G 1109M2L0ZG SF04> at scbus1 target 0 lun 0 (pass0,ada0) <SEAGATE ST95000NSSUN500G 1108M2KAAX SF04> at scbus2 target 0 lun 0 (pass1,ada1) # zpool status pool: freenas-boot state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM freenas-boot ONLINE 0 0 0 ada0p2 ONLINE 0 0 0 errors: No known data errors pool: master state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM master ONLINE 0 0 0 raidz2-0 ONLINE 0 0 0 gptid/27696752-5146-11e8-a0b0-002128c0ab6e ONLINE 0 0 0 gptid/282c244a-5146-11e8-a0b0-002128c0ab6e ONLINE 0 0 0 gptid/28f1c382-5146-11e8-a0b0-002128c0ab6e ONLINE 0 0 0 gptid/29c004de-5146-11e8-a0b0-002128c0ab6e ONLINE 0 0 0 gptid/2a92f968-5146-11e8-a0b0-002128c0ab6e ONLINE 0 0 0 gptid/2b5e73f2-5146-11e8-a0b0-002128c0ab6e ONLINE 0 0 0 gptid/2c3d6af3-5146-11e8-a0b0-002128c0ab6e ONLINE 0 0 0 gptid/2d0d63c3-5146-11e8-a0b0-002128c0ab6e ONLINE 0 0 0 gptid/2dd6801f-5146-11e8-a0b0-002128c0ab6e ONLINE 0 0 0 gptid/2eac8189-5146-11e8-a0b0-002128c0ab6e ONLINE 0 0 0 gptid/2f84c5a5-5146-11e8-a0b0-002128c0ab6e ONLINE 0 0 0 gptid/30568a9b-5146-11e8-a0b0-002128c0ab6e ONLINE 0 0 0 gptid/31420621-5146-11e8-a0b0-002128c0ab6e ONLINE 0 0 0 gptid/322ad8b6-5146-11e8-a0b0-002128c0ab6e ONLINE 0 0 0 gptid/330e489b-5146-11e8-a0b0-002128c0ab6e ONLINE 0 0 0 gptid/33f0ec7e-5146-11e8-a0b0-002128c0ab6e ONLINE 0 0 0 gptid/34ca6c34-5146-11e8-a0b0-002128c0ab6e ONLINE 0 0 0 gptid/3598abcc-5146-11e8-a0b0-002128c0ab6e ONLINE 0 0 0 gptid/366c7863-5146-11e8-a0b0-002128c0ab6e ONLINE 0 0 0 gptid/374313e3-5146-11e8-a0b0-002128c0ab6e ONLINE 0 0 0 logs gptid/38602bc5-5146-11e8-a0b0-002128c0ab6e ONLINE 0 0 0 cache gptid/38e94a9a-5146-11e8-a0b0-002128c0ab6e ONLINE 0 0 0 errors: No known data errors # glabel status Name Status Components gptid/971fb895-4f6c-11e8-88d1-002128c0ab6e N/A ada0p1 gptid/27696752-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk3p2 gptid/282c244a-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk4p2 gptid/28f1c382-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk5p2 gptid/29c004de-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk6p2 gptid/2a92f968-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk7p2 gptid/2b5e73f2-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk8p2 gptid/2c3d6af3-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk9p2 gptid/2d0d63c3-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk10p2 gptid/2dd6801f-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk11p2 gptid/2eac8189-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk12p2 gptid/2f84c5a5-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk13p2 gptid/30568a9b-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk14p2 gptid/31420621-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk15p2 gptid/322ad8b6-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk16p2 gptid/330e489b-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk17p2 gptid/33f0ec7e-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk18p2 gptid/34ca6c34-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk19p2 gptid/3598abcc-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk20p2 gptid/366c7863-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk21p2 gptid/374313e3-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk22p2 gptid/38602bc5-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk1p1 gptid/38e94a9a-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk2p1 gptid/2e943c2a-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk12p1 gptid/2dc39b10-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk11p1 gptid/2cfc418c-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk10p1 gptid/2c25fd54-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk9p1 gptid/2b486738-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk8p1 gptid/2a836521-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk7p1 gptid/29a5beba-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk6p1 gptid/28e10dcf-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk5p1 gptid/281dfa3d-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk4p1 gptid/275b601f-5146-11e8-a0b0-002128c0ab6e N/A multipath/disk3p1
P.S sorry for long post :/
Last edited: