da6 CAM status SCSI Status Error

[modi]

So I got a new server about a week ago, and I had installed TrueNAS.
I setup everything, and after a hour or two, it complained about the pool being degraded/faulted.

I rebooted, and when it ran the scrub again, it threw the error again.
In the Serial, it is showing "da6 CAM status SCSI Status Error. \SCSI status: Check Condition. \SCSI sense: ABORTED COMMAND (NAK received)."
I've tried searching to forums, and nothing I've seen has been of help.

What I have done is, swapped the 2 drives in that VDEV, the error did not follow the drive, but stayed in that da6 bay.
I then tried swapping the two HBA cables around with each other (because I don't have replacement cables) that go to the back of the backplane, the error stayed in that da6 bay as well. (I imagine it would have moved if it was the cables, or the controller).
I then just ordered a replacement backplane, and just now swapped that out, booted and it's STILL throwing errors.

I'm at a loss and would really appreciate any input. I'm a bit newer to servers, so please bear with me if I misuse any terminology or anything.
I have tried searching the forums, and have found many people with this issue, but nothing I've read has seemed to be of any help.
Thank you.

Specs:
Processor: 2x Intel Xeon E5-2630 V2 Hex (6) Core 2.6GHz (total 12 Cores)
Memory: 64GB DDR3 ECC REG
Hard Drives: 8x 4TB SAS3 12Gbps HGST Hitachi -HUS726040AL4210 (wired to SAS3 controller S3008-8LE)
Controller: 1x AOC-S3008-8LE SAS3 HBA Controller SET TO IT MODE (4 remaining slots are wired to on board SATA, currently only being used for boot SSD, the rest of the drives are using SAS. IT mode flashing was done by the company.)
NIC: * Integrated Quad Intel 1000BASE-T Ports
Server Chassis/ Case: Supermicro 2U CSE-826A-R1200LPB
Motherboard: X9DRi-LN4F+
Backplane: BPN-SAS-826A I-Path Direct Attached Backplane
PCI-Expansions slots: Low Profile 4 x16 PCI-E 3.0, 1 x8 PCI-E 3.0, 1 x4 PCI-E 3.0 (in x8)
Power: 2x 920Watt Power Supply PWS-920P-1R Platium (Only 1 in currently)

 

[modi]

Here's the results of some commands that I have seen asked for in threads when searching that may be of help potentially?

# zpool status

Code:

# zpool status
pool: PrimaryPool
state: DEGRADED
status: One or more devices are faulted in response to persistent errors.
Sufficient replicas exist for the pool to continue functioning in a
degraded state.
action: Replace the faulted device, or use 'zpool clear' to mark the device
repaired.
scan: scrub repaired 0B in 00:13:04 with 0 errors on Thu Oct 28 16:59:58 2021
config:

NAME STATE READ WRITE CKSUM
PrimaryPool DEGRADED 0 0 0
mirror-0 ONLINE 0 0 0
gptid/d7476d46-32ca-11ec-b815-002590f52cc2 ONLINE 0 0 0
gptid/d8d6aa36-32ca-11ec-b815-002590f52cc2 ONLINE 0 0 0
mirror-1 ONLINE 0 0 0
gptid/d9a6f5dc-32ca-11ec-b815-002590f52cc2 ONLINE 0 0 0
gptid/db71bcb5-32ca-11ec-b815-002590f52cc2 ONLINE 0 0 0
mirror-2 ONLINE 0 0 0
gptid/d8b2f42f-32ca-11ec-b815-002590f52cc2 ONLINE 0 0 0
gptid/d96847a9-32ca-11ec-b815-002590f52cc2 ONLINE 0 0 0
mirror-3 DEGRADED 0 0 0
gptid/d9fb7757-32ca-11ec-b815-002590f52cc2 FAULTED 256 0 246K too many errors
gptid/da1e1121-32ca-11ec-b815-002590f52cc2 ONLINE 0 0 0

errors: No known data errors

pool: boot-pool
state: ONLINE
scan: scrub repaired 0B in 00:00:03 with 0 errors on Thu Oct 28 03:45:03 2021
config:

# camcontrol devlist

Code:

# camcontrol devlist
<SanDisk SDSSDH3 512G 40101000> at scbus2 target 0 lun 0 (pass0,ada0)<AHCI SGPIO Enclosure 2.00 0001> at scbus7 target 0 lun 0 (pass1,ses0)
<HGST HUS726040AL4210 A980> at scbus8 target 0 lun 0 (pass2,da0)<HGST HUS726040AL4210 A980> at scbus8 target 1 lun 0 (pass3,da1)
<HGST HUS726040AL4210 A980> at scbus8 target 2 lun 0 (pass4,da2)<HGST HUS726040AL4210 A980> at scbus8 target 3 lun 0 (pass5,da3)
<HGST HUS726040AL4210 A980>        at scbus8 target 4 lun 0 (pass6,da4)

 

[modi]

The camcontrol didn't paste the whole list, my apologies.
Here's the fixed codebox:

Code:

# camcontrol devlist
<SanDisk SDSSDH3 512G 40101000> at scbus2 target 0 lun 0 (pass0,ada0)
<AHCI SGPIO Enclosure 2.00 0001> at scbus7 target 0 lun 0 (pass1,ses0)
<HGST HUS726040AL4210 A980> at scbus8 target 0 lun 0 (pass2,da0)
<HGST HUS726040AL4210 A980> at scbus8 target 1 lun 0 (pass3,da1)
<HGST HUS726040AL4210 A980> at scbus8 target 2 lun 0 (pass4,da2)
<HGST HUS726040AL4210 A980> at scbus8 target 3 lun 0 (pass5,da3)
<HGST HUS726040AL4210 A980>  at scbus8 target 4 lun 0 (pass6,da4)
<HGST HUS726040AL4210 A980>  at scbus8 target 5 lun 0 (pass7,da5)
<HGST HUS726040AL4210 A980>  at scbus8 target 6 lun 0 (pass8,da6)
<HGST HUS726040AL4210 A980>  at scbus8 target 7 lun 0 (pass9,da7)

 

[sretalla]

So I'm going to guess that

gptid/d9fb7757-32ca-11ec-b815-002590f52cc2 FAULTED 256 0 246K too many errors

is /dev/da6

You can use glabel status to confirm that more clearly.

What will be interesting to confirm is the output from smartctl -a /dev/da6

 

[modi]

So I'm going to guess that

is /dev/da6

I am pretty sure I have confirmed this the other day. I'm not able to double check at this moment, but I can report back in a few hours.

You can use glabel status to confirm that more clearly.

What will be interesting to confirm is the output from smartctl -a /dev/da6

I had ran SMART tests on all the drives, and if I read them correctly they all passed. Furthermore I had swapped the two drives around in that VDEV, and it showed the error as da6 still. It should have changed if it was the drive, am I wrong?
Anyways I'll grab the smartctl when I can in a few hours as well and post it just for clarity.

Appreciate any other suggestions of things to try though, I have another one of those drives on the way that I can try adding in. But in the meantime, if there's some potential software settings, or anything I'm all ears.
I've considering ordering 2 new SAS cables to just try replacing the two in there at this point but didn't want to spend the $26 if I didn't need to. As I said originally, I swapped these two around and the error still stuck on da6, so it didn't seem like the cables.

 

[sretalla]

I swapped these two around and the error still stuck on da6, so it didn't seem like the cables.

Depends what you swapped... can you empty the slot that usually gets assigned to da6 and put that disk in a different one?

 

[modi]

Depends what you swapped... can you empty the slot that usually gets assigned to da6 and put that disk in a different one?

I had tried swapping those 2 disks around (the disk in da6, with the other one in that vdev). As I said the error stayed as stated.

I did also however try doing what you suggest, emptying that da6 bay and moving the drive to one of the open bays. For some reason it wasn't powering on that drive though. So I had swapped it back. I know those extra bays are only going over SATA not SAS but I think those drives should be able to power on over SATA no issue.
I'll give it another try in a few hours maybe it was seated poorly.

Again though, if the error didn't follow to the other bay when swapping the two disks around, then i don't see why it'd be the disk.
And if the error didn't go away when I completely put in a new backplane (and furthermore STAYED erroring for "da6") then what else can it even be besides software?
The controller? I would've imagined swapping those two cables around on the controller would've moved the error, but maybe not? Not sure.
Just brainstorming.

Could it be a setting in the BIOS? There's a lot of settings I didn't really understand but I didn't exactly see anything that relates to that. I know there's also something "Avago" settings when I boot the machine, but I didn't see much in there I think that's the controller. I know the controller is flashed with IT mode (by Unixsurplus which is where I bought it, but I can't imagine the firmware would only throw errors on one bay like that, or even stick when swapping cables to the controller). I don't know. I had messaged the company and haven't heard back yet.
Pulling my hair out haha appreciate your support.

 

[modi]

gptid/d9fb7757-32ca-11ec-b815-002590f52cc2 FAULTED 256 0 246K too many errors

So I'm going to guess that

is /dev/da6

You can use glabel status to confirm that more clearly.

Here's the commands before I moved the drive out of the bay:

glabel status

Code:

# glabel status
                                      Name  Status  Components
gptid/0db68b72-32a7-11ec-8c36-002590f52cc2     N/A  ada0p1
gptid/d8b2f42f-32ca-11ec-b815-002590f52cc2     N/A  da0p2
gptid/d96847a9-32ca-11ec-b815-002590f52cc2     N/A  da1p2
gptid/d9fb7757-32ca-11ec-b815-002590f52cc2     N/A  da2p2
gptid/da1e1121-32ca-11ec-b815-002590f52cc2     N/A  da3p2
gptid/d7476d46-32ca-11ec-b815-002590f52cc2     N/A  da4p2
gptid/d8d6aa36-32ca-11ec-b815-002590f52cc2     N/A  da5p2

gptid/d9a6f5dc-32ca-11ec-b815-002590f52cc2      N/A  da6p2

gptid/db71bcb5-32ca-11ec-b815-002590f52cc2    N/A   da7p2

gptid/0dbaec8b-32a7-11ec-8c36-002590f52cc2    N/A    ada0p3

What will be interesting to confirm is the output from smartctl -a /dev/da6

Code:

# smartctl -a /dev/da6



smartctl 7.2 2020-12-30 r5155 [FreeBSD 12.2-RELEASE-p10 amd64] (local build)
Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:               HGST
Product:              HUS726040AL4210
Revision:             A980
Compliance:           SPC-4
User Capacity:        4,000,787,030,016 bytes [4.00 TB]
Logical block size:   512 bytes
Physical block size:  4096 bytes
LU is fully provisioned
Rotation Rate:        7200 rpm
Form Factor:          3.5 inches
Logical Unit id:      0x5000cca244194888
Serial number:        N8GEX1NY
Device type:          disk
Transport protocol:   SAS (SPL-3)
Local Time is:        Fri Oct 29 12:46:33 2021 EDT
SMART support is:     Available - device has SMART capability.
SMART support is:     Enabled
Temperature Warning:  Enabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK

Current Drive Temperature:     32 C
Drive Trip Temperature:        85 C

Accumulated power on time, hours:minutes 33586:07
Manufactured in week 29 of year 2016
Specified cycle count over device lifetime:  50000
Accumulated start-stop cycles:  53
Specified load-unload count over device lifetime:  600000
Accumulated load-unload cycles:  1456
Elements in grown defect list: 0

Vendor (Seagate Cache) information
  Blocks sent to initiator = 3314692885839872

Error counter log:
           Errors Corrected by           Total   Correction     Gigabytes    Total
               ECC          rereads/    errors   algorithm      processed    uncorrected
           fast | delayed   rewrites  corrected  invocations   [10^9 bytes]  errors
read:          0       23         0        23   12190225     262868.493  0
write:         0       53         0        53    2343842      21197.984  0
verify:        0        0         0         0     373120          0.000  0

Non-medium error count:        0

SMART Self-test log
Num  Test              Status                 segment  LifeTime  LBA_first_err [SK ASC ASQ]
     Description                              number   (hours)
# 1  Background short  Completed                   -   33573                 - [-   -    -]
# 2  Background short  Completed                   -   33550                 - [-   -    -]
# 3  Background short  Completed                   -   33531                 - [-   -    -]
# 4  Background short  Completed                   -   33507                 - [-   -    -]
# 5  Background long   Completed                   -   33495                 - [-   -    -]
# 6  Background short  Completed                   -   33483                 - [-   -    -]
# 7  Background short  Completed                   -   33445                 - [-   -    -]
# 8  Background long   Completed                   -   33426                 - [-   -    -]
# 9  Background long   Aborted (by user command)   -   33417                 - [-   -    -]
#10  Background long   Self test in progress ...   -     NOW      

# 11  Background short Completed                   -   33351 - [-   -    -]



Long (extended) Self-test duration: 34237 seconds [570.6 minutes]

Here's a snippet of the errors it's throwing so you can see exactly. It just spams the log/serial with the same set of messages:

Code:

0 00
Oct 29 07:18:08 (da6:mpr0:0:6:0): CAM status: SCSI Status Error
Oct 29 07:18:08 (da6:mpr0:0:6:0): SCSI status: Check Condition
Oct 29 07:18:08 (da6:mpr0:0:6:0): SCSI sense: ABORTED COMMAND asc:4b,4 (NAK received)
Oct 29 07:18:08 (da6:mpr0:0:6:0): Command Specific Info: 0
Oct 29 07:18:08 (da6:mpr0:0:6:0): Descriptor 0x80: f5 50
Oct 29 07:18:08 (da6:mpr0:0:6:0): Descriptor 0x81: 00 00 00 00 00 00
Oct 29 07:18:08 (da6:mpr0:0:6:0): Retrying command (per sense data)
Oct 29 07:18:09 (da6:mpr0:0:6:0): READ(10). CDB: 28 00 c1 24 c2 88 00 01 00 00
Oct 29 07:18:09 (da6:mpr0:0:6:0): CAM status: SCSI Status Error
Oct 29 07:18:09 (da6:mpr0:0:6:0): SCSI status: Check Condition
Oct 29 07:18:09 (da6:mpr0:0:6:0): SCSI sense: ABORTED COMMAND asc:4

__________________



Here's commands after I moved the drive out of the bay:

can you empty the slot that usually gets assigned to da6 and put that disk in a different one?

It seems to not detect the drive when plugged into the bay using SATA instead of going to the SAS controller.

There's no power indicator on the drive either. It is worth noting the SSD booting the host is on one of those 4 state ports.

Here's the zpool status after taking the drive out of da6.

Code:

# zpool status  pool: PrimaryPool
 state: DEGRADEDstatus: One or more devices could not be opened.  Sufficient replicas exist for
        the pool to continue functioning in a degraded state.action: Attach the missing device and online it using 'zpool online'.
   see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-2Q  scan: resilvered 69.4G in 00:23:46 with 0 errors on Thu Oct 28 18:15:17 2021
config:
        NAME                                            STATE     READ WRITE CKS
UM
        PrimaryPool                                     DEGRADED     0     0
 0
          mirror-0                                      ONLINE       0     0
 0
            gptid/d7476d46-32ca-11ec-b815-002590f52cc2  ONLINE       0     0
 0
            gptid/d8d6aa36-32ca-11ec-b815-002590f52cc2  ONLINE       0     0
 0
          mirror-1                                      DEGRADED     0     0
 0
            9326272103703545202                         UNAVAIL      0     0
 0  was /dev/gptid/d9a6f5dc-32ca-11ec-b815-002590f52cc2
            gptid/db71bcb5-32ca-11ec-b815-002590f52cc2  ONLINE       0     0 0
          mirror-2                                      ONLINE       0     0 0
            gptid/d8b2f42f-32ca-11ec-b815-002590f52cc2  ONLINE       0     0 0
            gptid/d96847a9-32ca-11ec-b815-002590f52cc2  ONLINE       0     0 0
          mirror-3                                      ONLINE       0     0 0
            gptid/d9fb7757-32ca-11ec-b815-002590f52cc2  ONLINE       0     0 0
            gptid/da1e1121-32ca-11ec-b815-002590f52cc2  ONLINE       0     0 0

errors: No known data errors

  pool: boot-pool
 state: ONLINE
  scan: scrub repaired 0B in 00:00:03 with 0 errors on Thu Oct 28 03:45:03 2021
config:

What's interesting is it does still show all 8 HDD's + Host SSD still when using camcontrol devlist

Code:

# camcontrol devlist

<SanDisk SDSSDH3 512G 40101000> at scbus2 target 0 lun 0 (pass0,ada0)

<AHCI SGPIO Enclosure 2.00 0001> at scbus7 target 0 lun 0 (pass1,ses0)

<HGST HUS726040AL4210 A980> at scbus8 target 0 lun 0 (pass2,da0)

<HGST HUS726040AL4210 A980> at scbus8 target 1 lun 0 (pass3,da1)

<HGST HUS726040AL4210 A980> at scbus8 target 2 lun 0 (pass4,da2)

<HGST HUS726040AL4210 A980> at scbus8 target 3 lun 0 (pass5,da3)

<HGST HUS726040AL4210 A980>  at scbus8 target 4 lun 0 (pass6,da4)

<HGST HUS726040AL4210 A980>  at scbus8 target 5 lun 0 (pass7,da5)

<HGST HUS726040AL4210 A980>  at scbus8 target 6 lun 0 (pass8,da6)

<HGST HUS726040AL4210 A980>  at scbus8 target 7 lun 0 (pass9,da7)

And also still shows all 10 devices with glabel status (although slightly different than when I first ran the command above):

Code:

                                      Name  Status  Components
gptid/0db68b72-32a7-11ec-8c36-002590f52cc2     N/A  ada0p1
gptid/d8b2f42f-32ca-11ec-b815-002590f52cc2     N/A  da0p2
gptid/d96847a9-32ca-11ec-b815-002590f52cc2     N/A  da1p2
gptid/d9fb7757-32ca-11ec-b815-002590f52cc2     N/A  da2p2
gptid/da1e1121-32ca-11ec-b815-002590f52cc2     N/A  da3p2
gptid/d7476d46-32ca-11ec-b815-002590f52cc2     N/A  da4p2
gptid/d8d6aa36-32ca-11ec-b815-002590f52cc2     N/A  da5p2
gptid/db71bcb5-32ca-11ec-b815-002590f52cc2     N/A  da6p2

gptid/d7f09611-32ca-11ec-b815-002590f52cc2      N/A  da0p1

gptid/0dbaec8b-32a7-11ec-8c36-002590f52cc2     N/A  ada0p3

Thank you.

 

[Spearfoot]

Here's a snippet of the errors it's throwing so you can see exactly. It just spams the log/serial with the same set of messages:

Code:

Oct 29 07:18:08 (da6:mpr0:0:6:0): CAM status: SCSI Status Error
Oct 29 07:18:08 (da6:mpr0:0:6:0): SCSI status: Check Condition
Oct 29 07:18:08 (da6:mpr0:0:6:0): SCSI sense: ABORTED COMMAND asc:4b,4 (NAK received)
Oct 29 07:18:08 (da6:mpr0:0:6:0): Command Specific Info: 0
Oct 29 07:18:08 (da6:mpr0:0:6:0): Descriptor 0x80: f5 50
Oct 29 07:18:08 (da6:mpr0:0:6:0): Descriptor 0x81: 00 00 00 00 00 00
Oct 29 07:18:08 (da6:mpr0:0:6:0): Retrying command (per sense data)
Oct 29 07:18:09 (da6:mpr0:0:6:0): READ(10). CDB: 28 00 c1 24 c2 88 00 01 00 00
Oct 29 07:18:09 (da6:mpr0:0:6:0): CAM status: SCSI Status Error
Oct 29 07:18:09 (da6:mpr0:0:6:0): SCSI status: Check Condition
Oct 29 07:18:09 (da6:mpr0:0:6:0): SCSI sense: ABORTED COMMAND asc:4

Those mpr error messages may indicate a bad hard drive or a bad HBA card. I've only glanced through your posts -- have you been able to establish whether the error follows the drive? Or does the error always occur on the same port of the HBA?

I had the misfortune to buy 3 bad HBA cards from the same seller as yours; all showed similar error messages in the system log; all were Supermicro AOC-S3008L-L8e cards like yours.

See this link at STH for details:

Misadventures with LSI SAS3008 cards

This Spring I bought 3 of Supermicro's AOC-S3008L-L8e cards, with the idea of upgrading the 3 LSI SAS 9210-8i HBAs in my main X9DRi-LN4F+-based FreeNAS server. These should just be a 'drop-in' upgrade, right? Wrong! I got all kinds of errors, like this:(da2:mpr0:0:0:0): READ(10). CDB: 28 00 e8...

forums.servethehome.com

My advice is: return the HBA for a refund and buy a genuine LSI SAS9300-8i card.

 

[modi]

The error didn't seem to follow the drive as I stated on my original post.
Maybe it is the HBA, that being said why would it only throw errors on da6, even after swapping the cables.
Wouldn't da6 change to da2 or something after swapping the HBA cables around?

The cards came with phase 16.00.01.00 firmware, so I then tried Supermicro's phase 16.00.10.00

I noticed this as well. The company asked me to reflash the HBA, and when doing so I noticed it was .01 and I had tried .10. Didn't fix but thought it was weird.
I'm new to the networking world, so excuse my lack of knowledge. I saw someone say in that thread there's issues with the MPR driver.
Is there an alternative driver I shpuld be using. I know I've seen the words MPR driver in my troubleshooting process, I'm unsure where though. Is this the HBA driver and just needs to be flashed with something different? Or is this a simple thing to try changing on TrueNAS?

 

[modi]

Reading more into it, it looks like it's just a FreeBSD option.

I see in their man pages it says to place in /boot/loader.conf
mps_load="YES"
mpr_load="NO"
to achieve this. But I did that and rebooted and it did not seem to work. The errors are still showing da6:mpr instead of da6:mps.

 

[Spearfoot]

@modi : we're dealing with the HBA (Host Bus Adapater), which controls your hard drives. This doesn't have anything to do with networking per se.

There may be problems with the FreeBSD mpr driver, but I suspect the people experiencing problems most likely just have bad HBA cards. Why? Because too many users with the same card have no problems whatsoever with the mpr driver on FreeBSD/FreeNAS/TrueNAS.

FreeNAS/TrueNAS will automatically load the correct driver, depending on your HBA card and the firmware it's running. Also, any changes you make to the loader configuration are over-written by FreeNAS/TrueNAS at startup. So it's pretty much a waste of time to try to force a different driver.

As I mentioned above, I recommend returning this HBA card and getting an Avago/Broadcom/LSI SAS9300-8i card. The Supermicro card you have is functionally identical to the SAS9300, but I've had zero success with them while the SAS9300 has always worked for me. I'm stuck with 3 of the Supermicro cards that don't work and which I couldn't return because I didn't realize they were bad until after the return window had closed. Granted this is anecdotal, but it's caveat emptor when buying used IT gear and sometimes you'll get a dud.

 

[modi]

Didn't mean to say networking, I was half alseep when I wrote that original point. But overall servers in general. Anyways, ok, guess I'll have to grab a new card. There's also the worry of buying a dud SAS9300 but at this point I guess. Can you confirm, Is this the card you are suggesting buying?

LSI SAS 9302-8i 12Gb/s 8-port IT-Mode HBA JBOD FreeNAS unRAID +2* SATA Cable | eBay

Find many great new & used options and get the best deals for LSI SAS 9302-8i 12Gb/s 8-port IT-Mode HBA JBOD FreeNAS unRAID +2* SATA Cable at the best online prices at eBay! Free shipping for many products!

www.ebay.com

Found this one as well, a bit cheaper, quicker shipping too.

OEM LSI 9300-8i SATA / SAS HBA Controller IT-Mode 12Gb PCIe x8 LSI RAID TrueNAS | eBay

Find many great new & used options and get the best deals for OEM LSI 9300-8i SATA / SAS HBA Controller IT-Mode 12Gb PCIe x8 LSI RAID TrueNAS at the best online prices at eBay! Free shipping for many products!

www.ebay.com

Not entirely sure why it states: "OEM LSI 9300-8i / Fujitsu CP400i SATA / SAS HBA Controller RAID 12Gbps PCIe x8 Avago LSI 9340-8".
Is Fujitsu the chip in it? The heatsink looks a bit weird too. Could thid be a counterfeit?

I've been reading good things about TheArtofServer's products.
Although he is only selling the Supermicro ones.

Supermicro AOC-S3008L-L8E 12Gbps SAS-3 HBA P16 IT mode ZFS TrueNAS unRAID FP | eBay

I have fully tested them using all 8 SAS lanes. You will need a compatible cable to connect these to your hard drives or a backplane. ALL 8 SAS lanes have been fully tested. I've used ZFS for many years.

www.ebay.com

Supermicro AOC-S3008L-L8E 12Gbps SAS-3 HBA P16 IT mode ZFS TrueNAS unRAID LP | eBay

I have fully tested them using all 8 SAS lanes. You will need a compatible cable to connect these to your hard drives or a backplane. ALL 8 SAS lanes have been fully tested. I've used ZFS for many years.

www.ebay.com

This is all a bit confusing haha. Just wanted to ensure before I order. Thanks.

 

[Ericloewe]

I've been reading good things about ServeTheHome's products.

Serve The Home (STH) is a server (and server-adjacent) news/review website with a popular forum.

That eBay store is Art of Server. The guy who runs it also frequents the STH forums I believe and he's done a few relevant videos.

 

[modi]

Serve The Home (STH) is a server (and server-adjacent) news/review website with a popular forum.

That eBay store is Art of Server. The guy who runs it also frequents the STH forums I believe and he's done a few relevant videos.

I meant the Art of Server not STH!
Not sure what has been going through my mind lately. My apologies, edited it! :)

 

[Spearfoot]

Didn't mean to say networking, I was half alseep when I wrote that original point. But overall servers in general. Anyways, ok, guess I'll have to grab a new card. There's also the worry of buying a dud SAS9300 but at this point I guess. Can you confirm, Is this the card you are suggesting buying?

LSI SAS 9302-8i 12Gb/s 8-port IT-Mode HBA JBOD FreeNAS unRAID +2* SATA Cable | eBay

Find many great new & used options and get the best deals for LSI SAS 9302-8i 12Gb/s 8-port IT-Mode HBA JBOD FreeNAS unRAID +2* SATA Cable at the best online prices at eBay! Free shipping for many products!

www.ebay.com

Found this one as well, a bit cheaper, quicker shipping too.

OEM LSI 9300-8i SATA / SAS HBA Controller IT-Mode 12Gb PCIe x8 LSI RAID TrueNAS | eBay

Find many great new & used options and get the best deals for OEM LSI 9300-8i SATA / SAS HBA Controller IT-Mode 12Gb PCIe x8 LSI RAID TrueNAS at the best online prices at eBay! Free shipping for many products!

www.ebay.com

Not entirely sure why it states: "OEM LSI 9300-8i / Fujitsu CP400i SATA / SAS HBA Controller RAID 12Gbps PCIe x8 Avago LSI 9340-8".
Is Fujitsu the chip in it? The heatsink looks a bit weird too. Could thid be a counterfeit?

I've been reading good things about TheArtofServer's products.
Although he is only selling the Supermicro ones.

Supermicro AOC-S3008L-L8E 12Gbps SAS-3 HBA P16 IT mode ZFS TrueNAS unRAID FP | eBay

I have fully tested them using all 8 SAS lanes. You will need a compatible cable to connect these to your hard drives or a backplane. ALL 8 SAS lanes have been fully tested. I've used ZFS for many years.

www.ebay.com

Supermicro AOC-S3008L-L8E 12Gbps SAS-3 HBA P16 IT mode ZFS TrueNAS unRAID LP | eBay

I have fully tested them using all 8 SAS lanes. You will need a compatible cable to connect these to your hard drives or a backplane. ALL 8 SAS lanes have been fully tested. I've used ZFS for many years.

www.ebay.com

This is all a bit confusing haha. Just wanted to ensure before I order. Thanks.

There are numerous OEM models that use the LSI SAS 3008 chip -- the Fujitsu is one such.

The Art of Server is indeed a reputable seller on eBay and a commenter at STH. I would buy from him; but you've indicated he doesn't have any LSI cards in stock. The Supermicro cards are fine -- as long as they work. I recently had a tremendously bad run of luck with these, buying THREE bad ones.

I would prefer the Supermicro card over the Fujitsu, because I understand there may be complications when it comes to flashing the Fujitsu card.

Out of an abundance of caution -- I would never buy anything on eBay from a China-based seller. YMMV

 

[modi]

Out of an abundance of caution -- I would never buy anything on eBay from a China-based seller. YMMV

Understandable

I would prefer the Supermicro card over the Fujitsu, because I understand there may be complications when it comes to flashing the Fujitsu card.

Thank you, good to know

There are numerous OEM models that use the LSI SAS 3008 chip -- the Fujitsu is one such.

The Art of Server is indeed a reputable seller on eBay and a commenter at STH. I would buy from him; but you've indicated he doesn't have any LSI cards in stock. The Supermicro cards are fine -- as long as they work. I recently had a tremendously bad run of luck with these, buying THREE bad ones.

So, LSI makes their own cards + they outsource the SAS 3008 chip to others, if I understand correctly? That's why some are labeled as Supermicro LSI SAS 3008? Just curiously is there a way to determine if one is a "genuine" LSI card? By that I mean, the entire HBA produced by LSI, not just another company making the HBA with the LSI chip What is the SAS9300? I see for example, AoS has it listed as "Supermicro AOC-S3008L-L8e / LSI SAS9300-8i SAS".

Anyways, yeah I'm thinking about buying the Supermicro one. I know you originally mentioned there are "others using the same card without issue". Were you referring to the Supermicro card, or just the fact that it is a SAS3008/SAS9300?
AoS seems to be familiar with TrueNAS/FreeNAS so I can't see why he would label a card as working with FreeNAS if he encountered issues.
So I'm hoping I just got a bad card the first time around.. unless it's some weird software issue.
Thanks for your information, and support.

 

[Spearfoot]

Understandable

Thank you, good to know

So, LSI makes their own cards + they outsource the SAS 3008 chip to others, if I understand correctly? That's why some are labeled as Supermicro LSI SAS 3008? Just curiously is there a way to determine if one is a "genuine" LSI card? By that I mean, the entire HBA produced by LSI, not just another company making the HBA with the LSI chip What is the SAS9300? I see for example, AoS has it listed as "Supermicro AOC-S3008L-L8e / LSI SAS9300-8i SAS".

Yes, LSI/Avago/Broadcom makes their own card, based on their SAS3008 chip, and they also outsource the chip.
Here's a link:

Host Bus Adapters

Broadcom Host Bus Adapter (HBA) cards can enable an easy, long-term storage growth strategy in practically any direct-attached storage scenario.

www.broadcom.com

Anyways, yeah I'm thinking about buying the Supermicro one. I know you originally mentioned there are "others using the same card without issue". Were you referring to the Supermicro card, or just the fact that it is a SAS3008/SAS9300?

I was referring to the chipset in general.

AoS seems to be familiar with TrueNAS/FreeNAS so I can't see why he would label a card as working with FreeNAS if he encountered issues.
So I'm hoping I just got a bad card the first time around.. unless it's some weird software issue.
Thanks for your information, and support.

That's a good approach. You can always return the card if it doesn't work.

 

[modi]

Yes, LSI/Avago/Broadcom makes their own card, based on their SAS3008 chip, and they also outsource the chip.
Here's a link:

Host Bus Adapters

Broadcom Host Bus Adapter (HBA) cards can enable an easy, long-term storage growth strategy in practically any direct-attached storage scenario.

www.broadcom.com

I was referring to the chipset in general.
That's a good approach. You can always return the card if it doesn't work.

Thank you. Will report back in the near future with how things go.

 

[modi]

Said I would report back.
So I talked to the seller and they agreed to sending me a replacement card, and they also sent new cables. So I just swapped the cables and cards and it seems to be working solid now.