LSI 9240-8i IT Mode + Seagate ST33000651SS

[KeithMKemp]

Hi,
I'm new to Storage, and especially new to FreeNAS. So please be patient.

I got quite a few Seagate ST33000651SS from work recently. And thought I'd try putting them to use. Specifically, I have:
Sabertooth X58 MoBo
2 x LSI 9240-8i (I'm only going to be using one but the ebay deal was too good to pass)
8 x Seagate ST33000651SS

Initially, I was trying to boot into FreeNas using the LSI card in IR. However, it would never boot successfully. It'd say something to the effect of "Timeout after 59 seconds... Timeout after 99 seconds... etc etc"

So I flashed one of my two cards into IT. And sure enough, I can boot successfully, and Freenas can see my drives. But I can't do anything with them.

My Drives

Creating Test Volume

Volume Creation Error

Wiping DA2

Wipe Error

Any thoughts on how to proceed forward is greatly appreciated!

 

[survive]

Hi KeithMKemp,

First thing I would try is to boot up a "gparted" linux disk and use that to delete the existing partition data, repartition them, format them & then delete the new partitions....basically just get some other OS to write out new partiton info in an effort to nuke whatever existing data in there on the disks.

-Will

 

[KeithMKemp]

Hey,
So I tried Gparted.
It sees my SSD fine, but when it tries to detect any of the 8 Seagates, I get "Libparted Bug found! Input/Output error during read on /dev/sdb".
Each of the Seagates shows up as 2.73 TiB of Unallocated space. And if I try to create any partition table I get the same error as above.

I did boot up ESX on a thumb drive, however. And I was able to see all the drives without issue. I was able to make one a datastore (Only tested one HDD) and read/write data to it. Not sure if that tidbit helps or not...

 

[Lordadmiral Drake]

Try to read out the SMART values on your disks, they may be faulty:
On FreeNAS shell type smartctl -A /dev/daX
where X is the number of the disk from 2 through 9

Post the results here

 

[KeithMKemp]

I removed the SSD. So now it's just DA1-DA8

DA1:
[root@Big-Bad-Nas ~]# smartctl -A /dev/da1
smartctl 6.2 2013-07-26 r3841 [FreeBSD 9.2-RELEASE-p3 amd64] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
Current Drive Temperature: 42 C
Drive Trip Temperature: 68 C

Manufactured in week 37 of year 2011
Specified cycle count over device lifetime: 10000
Accumulated start-stop cycles: 184
Specified load-unload count over device lifetime: 300000
Accumulated load-unload cycles: 184
Elements in grown defect list: 1

Vendor (Seagate) cache information
Blocks sent to initiator = 1249583258
Blocks received from initiator = 480409246
Blocks read from cache and sent to initiator = 105007200
Number of read and write commands whose size <= segment size = 536705
Number of read and write commands whose size > segment size = 0

Vendor (Seagate/Hitachi) factory information
number of hours powered up = 17049.45
number of minutes until next internal SMART test = 26

DA2:
[root@Big-Bad-Nas ~]# smartctl -A /dev/da2
smartctl 6.2 2013-07-26 r3841 [FreeBSD 9.2-RELEASE-p3 amd64] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
Current Drive Temperature: 44 C
Drive Trip Temperature: 68 C

Manufactured in week 36 of year 2011
Specified cycle count over device lifetime: 10000
Accumulated start-stop cycles: 181
Specified load-unload count over device lifetime: 300000
Accumulated load-unload cycles: 181
Elements in grown defect list: 0

Vendor (Seagate) cache information
Blocks sent to initiator = 1297189786
Blocks received from initiator = 580911053
Blocks read from cache and sent to initiator = 196361926
Number of read and write commands whose size <= segment size = 677067
Number of read and write commands whose size > segment size = 0

Vendor (Seagate/Hitachi) factory information
number of hours powered up = 17049.50
number of minutes until next internal SMART test = 25

DA3:
[root@Big-Bad-Nas ~]# smartctl -A /dev/da3
smartctl 6.2 2013-07-26 r3841 [FreeBSD 9.2-RELEASE-p3 amd64] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
Current Drive Temperature: 44 C
Drive Trip Temperature: 68 C

Manufactured in week 36 of year 2011
Specified cycle count over device lifetime: 10000
Accumulated start-stop cycles: 180
Specified load-unload count over device lifetime: 300000
Accumulated load-unload cycles: 180
Elements in grown defect list: 2

Vendor (Seagate) cache information
Blocks sent to initiator = 989787925
Blocks received from initiator = 339033588
Blocks read from cache and sent to initiator = 45904468
Number of read and write commands whose size <= segment size = 377211
Number of read and write commands whose size > segment size = 0

Vendor (Seagate/Hitachi) factory information
number of hours powered up = 17049.38
number of minutes until next internal SMART test = 25

DA4:
[root@Big-Bad-Nas ~]# smartctl -A /dev/da4
smartctl 6.2 2013-07-26 r3841 [FreeBSD 9.2-RELEASE-p3 amd64] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
Current Drive Temperature: 46 C
Drive Trip Temperature: 68 C

Manufactured in week 37 of year 2011
Specified cycle count over device lifetime: 10000
Accumulated start-stop cycles: 183
Specified load-unload count over device lifetime: 300000
Accumulated load-unload cycles: 183
Elements in grown defect list: 1

Vendor (Seagate) cache information
Blocks sent to initiator = 1394232077
Blocks received from initiator = 478844876
Blocks read from cache and sent to initiator = 104865523
Number of read and write commands whose size <= segment size = 540632
Number of read and write commands whose size > segment size = 0

Vendor (Seagate/Hitachi) factory information
number of hours powered up = 17049.25
number of minutes until next internal SMART test = 25

DA5:
[root@Big-Bad-Nas ~]# smartctl -A /dev/da5
smartctl 6.2 2013-07-26 r3841 [FreeBSD 9.2-RELEASE-p3 amd64] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
Current Drive Temperature: 44 C
Drive Trip Temperature: 68 C

Manufactured in week 37 of year 2011
Specified cycle count over device lifetime: 10000
Accumulated start-stop cycles: 186
Specified load-unload count over device lifetime: 300000
Accumulated load-unload cycles: 186
Elements in grown defect list: 0

Vendor (Seagate) cache information
Blocks sent to initiator = 995562090
Blocks received from initiator = 419963675
Blocks read from cache and sent to initiator = 50419068
Number of read and write commands whose size <= segment size = 433748
Number of read and write commands whose size > segment size = 0

Vendor (Seagate/Hitachi) factory information
number of hours powered up = 17049.27
number of minutes until next internal SMART test = 25

DA6:
[root@Big-Bad-Nas ~]# smartctl -A /dev/da6
smartctl 6.2 2013-07-26 r3841 [FreeBSD 9.2-RELEASE-p3 amd64] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
Current Drive Temperature: 41 C
Drive Trip Temperature: 68 C

Manufactured in week 37 of year 2011
Specified cycle count over device lifetime: 10000
Accumulated start-stop cycles: 187
Specified load-unload count over device lifetime: 300000
Accumulated load-unload cycles: 187
Elements in grown defect list: 1

Vendor (Seagate) cache information
Blocks sent to initiator = 1393628789
Blocks received from initiator = 571917417
Blocks read from cache and sent to initiator = 101311011
Number of read and write commands whose size <= segment size = 516869
Number of read and write commands whose size > segment size = 0

Vendor (Seagate/Hitachi) factory information
number of hours powered up = 17049.55
number of minutes until next internal SMART test = 24

DA7:
[root@Big-Bad-Nas ~]# smartctl -A /dev/da7
smartctl 6.2 2013-07-26 r3841 [FreeBSD 9.2-RELEASE-p3 amd64] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
Current Drive Temperature: 40 C
Drive Trip Temperature: 68 C

Manufactured in week 37 of year 2011
Specified cycle count over device lifetime: 10000
Accumulated start-stop cycles: 185
Specified load-unload count over device lifetime: 300000
Accumulated load-unload cycles: 185
Elements in grown defect list: 0

Vendor (Seagate) cache information
Blocks sent to initiator = 1291466966
Blocks received from initiator = 596451550
Blocks read from cache and sent to initiator = 196277146
Number of read and write commands whose size <= segment size = 677619
Number of read and write commands whose size > segment size = 0

Vendor (Seagate/Hitachi) factory information
number of hours powered up = 17049.50
number of minutes until next internal SMART test = 24

DA8:
[root@Big-Bad-Nas ~]# smartctl -A /dev/da8
smartctl 6.2 2013-07-26 r3841 [FreeBSD 9.2-RELEASE-p3 amd64] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
Current Drive Temperature: 42 C
Drive Trip Temperature: 68 C

Manufactured in week 37 of year 2011
Specified cycle count over device lifetime: 10000
Accumulated start-stop cycles: 184
Specified load-unload count over device lifetime: 300000
Accumulated load-unload cycles: 184
Elements in grown defect list: 0

Vendor (Seagate) cache information
Blocks sent to initiator = 1458524485
Blocks received from initiator = 576006935
Blocks read from cache and sent to initiator = 201837180
Number of read and write commands whose size <= segment size = 670464
Number of read and write commands whose size > segment size = 0

Vendor (Seagate/Hitachi) factory information
number of hours powered up = 17049.38
number of minutes until next internal SMART test = 24

 

[jgreco]

Fastest path to happiness (or unhappiness if it turns out the drives are bad) is to run DBAN on the drives in zeroing mode.

 

[KeithMKemp]

So again - super new to most of this... Took me a bit to figure out DBAN... But right now each Disk is going through "DoD Short" and I'm at 00.02%... If that's not the one I should be running, please let me know!
Else, I'll update once this is complete.

 

[jgreco]

Yeah, well that'll work but it'll take a while. Zeroing mode is faster.

DBAN tends to do a better job than other random tools at taking arbitrary drives and blanking them.

 

[KeithMKemp]

I stopped and am running in Zeroing mode.

 

[TheSmoker]

For quick and dirty (no guarantees) i do:
dd if=/dev/zero of=/dev/<put disk here> bs=4k count=4096

 

[panz]

So again - super new to most of this... Took me a bit to figure out DBAN... But right now each Disk is going through "DoD Short" and I'm at 00.02%... If that's not the one I should be running, please let me know!
Else, I'll update once this is complete.

http://www.hdat2.com/

 

[jgreco]

For quick and dirty (no guarantees) i do:
dd if=/dev/zero of=/dev/<put disk here> bs=4k count=4096

That won't always work but is the general "quickest" strategy for a directly attached disk (RAID drives are another matter!)

More specifically, what you really want to do is to blow away any GPT table data, including the redundant copy at the end of the disk

http://en.wikipedia.org/wiki/GUID_Partition_Table

but FreeBSD may prohibit you from writing to a disk if it feels that the disk might be active, so actually what you end up needing to do is more along the lines of

# gpart show | grep "${dev}"
(use gpart delete and gpart destroy on any that show up)
# sysctl -w kern.geom.debugflags=16
# dd if=/dev/zero of=/dev/${dev} bs=4096 count=4096
(then calculate the size of the disk in 4k blocks, reduce that number a bit to blast the label, and call that ${n})
# dd if=/dev/zero of=/dev/${dev} bs=4096 seek=${n}
(and then once this has been done to all target drives)
# reboot

And then pretty much anything FreeBSD might consider as meaningful disk labeling should be zeroed.

 

[TheSmoker]

Insaid quick and dirty as well as no guarantees. :) and I assumed (not write about it though) that it's and unused/removed drive. Bu yes, your answer is the correct long one. Me, just lazy. :)

 

[KeithMKemp]

I'm committed for 35 more hours to the DBAN process.
Not that it will affect me now, but instead just for my knowledge - The total time it takes for DBAN to complete, is that impacted by RAM/CPU or just the disk speed?

Would I have been better to put these hard drives on a more robust machine before I started this process?

 

[gpsguy]

CPU and disk size certainly play a role with DBAN.

The quick erase would have been faster than DoD Short.


Sent from my phone

 

[KeithMKemp]

DBAN completed successfully. No errors.
But when I tried to create the ZFS volumes in freenas - I got the exact same error as before.

The hardware works no problem on Windows. I can change between GPT and MBR, read/write with no problem.
I created ZFS formatted drives in nas4free and could read/write.

It's just Freenas that's not making any progress.

 

[cyberjock]

That's what you get for buying Seagates. Just kidding.

Did you reflash that controller to IT mode? What firmware version? Does it match the driver for your card?

 

[KeithMKemp]

It is in IT mode
When my system boots it says,
"LSI Corporation MPT SAS2 BIOS
MPT2BIOS-7.29.00.00 (2012.11.12)"

I'm running Freenas 9.2.1.3... I'm not sure where to determine the driver.

When I have console open, and I try to format the ZFS volume I see this:

 

[mike59]

To determine the driver version and to check that it matches the BIOS version, from the console:

dmesg | grep mps
mps0: <LSI SAS2008> port 0xc000-0xc0ff mem 0xfb43c000-0xfb43ffff,0xfb440000-0xfb47ffff irq 16 at device 0.0 on pci4
mps0: Firmware: 16.00.00.00, Driver: 16.00.00.00-fbsd

 

[cyberjock]

Like mike59 said.. the firmware and driver should be the same major version.. in his example they are both 16.x.. so that's good. If they are uneven then you can have problems. And I'm 100% expecting yours to not match because of the date... FreeNAS' drivers are all dated 2013 or 2014 for LSI hardware.