Formatting Netapp (Seagate Constellation ES.3) to 512 byte blocks

[MasterTacoChief]

I purchased a couple Netapp-branded Seagate Constellation ES.3 4TB drives (ST4000NM0023) that will identify and mount in FreeNAS, but are unusable by default due to the 520-byte block size. I've previously used sg_format on Constellation ES.2 drives with the same issue with 100% success, but these ES.3 drives just produce an error no matter what options I feed into sg_format. Here's the output of one attempt:


[root@freenas] ~# sg_format --format --size=512 --fmtpinfo=0 /dev/da15 -v
NETAPP X477_SMEGX04TA07 NA01 peripheral_type: disk [0x0]
PROTECT=0
Unit serial number: Z1Z0T5KB00009346V1PP
LU name: 5000c50056ab8747
mode sense (10) cdb: 5a 00 01 00 00 00 00 00 fc 00
Mode Sense (block descriptor) data, prior to changes:
Mode sense number of blocks maxed out, set longlba
mode sense (10) cdb: 5a 10 01 00 00 00 00 00 fc 00
Mode Sense (block descriptor) data, prior to changes:
<<< longlba flag set (64 bit lba) >>>
Number of blocks=7814037168 [0x1d1c0beb0]
Block size=520 [0x208]
mode select (10) cdb: 55 11 00 00 00 00 00 00 22 00
mode select (10):
Descriptor format, current; Sense key: Illegal Request
Additional sense: Parameter list length error
Descriptor type: Sense key specific: Field pointer:
Error in Command: byte 7 bit 7
Descriptor type: Field replaceable unit code: 0x5
Descriptor type: Vendor specific [0x80]
00 00 00 00 00 00 00 00 00 00 00 00 00 00
MODE SELECT command: Illegal request sense key, apart from Invalid opcode


I've tried with fmtpinfo=0 and =1 and with the --six option set as well. I'm starting to think the firmware on these drives is hardcoded to be 520-byte only, but also can't seem to find an alternative firmware for these drives.
Any help is appreciated.

 

[tvsjr]

I used to have the same issue with some drives (finally pitched them, got tired of the failures). Never had an issue... a simple "sg_format --format --size=512 /dev/da##" was always sufficient.

 

[MasterTacoChief]

I was able to get Seagate firmware for this drive by inputting a non-Netapp serial number for the same model drive into their website. Unfortunately, at least within FreeNAS, I can't complete a firmware update. I'm not sure what "Argument list too long" means here, other than maybe the Netapp firmware uses a custom command length, even for firmware updates.


[root@freenas] /mnt/VOL0/Test/firmware# sg_write_buffer -v --in=MegalodonES3-SAS-STD-0006.LOD --length=1630720 /dev/da15
sending single write buffer, mode=0x0, mpsec=0, id=0, offset=0, len=1630720
Write buffer cmd: 3b 00 00 00 00 00 18 e2 00 00
sg_write_buffer: error sending SCSI ccb: Argument list too long
(pass16:mps0:0:33:0): WRITE BUFFER. CDB: 3b 00 00 00 00 00 18 e2 00 00
(pass16:mps0:0:33:0): CAM status: CCB request is in progress
Write buffer: pass through os error: Input/output error
Write buffer failed: Sense category: -1


I will have to try updating the firmware in Windows with Seatools this evening. There is also the --bpw (bytes per write buffer) and --specific (mode specific value) option, though I'm not an expert on this so not sure what these end up doing.

 

[MasterTacoChief]

Well Seatools claimed to update the firmware successfully, but after a cold reboot the drives still reported firmware version NA01 instead of 0006 that I tried installing, and I continued to have no luck formatting them. The labels show they shipped with version NA00, so Netapp must have published an update at some point, but who knows what magic the drive expects to unlock/validate new firmware sent to it.
These are the first drives I've encountered that seem to be completely vendor-locked, so a warning to those that might want to use 3rd party label ES.3 drives, you might be out of luck unless someone knows how to unlock the disk to convert it to generic firmware.

 

[matteoking14]

Well Seatools claimed to update the firmware successfully, but after a cold reboot the drives still reported firmware version NA01 instead of 0006 that I tried installing, and I continued to have no luck formatting them. The labels show they shipped with version NA00, so Netapp must have published an update at some point, but who knows what magic the drive expects to unlock/validate new firmware sent to it.
These are the first drives I've encountered that seem to be completely vendor-locked, so a warning to those that might want to use 3rd party label ES.3 drives, you might be out of luck unless someone knows how to unlock the disk to convert it to generic firmware.

Hi, I am facing the same issues ...
Did you find a sollution for this ?
I also found this. https://forum.hddguru.com/viewtopic.php?f=28&t=34570

I really hope you can help me, Can't afford to buy new drives now X_X

 

[JoeAtWork]

I formatted my 520 byte block drives in Linux and they worked fine. You might want to boot into linux for the format and if the long smart test was 10 hours then so was the format to convert to 512 byte block drives. I hated dealing with 520 byte block drives, if the used drive is $50 and you get a 520 byte block drive I say it should cost 1/2 as you have to muck with it and format it. you may end up later with some stupid firmware that turns off some feature you need or want.

 

[matteoking14]

Hi, thx for the reply.
That is great news. Any idea what command?. Just via fdisk?

Greetings,


Mat

 

[JoeAtWork]

sg_format --format --size=512 /dev/sg8

 

[Darklion]

I just try that with a 520 disk but i got this eror that look different than yours. Con you tell me if I would be able to do it on linux, cuz I am seeing there that it says "fixed format" and at the final says "apart from invalid opcode"

root@freenas[~]# sg_format --format --size=512 --fmtpinfo=0 /dev/da8 -v
HITACHI HUS72302CLAR2000 C1D6 peripheral_type: disk [0x0]
PROTECT=1
<< supports protection information>>
Unit serial number: YGJH3XWD
LU name: 5000cca01c8c3d54
mode sense (10) cdb: 5a 00 01 00 00 00 00 00 fc 00
Mode Sense (block descriptor) data, prior to changes:
Number of blocks=3846921026 [0xe54b5b42]
Block size=520 [0x208]
mode select (10) cdb: 55 11 00 00 00 00 00 00 1a 00
mode select (10):
Fixed format, current; Sense key: Illegal Request
Additional sense: Parameter list length error
Sense Key Specific: Error in Command: byte 7
MODE SELECT command: Illegal request sense key, apart from Invalid opcode

 

[Elliot Dierksen]

I used the instructions from the article http://www.sysop.ca/?p=208 and was able to reformat some NetApp drives and use them with FreeNAS. I will say that the camcontrol command that does the reformatting takes a REALLY LONG TIME to complete.

 

[Darklion]

Thanks for mat information.

I just start the process on 11 hard drives, I will let the server run and take as mas as it need to do the formatting.

Let me just confirm with you, when you hit enter after the "camcontrol format da0 -q -y" the prompt just move down and it will not show anything until the process is done?

Or there is a mistake that I have done and that's why the prompt is just there doing nothing?

Thank you for you help.

 

[Darklion]

I used the instructions from the article http://www.sysop.ca/?p=208 and was able to reformat some NetApp drives and use them with FreeNAS. I will say that the camcontrol command that does the reformatting takes a REALLY LONG TIME to complete.

I want to thank you because my computer took like 5 and a half hour to do this format and my eleven disk are format on 512 now. I haven't try to do the pool but i don't think I should have any problem now.

thank very mutch. my question on the prompt not moving is already being answer by it self. It wont show nothing at all but it actually does the formating.

 

[Elliot Dierksen]

You are welcome. It has been a while since I had to do that, but I did remember that it took a crazy long time for the low level format to finish. Glad to hear it is working for you.

 

[Darklion]

You are welcome. It has been a while since I had to do that, but I did remember that it took a crazy long time for the low level format to finish. Glad to hear it is working for you.

Wells I try it on 10 Hitachi 2tb 7200rpm and it to like 5 to 6 tours on them, on one Seagate constellation 2tb 72 rpm and it took like 9 hours, on 4 Hitachi 600gb 15k and on those where only 45 minutes. Definitely that camcontrol command works like a champ. I just want to leave it here to make it even easier for others that are looking for this solutions as this is a FreeBSD native solution and not like sg_format that is a linux or unix solution.

# camcontrol cmd da1 -v -c "15 10 0 0 v:i1 0" 12 -o 12 "0 0 0 8 0 0:i3 0 v:i3" 512
# camcontrol format da1 -q -y

The frustrated part was that the prompt was there doing nothing and when it finished after hours, it just show like you only hit enter and nothing happened, but it definitely work.

# diskinfo -v da1

And it shows there that is specifically on 512 sector formatted.

Definitely this FreeNAS is making again learn and learn a lot. I had to be burning my brain and getting my wife mad as I am spending to much time on the server lol. But I am loving it.

Now I just need to figure out how to make plex work properly as is freezing on me and is not temperature related and can't figure out what could be the cost.