AVB
Contributor
- Joined
- Apr 29, 2012
- Messages
- 174
My server is just used for storage. No Jails, nor anything, about as straight forward as it gets. I have a pool with 2 Z2 eight drive vdevs. One vdev has 8tb drives and the other had 4tb drives. The eight tb drives are the famous or infamouse HGST SUN models the read 7.15tb in TrueNAS formatted as 512e. I bought 9 IBM-AIX ST6000NM0054 6tb drived to upgrade the 4tb drives I had. I do have a copy of the generic ST6000NM0054 firmware. But neither Seatools, or Seaflash or SG_write_buffer has been able to load it I just get an Illegal Operation error every time. The IBM drives are also 512e and since nothing within my ability that I threw at them would allow me to reformat or load new firmware on them so they remain 512e.
When I replaced the first 4tb drive it too 64 hours to resilver. The pool was only at 68% at the time. The other 7 drives took anywhere from 64-70 hours each to resilver . I have not added or erased any data from the pool since I began the upgrade.
As long as I was running up my electric bill I decided to reformat the HGST drives one at a time to 4096 block size. Luckily the standard sg format-size command worked just fine and 13 hours later I had a 4Kn drive. When I put that drive back into the same slot it came out of and did a replace it started the resilver process as expected. However, unless something goes seriously wrong in the next few hours it will be done in half the time (32 hours). Can this difference be attributed to 4K block size alone or do you think there something in the IBM firmware that slows everything down? Protection perhaps? I formatted my spare 6tb drive and stuck in my PC and it copies data at about the same rate as other 3 or 4tb drives I have but beyond that I haven't tested it.
Just looking for opinions to satisfy my curiosity since the server works at the level of performance I need. If it bothers me enough It will be fixed in about 4-5 years when I upgrade drives again.
When I replaced the first 4tb drive it too 64 hours to resilver. The pool was only at 68% at the time. The other 7 drives took anywhere from 64-70 hours each to resilver . I have not added or erased any data from the pool since I began the upgrade.
As long as I was running up my electric bill I decided to reformat the HGST drives one at a time to 4096 block size. Luckily the standard sg format-size command worked just fine and 13 hours later I had a 4Kn drive. When I put that drive back into the same slot it came out of and did a replace it started the resilver process as expected. However, unless something goes seriously wrong in the next few hours it will be done in half the time (32 hours). Can this difference be attributed to 4K block size alone or do you think there something in the IBM firmware that slows everything down? Protection perhaps? I formatted my spare 6tb drive and stuck in my PC and it copies data at about the same rate as other 3 or 4tb drives I have but beyond that I haven't tested it.
Just looking for opinions to satisfy my curiosity since the server works at the level of performance I need. If it bothers me enough It will be fixed in about 4-5 years when I upgrade drives again.