Resilvering time

[geronimo1958]

I swapped out one of my 1.5TB disks for a 2.0TB (see sig). I plan to replace all three 1.5TB disks with 2.0TB disks.

The first resilvering took 30 hours. Using the disk io measurements under the Reporting tab I noticed something odd. For the 1st hour 60 MB/s and then for the last 29 hours 8 MB/s. Why the big drop??

There system reports no error. Is there a log file for this operation?

 

[Robert Trevellyan]

Are all your drives healthy?

 

[geronimo1958]

Yes

 

[gpsguy]

How full was your pool?

 

[Robert Trevellyan]

Was there a scheduled scrub or extended SMART test running?

Other than a hardware problem, the only other thing that comes to mind is fragmentation, but 8MB/s seems very slow.

 

[geronimo1958]

1.8GB free of 6.3GB
Nothing else running.

Any tests I can run before I start the next resilvering?

 

[Robert Trevellyan]

Any tests I can run before I start the next resilvering?

SMART extended.

 

[Darren Myers]

So you have x3 2Tb drives + x3 1.5Tb hdds in RAIDz2 in a single pool then correct? So you had 1.8Tb full out of 6.3Tb? I agree with have you done any scheduled or manual SMART tests, short or extended? And have you ever scrubbed the pool?

 

[geronimo1958]

1.8TB remaining out of 6.3TB in a single pool

Ran a scrub the day before I started replacing the 1.5 with the 2.0

Ran a extended self test last night and I just checked the results and it says "Completed without error"

I will replace another of the 1.5's with a 2.0 tonight and see if I get better io.

While I have the case open I may swapout the SATA cable on the drive that had the problems resilvering.

 

[geronimo1958]

Resilvered the 2nd new WD Red 2TB. Replaced the SATA cable for the first WD Red 2TB (the one with really slow resilvering).

The job only took about 5 hours. Resilvering the last WD Red 2TB now.

 

[dpearcefl]

I just did a similar operation on my test box last week. It had three 500 GB 7200 SATA drives (pool 60% full) and I replaced them with three 1 TB drives. Each resiliver took about 30-45 mins. While my drives were smaller, it still seems your resiliver was slower than I would expect.

 

[geronimo1958]

The last resilver finished but the auto-expand did not work.

The last two resilvers ran much, much faster than the first.

Not sure why auto-expand did not do its thing. The feature is turned on.

 

[dpearcefl]

My auto-expand worked perfectly. Not sure why your's did not.

 

[Bidule0hm]

Maybe a reboot will solve the problem.

 

[geronimo1958]

I will reboot when I get home tonite.

 

[Robert Trevellyan]

It had three 500 GB 7200 SATA drives (pool 60% full) and I replaced them with three 1 TB drives.

Is that a total of 3 drives in RAIDZ1? OP has 6 drives in RAIDZ2 and about 3x as much data, so their resilver would be expected to take longer than yours.

 

[geronimo1958]

OK. Rebooted the FREENAS box. No change.

What next?

Here is an image from the FREENAS gui

 

[Robert Trevellyan]

Here is an image

The image isn't working for me.

 

[geronimo1958]

Not sure what is wrong. I will have to work on it. Tried to test with an image from flickr that is my avatar on other sites and even it will not work????

 

[Bidule0hm]

Hmm... maybe there's some changes in the last update (9.3.1) because there's another member having problems with autoexpand not working. I can't help more than that unfortunately.