The volume is DEGRADED

[Jon Grappin]

I have 5 3tb disks in my freenas...
Initially i could not get all 5 disks to show up. Only three showed up. I read a thread somewhere i cannot find now that explained to turn off a few things in the bios and additionally, type a few commands into the console and then they all worked. My usb failed and i could never figure out how to get the other two drive to show up. I think the bios is correct but i dont know the commands to type... So i gave up and just raided the 3 drives together... all was well for a while now I have a degraded drive, freenas removed it, all my data is on these two drives.....
What should I do? If possible i would like to get these other two drvies up and running and add them to this array however. Then shut down or hotswap out failing drive?

Any help or advise?

 

[Fraoch]

Please post your system specs.

So i gave up and just raided the 3 drives together.

What do you mean? Was this in the BIOS or in the FreeNAS GUI?

 

[gpsguy]

Don't yank the drive. There's information in the manual on how to replace disks.

Please furnish the info requested by Fraoch. I'd like to see the output of: zpool status

Please post these results in code tags to preserve formatting.


Sent from my phone

 

[danb35]

There isn't a good way to add two disks to an existing three-disk volume, so at some point you're going to need to copy the data off the pool, destroy it, and recreate it with all five disks. That's likely to be down the road a bit, though. To elaborate on @Fraoch's request, system specs would include version of FreeNAS, hardware (motherboard, CPU, RAM, disk controller if you're using one other than the motherboard), and storage configuration (zpool status). The output of camcontrol devlist would be helpful as well.

 

[Jon Grappin]

BuildFreeNAS-9.2.1.7-RELEASE-x64 (fdbe9a0)
PlatformIntel(R) Core(TM)2 Quad CPU Q9650 @ 3.00GHz
Memory8169MB

state: DEGRADED
status: One or more devices has been removed by the administrator.
Sufficient replicas exist for the pool to continue functioning in a
degraded state.
action: Online the device using 'zpool online' or replace the device with
'zpool replace'.
scan: scrub repaired 0 in 0h37m with 0 errors on Sun Jan 4 00:37:22 2015
config:

NAME STATE READ WRITE CKS
UM
Raidz DEGRADED 0 0
0
raidz1-0 DEGRADED 0 0
0
gptid/16d8444e-63d8-11e4-b93d-00044b177548 ONLINE 0 0
0
gptid/1762c925-63d8-11e4-b93d-00044b177548 ONLINE 0 0
0
12642027173423817476 REMOVED 0 0
0 was /dev/gptid/17e9067e-63d8-11e4-b93d-00044b177548

errors: No known data errors

camcontrol devlist
<TSSTcorp CDDVDW SH-S202G SB00> at scbus0 target 0 lun 0 (cd0,pass0)
<ST3000DM001-1CH166 CC29> at scbus4 target 0 lun 0 (ada0,pass1)
<ST3000DM001-1CH166 CC29> at scbus5 target 0 lun 0 (ada1,pass2)
<Corsair Voyager GT 3.0 1.00> at scbus12 target 0 lun 0 (da0,pass4)

Motherbaord:
MB-N790-IU MB-N790-IUL9 4.2
XFX nForce 790I Ultra SLI

When i did get all the drives working i changed i believe the IEEE1394 off in bios, Then had to type something in the shell..

Can I simply detach the 4th or 5th drive that is not seen, then unplug the drive 3 that is down. plug one of the good drives in drive three and then it automatically fixes itself? Or whats the proper procedure to swap that bad drive with one of the good ones Since DANB35 stated I cant added theses two drives to the pool anyways..... Can I add one to the pool? use the other to replace the bad. Rma the bad, then setup then rmaed drive as a hot spare.....

Im getting nervious, I wanted to create a reliable datastore, now I am questioning the whitebox build, Also questioning the reliability of entry lever 3tb drives in a raid.... Should I perfect this build or sell it and buy something enterprise/used.....

 

[danb35]

I don't know, and can't find, anything about that motherboard--who's the manufacturer? And how many drives are plugged in to the system?

Right now, the system is only seeing that you have two drives connected. Until that changes, you won't be able to rebuild your RAIDZ array. Once you've got a third drive installed and recognized by the system, you can follow the manual's instructions for replacing a failed drive. Please note that those instructions DO NOT call for using the Volume Manager in any way.

Once you get your array sorted, you can think about how to expand it. Since you seem to be unfamiliar with what you can and can't do with ZFS, I'd suggest you take a look at cyberjock's powerpoint on the subject. In short: No, you can't safely add a single disk to your array either. If you wanted to add disks to an existing array, you'd need to add a new redundant group (e.g., another RAIDZ array). In your case, with a total of five disks, the best option is probably to back up your data, destroy the pool, and create a new RAIDZ2 pool on all five disks.

As to your build, it's up to you. You'd probably be well-served to get a new SuperMicro board, appropriate CPU, and ECC RAM, since there are clearly some oddities with your current board. Your disks should be fine--if they were WD Greens I'd say you'd want to adjust the load cycle timeout, but I'm not aware of Seagate drives having a similar issue.

 

[Fraoch]

When i did get all the drives working i changed i believe the IEEE1394 off in bios, Then had to type something in the shell..

Which shell? The one in FreeNAS?

It's sort of looking like the missing drives have been RAIDed together by the motherboard through the BIOS and that ZFS can't see them any more. If that's the case, the motherboard RAID controller probably altered the data and if it did, ZFS won't be able to read data on them and won't be able to use them.

So I hope this is not the case.

Can you see these drives in the BIOS? Do they look any different than the drives FreeNAS can read?

 

[Jon Grappin]

The motherboard is: XFX nForce 790I Ultra SLI
http://www.nvidia.com/object/product_nforce_790i_ultra_sli_us.html

I think there are two different controllers for the 6 satas on the mother board: three connectors are grouped together (the three in question) the other two are connected to the sata connectors in a different spot on the board...

I do not want to shut the nas down, afraid to loose 5TB of data..... Where to go from here? Can I hot swap that bad drive to restore my pool prior to restarting or going to bios...? Can you please give me a link to this how to please......

thanks for all the support, its great to see there is a good community behind this software. thank you in advance!

 

[Fraoch]

I think there are two different controllers for the 6 satas on the mother board: three connectors are grouped together (the three in question) the other two are connected to the sata connectors in a different spot on the board...

Are the three drives FreeNAS can't see arranged in some sort of RAID by the controller? Check this in the BIOS.

 

[Ericloewe]

The motherboard is: XFX nForce 790I Ultra SLI
http://www.nvidia.com/object/product_nforce_790i_ultra_sli_us.html

AHH! BURN IT! BURN IT!

Cast it into the depths of the Gorge of Eternal Peril, where all nVidia chipsets belong!

 

[danb35]

I do not want to shut the nas down, afraid to loose 5TB of data..... Where to go from here? Can I hot swap that bad drive to restore my pool prior to restarting or going to bios...? Can you please give me a link to this how to please......

I would estimate that the risk to your hardware and your data is much greater from attempting to hot-swap a disk than from shutting down the system through the web GUI. We don't know if any of your hardware supports hot-swap, and even with hardware that supports it completely it's a risk.

 

[cyberjock]

I would estimate that the risk to your hardware and your data is much greater from attempting to hot-swap a disk than from shutting down the system through the web GUI. We don't know if any of your hardware supports hot-swap, and even with hardware that supports it completely it's a risk.

Exactly. Don't let emotion get the best of you. Use logic... and it is illogical to assume hotswap will work if you haven't tested it and can vouch for it working.