ZPool Unavailable - Unknown - Drive Failure

[hooti3]

Hi All,
I thought I'd reach out for some help in getting my zPool back online.
One of my disks died in my Raid-z1 (5 disk pool).

Code:

[root@freenas ~]# zpool import                                                 
   pool: Storage                                                               
     id: 1289359227856568490                                                   
  state: DEGRADED                                                               
 status: One or more devices are missing from the system.                       
 action: The pool can be imported despite missing or damaged devices.  The     
        fault tolerance of the pool may be compromised if imported.             
   see: http://illumos.org/msg/ZFS-8000-2Q                                     
 config:                                                                       
                                                                                
        Storage                                         DEGRADED               
          raidz1-0                                      DEGRADED               
            gptid/93df7155-0be3-11e8-9668-38d547757201  ONLINE                 
            gptid/94a17197-0be3-11e8-9668-38d547757201  ONLINE                 
            ada3p2                                      ONLINE                 
            12885366225365287864                        UNAVAIL  cannot open   
            gptid/976a0085-0be3-11e8-9668-38d547757201  ONLINE  

I've looked online to try and get some assistance, but rather than make a mistake and possibly lose my data (which may already be the case), I thought I would reach out for some help.

I've added in another blank disk in hopes of bringing the volume and zPool back online, but haven't had any success.
The drive is a blank 3TB WD Red I had lying around.

The failed disk is visible when running the above command, but not visible in the GUI to offline.
Hardware specs:
- Asus P10S-I
- G4560
- 16GB Non-ECC Memory
- 5 HDD (WD Red 4TB each )
- 1 Intel SSD for OS.

I've never had to replace a drive before on a FreeNAS, so really just wanting to get some guidance on it.

Additional checks from my Reddit post - https://www.reddit.com/r/freenas/comments/f13ch2/zpool_unavailable_unknown_drive_failure/

As you can see there is no ability to edit the pool status or check the drives.
https://ibb.co/YNVL9DD

I've attempted a zpool import via the shell and received this error message:
https://ibb.co/h9mtDTW

 

[hooti3]

Sorry forgot to mention the FreeNAS version - 11.2-U7

 

[KevDog]

I posted to your reddit thread. Just to let you know

 

[PhiloEpisteme]

Code:

ada3p2 ONLINE
12885366225365287864 UNAVAIL cannot open gptid/976a0085-0be3-11e8-9668-38d547757201 ONLINE

Hey, any chance you did some manual, CLI, management of your pool in the past? Possibly replaced a disk or something?

 

[hooti3]

Hey, any chance you did some manual, CLI, management of your pool in the past? Possibly replaced a disk or something?

I've simply set it up once and never really looked at the box since.

The only thing I've ever realy done on the FreeNAS is installing Plex Updates.

I've never had a drive fail or replaced any drives.

 

[Misterb]

I don't know for certain, but I doubt you can replace a failed 4TB drive with a smaller 3TB spare.

 

[KevDog]

@Misterb -- good catch if that's what has happened. You can only replace drives at similar or greater capacity than the failed drive -- not smaller.

 

[PhiloEpisteme]

@Misterb -- good catch if that's what has happened. You can only replace drives at similar or greater capacity than the failed drive -- not smaller.

Correct, you must use a drive at least the same size or larger.

I've simply set it up once and never really looked at the box since.

The fact that one drive reports as adaX rather than gptid suggests that something was not configured correctly. Typically this happens when someone replaces a drive from the command line. FreeNAS does specific formatting, configuring, and zfs flag setting that is important for its operation. It may be a fluke, but I noticed it in your output and though it may not be related to the import issue you're having it may be worth looking in to.

Did you find the instructions for importing a degraded pool?