TrueNAS-12.0-U8 Pool Offline

[CNas1]

Hi,

I'm pretty new to running a TrueNas server and recently got an error in an email that one of my pool went offline.

* Pool red1-1-pool is offline, not running scrub.

My Specs:
Version: TrueNAS-12.0-U8
CPU: Intel(R) Core(TM) i5-10400 CPU @ 2.90GHz
Memory: 32 GB

Pools:
(red1-1-pool)
with on 1 HD [WD Red Plus 10TB] (ada0)

(stripe1)
stripe, over 3 hard drives [Seagate Ironwolf 4TB] (ada1, ada2, ada3)


The pool (red1-1-pool) is the one that is now offline.

The pool should just use 1 disk,
I can see the Disk under Storage in the TrueNas Web UI, but it is now showing N/A for the pool.

I also noticed that SMB has stopped working; i am able to Map Network Drive, but now just says the specified network password is not correct.

I dont see my pool when i use

ls /mnt

I also tried looking at the drive briefly with a file recovery software.
I stopped it after a few hours, since it it would take a long time to complete, and i feel there might be a better solution.
but it was able to find some files and folders, and I also noticed that the drive is completely filled.


What can i do to investigate this further and get the pool online?

Would filling a HD completely cause a pool to go offline? and if so,
how would i be able to free up space?

Any help is greatly appreciated.
Thanks a lot.

 

[Arwen]

A single disk pool has no redundancy and too many errors on the single drive will cause the pool to become unavailable. This is not recommended because data loss is guaranteed at some point in the life of the pool.

Do you have backups of your "red1-1-pool"?

What do the following commands show?
zpool status zpool import

 

[CNas1]

Unfortunately, i dont have a backup.


zpool status

pool: boot-pool
state: ONLINE
scan: scrub repaired 0B in 00:00:01 with 0 errors on Wed Sep 13 03:45:01 2023
config:

NAME STATE READ WRITE CKSUM
boot-pool ONLINE 0 0 0
nvd0p2 ONLINE 0 0 0

errors: No known data errors

pool: stripe1
state: ONLINE
scan: scrub repaired 0B in 06:52:58 with 0 errors on Sun Aug 20 06:52:58 2023
config:

NAME STATE READ WRITE CKSUM
stripe1 ONLINE 0 0 0
gptid/47918781-0d8a-11ed-830b-18c04d8ff3ab ONLINE 0 0 0
gptid/47b7bbeb-0d8a-11ed-830b-18c04d8ff3ab ONLINE 0 0 0
gptid/47a639b1-0d8a-11ed-830b-18c04d8ff3ab ONLINE 0 0 0

errors: No known data errors

zpool import

pool: red1-1-pool
id: 2737770912408443578
state: ONLINE
action: The pool can be imported using its name or numeric identifier.
config:

red1-1-pool ONLINE
gptid/59771667-9852-11ec-99c1-18c04d8ff3ab ONLINE

 

[ChrisRJ]

And of course the pool "stripe1" is also very much at risk. Actually even more so then the single drive one.

 

[Arwen]

You can try to import your "red1-1-pool" with;
zpool import red1-1-pool
Paste in this forum the results of the command.

But, if there are too many errors, it may not import without extra options. If you are not able to import your "red1-1-pool" with the above command, their are recovery options which we can try.

Even if it were just blocks with errors, you may have lost files. After import, you can get the list of files impacted with;
zpool status -v red1-1-pool

As to the lack of backups, I know many people can't afford such. But, this is the result, probable data loss.

TrueNAS and ZFS are no different than other NAS & file systems, enough disk problems, and data loss occurs. Well, in fact, ZFS is better than most file systems because it keeps 2 copies of metadata, (like directory blocks). Plus, will at least tell you what was lost.

 

[CNas1]

zpool import red1-1-pool

cannot import 'red1-1-pool': I/O error
Recovery is possible, but will result in some data loss.
Returning the pool to its state as of Mon Aug 28 16:00:41 2023
should correct the problem. Approximately 11 seconds of data
must be discarded, irreversibly. Recovery can be attempted
by executing 'zpool import -F red1-1-pool'. A scrub of the pool
is strongly recommended after recovery.

zpool import -F red1-1-pool


zpool status -v red1-1-pool

pool: red1-1-pool
state: ONLINE
scan: scrub repaired 0B in 12:05:39 with 0 errors on Sun Aug 6 12:05:39 2023
config:

NAME STATE READ WRITE CKSUM
red1-1-pool ONLINE 0 0 0
gptid/59771667-9852-11ec-99c1-18c04d8ff3ab ONLINE 0 0 0

Awesome!
My SMB is still not working, (might just be a different issue) but I am able to access the files in pool via SSH.

Thanks so much!