(ZFS) Status UNKNOWN

[michel de geofroy]

Hi I was transfering data using apple share on my local network last night and this error came up ! what should I do?

• WARNING: The volume BRAINONE (ZFS) status is UNKNOWN: One or more devices has experienced an error resulting in data corruption. Applications may be affected.Restore the file in question if possible. Otherwise restore the entire pool from backup.

Hostname freenas.local
Build FreeNAS-8.3.1-RELEASE-p2-x86 (r12686+b770da6)
Platform Pentium(R) Dual-Core CPU E5500 @ 2.80GHz
Memory 2021MB
System Time Wed Nov 06 23:25:17 PST 2013
Uptime 11:25PM up 38 mins, 0 users
Load Average 0.19, 0.06, 0.03
Connected through 192.168.0.157
[root@freenas ~]# zpool status -v pool: BRAINONE state: ONLINE status: One or more devices has experienced an error resulting in data corruption. Applications may be affected. action: Restore the file in question if possible. Otherwise restore the entire pool from backup. see: http://www.sun.com/msg/ZFS-8000-8A scan: scrub repaired 0 in 0h51m with 0 errors on Sun Oct 20 00:51:51 2013 config: NAME STATE READ WRITE CKSUM BRAINONE ONLINE 101 0 0 gptid/0a6df9b1-b94b-11e2-b109-90fba694c351 ONLINE 101 0 0 gptid/36d17c42-bc6d-11e2-9193-90fba694c351 ONLINE 0 0 0 errors: Permanent errors have been detected in the following files: /mnt/BRAINONE/.AppleDB/cnid2.db [root@freenas ~]#

 

[cyberjock]

Well, it sounds like you have some files that are corrupt and ZFS has noticed this.

First, upgrade to the 8GB minimum as called for in the FreeNAS manual with ZFS, then go to the CLI and type "zpool status -v" to see what files are corrupt.

 

[michel de geofroy]

[root@freenas] ~# zpool status -v
pool: BRAINONE
state: ONLINE
status: One or more devices has experienced an error resulting in data
corruption. Applications may be affected.
action: Restore the file in question if possible. Otherwise restore the
entire pool from backup.
see: http://www.sun.com/msg/ZFS-8000-8A
scan: scrub repaired 9.50K in 2h16m with 122 errors on Thu Nov 7 02:02:11 2013
config:

NAME STATE READ WRITE CKSUM
BRAINONE ONLINE 122 0 0
gptid/0a6df9b1-b94b-11e2-b109-90fba694c351 ONLINE 122 0 31
gptid/36d17c42-bc6d-11e2-9193-90fba694c351 ONLINE 0 0 0

errors: Permanent errors have been detected in the following files:

/mnt/BRAINONE/MG 2/To File/To File Rhino/2005/New Show Model 5-5-2005.3dm
/mnt/BRAINONE/To File/TO SORT/To ARCHIVE/WEB SITES TO FILE/Web/Degeofroy/login/phonebook/phonebook.mdb
/mnt/BRAINONE/To File/TO SORT/USB STICK/USB 2006/Internet/PortableNVU/nvu/xpcom_compat.dll
/mnt/BRAINONE/MG 2/To File/To File Rhino/2006/Final file (3-8-2006)from muhammad.3dm
/mnt/BRAINONE/MG 2/To File/To File RAR/05-2-2006 latest.rar
/mnt/BRAINONE/.AppleDB/cnid2.db
/mnt/BRAINONE/To File/TO SORT/To ARCHIVE/WEB SITES TO FILE/Web/Degeofroy/login/UP/Archive/Public Downloads/hfl.rar
/mnt/BRAINONE/To File/TO SORT/To File/Engineering department/Aship trial files/ACAD files/for autoship as surfaces.dxf
/mnt/BRAINONE/To File/TO SORT/To File/the backup folder/Wael/ship IV/max files/ship IV 2004 only.max
/mnt/BRAINONE/To File/TO SORT/To File/the backup folder/Wael/ship IV/max files/ship IV 2004 only1.max
/mnt/BRAINONE/MG 2/To File/To File Rhino/2005/final Model 18-7-2005 test.3dm
/mnt/BRAINONE/To File/TO SORT/USB STICK/USB 2006/Internet/BitComet_0.70/lang/lang_es_es.xml
/mnt/BRAINONE/MG 2/To File/To File RAR/After 15-4.rar
/mnt/BRAINONE/MG 2/Programs/Microsoft/FRONTPAGE.rar
/mnt/BRAINONE/To File/TO SORT/To File/for max/eleg.max
/mnt/BRAINONE/MG 2/To File/To File Rhino/2005/forward cabin+bathroom 14-6-2005.3dm
/mnt/BRAINONE/To File/TO SORT/To ARCHIVE/Private Walid/For students/PVC fittings dimensions/PVC sch 80 fittings.pdf
/mnt/BRAINONE/To File/TO SORT/To ARCHIVE/WEB SITES TO FILE/Web/Degeofroy/logs/W3SVC526109752/u_ex040428.log
/mnt/BRAINONE/To File/TO SORT/To ARCHIVE/WEB SITES TO FILE/Web/Degeofroy/logs/W3SVC526109752/u_ex040504.log
/mnt/BRAINONE/To File/TO SORT/To ARCHIVE/WEB SITES TO FILE/Web/Degeofroy/logs/W3SVC526109752/u_ex040506.log
/mnt/BRAINONE/To File/TO SORT/To ARCHIVE/WEB SITES TO FILE/Web/Map Red Sea/Mapmosaic.psd
/mnt/BRAINONE/MG 2/To File/To File Rhino/2006/Model 13-2-2006 M.3dm
/mnt/BRAINONE/To File/TO SORT/USB STICK/USB 2006/Internet/PortableGaim/gaim/libgdk_pixbuf-2.0-0.dll
/mnt/BRAINONE/MG 2/To File/To File Rhino/2004/elegance hull mod 10.3dm
/mnt/BRAINONE/To File/TO SORT/USB STICK/USB 2006/Internet/PortableThunderbird/Data/profile/xpti.dat
/mnt/BRAINONE/To File/TO SORT/To ARCHIVE/WEB SITES TO FILE/Web/Degeofroy/login/payment/payroll.asp
/mnt/BRAINONE/To File/TO SORT/To File/Epoxy/SWScan0007600009.bmp
/mnt/BRAINONE/To File/TO SORT/To File/Epoxy/SWScan0007600010.bmp
/mnt/BRAINONE/To File/TO SORT/USB STICK/USB 2006/Internet/PortableThunderbird/Other/PortableThunderbirdSource/License.txt
/mnt/BRAINONE/To File/TO SORT/To ARCHIVE/WEB SITES TO FILE/Web/Degeofroy/login/mem_worldtime.asp
/mnt/BRAINONE/To File/TO SORT/To File/New Folder/SETUP.EXE
/mnt/BRAINONE/Michel/LTE/COMPANY/Photo+ ID/scan/New Folder (4)/SWScan00005.bmp
/mnt/BRAINONE/Michel/LTE/COMPANY/Photo+ ID/scan/New Folder (4)/SWScan00006.bmp
/mnt/BRAINONE/To File/TO SORT/USB STICK/USB 2006/Internet/PortableFirefox/App/firefox/greprefs/.AppleDouble/.Parent
/mnt/BRAINONE/Michel/LTE/COMPANY/Photo+ ID/scan/New Folder (4)/SWScan00007.bmp
BRAINONE@auto-20130707.0300-2y:/Music/Various Artists/Jazz and '90s/07 Suicide Blonde.mp3
BRAINONE@auto-20130707.0300-2y:/Music/Various Artists/Jazz and '90s/08 Black Hole Sun.mp3

[root@freenas] ~#

Volume Path Used Available Size Status Available actions
BRAINONE /mnt/BRAINONE 357.1 GiB (93%) 24.4 GiB 381.5 GiB HEALTHY

​

​

​

​

​

​

​

​

BRAINONE/Media /mnt/BRAINONE/Media 392.9 MiB (1%) 24.4 GiB 24.7 GiB HEALTHY

​

​

​

​

​

BRAINONE/PluginsJail /mnt/BRAINONE/PluginsJail 409.9 MiB (1%) 24.4 GiB 24.8 GiB HEALTHY

​

​

​

​

​

 

[cyberjock]

So it looks like you had 2 disks in the pool with no redundancy. One of your disks is failing. That list of files are permanently corrupted. The list will almost certainly get longer as the disk's condition worsens.

What you need to do is backup your data.. and do it asap. If the failing disk fails completely you will lose all of the data in your pool.

In the end you will need to destroy and recreate your pool since you have no redundancy for your pool and its already damaged.

 

[michel de geofroy]

How do I delete these files ? and what is the best way to back up ?

Like this for delete file ?

echo > /mnt/BRAINONE/To File/TO SORT/To File/New Folder/SETUP.EXE

 

[michel de geofroy]

and how do i know which disk is failing ?

 

[cyberjock]

files and folders are deleted with the "rm" command.

You can figure out which disk is failing by checking out SMART monitoring and seeing which disk has bad values.

Or you can take the gptid and match that to a particular disk device, then trace that to a disk serial number.

 

[michel de geofroy]

Hey Cyberjock thanks for the feed back and advice

I tried to cd to the location of file to delete it but ... see below

drwxrwxr-x 4 root wheel 512 Nov 7 00:04 .
drwxr-xr-x 20 root wheel 512 Apr 10 2013 ..
drwxrwxr-x 2 root operator 512 Nov 7 00:04 .snap
drwxrwxrwx 20 Michel wheel 30 Nov 7 02:26 BRAINONE
-rw-rw-r-- 1 root wheel 5 Apr 10 2013 md_size
[root@freenas /mnt]# cd /BRAINONE

bash: cd: /BRAINONE: No such file or directory

drwxrwxr-x 4 root wheel 512 Nov 7 00:04 . drwxr-xr-x 20 root wheel 512 Apr 10 2013 .. drwxrwxr-x 2 root operator 512 Nov 7 00:04 .snap drwxrwxrwx 20 Michel wheel 30 Nov 7 02:26 BRAINONE -rw-rw-r-- 1 root wheel 5 Apr 10 2013 md_size [root@freenas /mnt]# cd /BRAINONE bash: cd: /BRAINONE: No such file or directory

drwxrwxr-x 4 root wheel 512 Nov 7 00:04 . drwxr-xr-x 20 root wheel 512 Apr 10 2013 .. drwxrwxr-x 2 root operator 512 Nov 7 00:04 .snap drwxrwxrwx 20 Michel wheel 30 Nov 7 02:26 BRAINONE -rw-rw-r-- 1 root wheel 5 Apr 10 2013 md_size [root@freenas /mnt]# cd /BRAINONE
bash: cd: /BRAINONE: No such file or directory

 

[michel de geofroy]

see attached

 

[gpsguy]

From /mnt, just do: cd BRAINONE[

 

[michel de geofroy]

I deleted all the corrupt files but now I get this

root@freenas] ~# zpool status -v
pool: BRAINONE
state: ONLINE
status: One or more devices has experienced an error resulting in data
corruption. Applications may be affected.
action: Restore the file in question if possible. Otherwise restore the
entire pool from backup.
see: http://www.sun.com/msg/ZFS-8000-8A
scan: scrub in progress since Thu Nov 7 06:18:44 2013
64.4G scanned out of 493G at 87.3M/s, 1h23m to go
0 repaired, 13.05% done
config:

NAME STATE READ WRITE CKSUM
BRAINONE ONLINE 0 0 0
gptid/0a6df9b1-b94b-11e2-b109-90fba694c351 ONLINE 0 0 0
gptid/36d17c42-bc6d-11e2-9193-90fba694c351 ONLINE 0 0 0

errors: Permanent errors have been detected in the following files:

BRAINONE:<0x45900>
BRAINONE:<0x7e30b>
BRAINONE:<0x83c0c>
BRAINONE:<0x45b0d>
BRAINONE:<0x44c0e>
BRAINONE:<0x1a>
BRAINONE:<0x7e51d>
BRAINONE:<0x80921>
BRAINONE:<0x81a2c>
BRAINONE:<0x81a2e>
BRAINONE:<0x4583c>
BRAINONE:<0x82d46>
BRAINONE:<0x44c64>
BRAINONE:<0x3c16a>
BRAINONE:<0x81076>
BRAINONE:<0x4587e>
BRAINONE:<0x7b97e>
BRAINONE:<0x7e586>
BRAINONE:<0x7e592>
BRAINONE:<0x7e596>
BRAINONE:<0x7fa9e>
BRAINONE:<0x45ba3>
BRAINONE:<0x835b9>
BRAINONE:<0x452bd>
BRAINONE:<0x83dc4>
BRAINONE:<0x7e2c5>
BRAINONE:<0x80fd3>
BRAINONE:<0x80fd5>
BRAINONE:<0x83dd7>
BRAINONE:<0x7e1e1>
BRAINONE:<0x818e3>
BRAINONE:<0x300e8>
BRAINONE:<0x300ea>
BRAINONE:<0x833eb>
BRAINONE:<0x300ec>
<0x8e>:<0xba5c>
<0x8e>:<0xba5e>

[root@freenas] ~#

I used the rm command

e.g. [root@freenas] ~# rm "/mnt/BRAINONE/To File/TO SORT/To File/the backup folder/Wael/ship IV/max files/ship IV 2004 only1.max"

the inverted " " commas helped for where file location included spaces

I am trying to get to my files to back them up but I can't fails in ftp and in afp

could I connect a USB HD and move all files to it ? and if so how ?

any tips ?

 

[cyberjock]

could I connect a USB HD and move all files to it ? and if so how ?

any tips ?

Yes, you can connect a USB hard drive and move the files. Read up on mounting drives from the FreeNAS GUI and the appropriate copy commands on FreeBSD's manpages.

Remember when I said this...

What you need to do is backup your data.. and do it asap. If the failing disk fails completely you will lose all of the data in your pool.

In the end you will need to destroy and recreate your pool since you have no redundancy for your pool and its already damaged.

Especially the bold. That's because I knew that after you deleted the files you'd still have pool metadata corruption to deal with. The only easy solution is to destroy and recreate the pool after you get the new disk.

And maybe this time use redundancy. Using 2 disks in the configuration you did is very risky business. It's quite possible you might not even be able to copy off all of the files you already have because the metadata corruption may cause a kernel panic.

Good luck!

 

[ss4johnny]

I'm new to FreeNas and ZFS and am having a similar issue with errors (I have 6 3TB drives in a raidz2 configuration). I've only transferred a portion of my files, but I didn't set up SMART, Scrubs, or Snapshots until I noticed the alert about errors. After noticing, I identified the corrupt files and removed them as the OP did. The memory addresses are still being listed as errors. The way I have it set up is that I have the volume and then a ZFS dataset underneath with about 1TB (now at least). Initially, there are no issues with the dataset as errors were at the volume level, but the scrub detected some additional errors within the dataset.

@Cyberjock, would your recommendation still be the best approach in my case? I've only moved some of my files to the NAS, so I can still move them back and re-create the pool. However, it seems like that would be a very time intensive process and it seems a bit like overkill. What are the options with ZFS-2?