One or more devices are faulted in response to persistent errors.

[Apollo]

Just got a Critical Alert e-mail about my volume.

Code:

  pool: WD-RAIDZ2
 state: DEGRADED
status: One or more devices are faulted in response to persistent errors.
  Sufficient replicas exist for the pool to continue functioning in a
  degraded state.
action: Replace the faulted device, or use 'zpool clear' to mark the device
  repaired.
  scan: scrub repaired 0 in 9h50m with 0 errors on Mon Mar 16 10:51:05 2015
config:

  NAME  STATE  READ WRITE CKSUM
  WD-RAIDZ2  DEGRADED  0  0  0
  raidz2-0  DEGRADED  0  0  0
  gptid/a6dcb01c-3174-11e4-8297-002590f4b7f8  ONLINE  0  0  0
  gptid/a76cce30-3174-11e4-8297-002590f4b7f8  ONLINE  0  0  0
  gptid/a7fe3726-3174-11e4-8297-002590f4b7f8  ONLINE  0  0  0
  gptid/a88fe944-3174-11e4-8297-002590f4b7f8  ONLINE  0  0  0
  gptid/a91ebf6c-3174-11e4-8297-002590f4b7f8  FAULTED  0  108  0  too many errors
  gptid/a9a5e749-3174-11e4-8297-002590f4b7f8  ONLINE  0  0  0

errors: No known data errors

  pool: freenas-boot
 state: ONLINE
  scan: scrub repaired 0 in 0h3m with 0 errors on Sat Mar 14 03:48:14 2015
config:

  NAME  STATE  READ WRITE CKSUM
  freenas-boot  ONLINE  0  0  0
  gptid/960500a9-896e-11e4-9fb0-002590f4b7f8  ONLINE  0  0  0

errors: No known data errors

Results of "smartctl -a" on every device is provided in attached file.

What is my course of action?

 

[Ericloewe]

Are you sure you got all the drives? SMART data looks fine.

 

[Apollo]

Are you sure you got all the drives? SMART data looks fine.

I got all the drives.
I am doing "zpool scrub" and here is the status:
I got the automated e-mail security run output ar 3:01 AM.
I have done "smartctl -a" on all the drives again and saved the results in individual files.
See attached files.

 

[cyberjock]

Please provide a debug file for your server. ;)

 

[Apollo]

Which part of the file are you interested in?
The TGZ file is 11MB.
Beside I am not comfortable just sending its content on the forum.

 

[cyberjock]

I normally look at all of the files looking for something "out of place".