FreeNAS 8.3 Will Not retain ZFS Pool

Status
Not open for further replies.
G

ghostlobster

Dabbler
Joined
Oct 10, 2012
Messages
36
Hmmm...no luck there...here's what I got:
Code:
[root@freenas ~]# zpool export RAID                                             
cannot open 'RAID': no such pool                                                
[root@freenas ~]# zpool export -f RAID                                          
cannot open 'RAID': no such pool                                                
[root@freenas ~]#


just for the hell of it I'll restart the box and see what happens. I may have hosed things a bit with that import -f before. I doubt that it'll change anything but it'll give me something to do for a few moments.

Nope, no different after a reboot.
Here's a zpool status...nothing surprising here.
Code:
[root@freenas ~]# zpool status                                                  
no pools available


Should I try a zpool import first, no options or -f flag before the export?
 
paleoN

paleoN

Wizard
Joined
Apr 22, 2012
Messages
1,403
ghostlobster said:
Should I try a zpool import first, no options or -f flag before the export?
Click to expand...
A blank zpool import, what I asked for, will list available pools for import.

Does the GUI think any pools are imported? If so export the pool from the GUI, do not mark disks as new.

Otherwise, I suppose we could always delete the zpool cache file:
Code:
mount -uw /

rm /data/zfs/zpool.cache

shutdown -r now
The last command will reboot the system obviously.
 
G

ghostlobster

Dabbler
Joined
Oct 10, 2012
Messages
36
Things appear pretty weird in my world. Here's what I'm looking at right now:

Nothing is listed in the storage panel in the GUI where zfs volumes would be. All disks do appear in the view disks page, but within Active Volumes, nothing is listed.

also, the zpool.cahe file does not exist:
Code:
[root@freenas ~]# mount -uw /                                                   
[root@freenas ~]# rm /data/zfs/zpool.cache                                      
rm: /data/zfs/zpool.cache: No such file or directory


A ls in the /data/zfs directory shows that it's empty as well:
Code:
[root@freenas /data/zfs]# ls                                                    
[root@freenas /data/zfs]#


Wow, thoughts? Ideas? Flamethrowers?
 
paleoN

paleoN

Wizard
Joined
Apr 22, 2012
Messages
1,403
G

ghostlobster

Dabbler
Joined
Oct 10, 2012
Messages
36
This:
Code:
[root@freenas ~]# zpool import                                                  
   pool: RAID                                                                   
     id: 10036866808421506734                                                   
  state: FAULTED                                                                
 status: One or more devices contains corrupted data.                           
 action: The pool cannot be imported due to damaged devices or data.            
        The pool may be active on another system, but can be imported using     
        the '-f' flag.                                                          
   see: http://www.sun.com/msg/ZFS-8000-5E                                      
 config:                                                                        
                                                                                
        RAID                      FAULTED  corrupted data                       
          raidz1-0                ONLINE                                        
            4140409436293275748   UNAVAIL  corrupted data                       
            13949890047348135266  UNAVAIL  corrupted data                       
            12864383027183141833  UNAVAIL  corrupted data                       
          14728624880139133829    UNAVAIL  corrupted data                       
[root@freenas ~]#
 
paleoN

paleoN

Wizard
Joined
Apr 22, 2012
Messages
1,403
I would try doing a Factory Restore at this point. It doesn't touch the pool.

If zpool import is still the same afterwards give mfsBSD a shot.
 
G

ghostlobster

Dabbler
Joined
Oct 10, 2012
Messages
36
OK...factory reset.
change in results:
Code:
[root@freenas ~]# zpool import                                                  
   pool: RAID                                                                   
     id: 10036866808421506734                                                   
  state: ONLINE                                                                 
 status: One or more devices contains corrupted data.                           
 action: The pool can be imported using its name or numeric identifier.         
   see: http://www.sun.com/msg/ZFS-8000-4J                                      
 config:                                                                        
                                                                                
        RAID                                            ONLINE                  
          raidz1-0                                      ONLINE                  
            gptid/32ea520c-031e-11e2-b182-000acd1fbb8d  ONLINE                  
            gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d  ONLINE                  
            gptid/36a53dae-031e-11e2-b182-000acd1fbb8d  ONLINE                  
          14728624880139133829                          UNAVAIL  corrupted data


With that 4th item showing as unavailable, is that going to be a major issue? I have not run any commands on anything except that import command to see what's there.
 
paleoN

paleoN

Wizard
Joined
Apr 22, 2012
Messages
1,403
ghostlobster said:
With that 4th item showing as unavailable, is that going to be a major issue? I have not run any commands on anything except that import command to see what's there.
Click to expand...
Yes, it's a major issue. That's the top level single disk stripe vdev. The one with no redundancy.

Let's see what happens with:
Code:
zpool import -R /mnt -o failmode=continue -o rdonly=on RAID
 
paleoN

paleoN

Wizard
Joined
Apr 22, 2012
Messages
1,403
I was/am expecting the above command to fail. Though it might work.

Assuming it failed, it would be nice to see a current glabel status. In addition the output of zdb -l /dev/adaXp2 for the remaining 3 drives.

It's also past time to run some long tests against all your disks:
Code:
smartctl -t long /dev/ada1
smartctl -t long /dev/ada2
smartctl -t long /dev/ada3
smartctl -t long /dev/ada4
 
G

ghostlobster

Dabbler
Joined
Oct 10, 2012
Messages
36
Sorry for the delay in responding, I've got family in town and was summoned to them yesterday.
Yes, that command cratered with an exception yesterday. Unfortunately, I didn't make a note of it as I had other things going on.
OK, zdb -l /dev/ada1p2 output:
Code:
--------------------------------------------                                    
LABEL 0                                                                         
--------------------------------------------                                    
    version: 28                                                                 
    name: 'RAID'                                                                
    state: 0                                                                    
    txg: 192838                                                                 
    pool_guid: 10036866808421506734                                             
    hostid: 1362761028                                                          
    hostname: 'freenas.local'                                                   
    top_guid: 11941661085329332228                                              
    guid: 12864383027183141833                                                  
    vdev_children: 2                                                            
    vdev_tree:                                                                  
        type: 'raidz'                                                           
        id: 0                                                                   
        guid: 11941661085329332228                                              
        nparity: 1                                                              
        metaslab_array: 23                                                      
        metaslab_shift: 31                                                      
        ashift: 9                                                               
        asize: 2994157387776                                                    
        is_log: 0                                    
        children[0]:                                                            
            type: 'disk'                                                        
            id: 0                                                               
            guid: 4140409436293275748                                           
            path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
            DTL: 54                                                             
        children[1]:                                                            
            type: 'disk'                                                        
            id: 1                                                               
            guid: 13949890047348135266                                          
            path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
        children[2]:                                                            
            type: 'disk'                                                        
            id: 2                                                               
            guid: 12864383027183141833                                          
            path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
--------------------------------------------                                    
LABEL 1                                                                         
--------------------------------------------                                    
    version: 28                                                                 
    name: 'RAID'                                                                
    state: 0                                                                    
    txg: 192838                                                                 
    pool_guid: 10036866808421506734                                             
    hostid: 1362761028                                                          
    hostname: 'freenas.local'                                                   
    top_guid: 11941661085329332228                                              
    guid: 12864383027183141833                                                  
    vdev_children: 2                                                            
    vdev_tree:                                                                  
        type: 'raidz'                                                           
        id: 0                                                                   
        guid: 11941661085329332228                                              
        nparity: 1                                                              
        metaslab_array: 23                                                      
        metaslab_shift: 31                                                      
        ashift: 9                                                               
        asize: 2994157387776                                                    
        is_log: 0                                                               
        children[0]:                                           
            type: 'disk'                                                        
            id: 0                                                               
            guid: 4140409436293275748                                           
            path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
            DTL: 54                                                             
        children[1]:                                                            
            type: 'disk'                                                        
            id: 1                                                               
            guid: 13949890047348135266                                          
            path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
        children[2]:                                                            
            type: 'disk'                                                        
            id: 2                                                               
            guid: 12864383027183141833                                          
            path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
--------------------------------------------                                    
LABEL 2                                                                         
--------------------------------------------                                    
    version: 28                                                                 
    name: 'RAID'                                                                
    state: 0                                                                    
    txg: 192838                                                                 
    pool_guid: 10036866808421506734                                             
    hostid: 1362761028                                                          
    hostname: 'freenas.local'                                                   
    top_guid: 11941661085329332228                                              
    guid: 12864383027183141833                                                  
    vdev_children: 2                                                            
    vdev_tree:                                                                  
        type: 'raidz'                                                           
        id: 0                                                                   
        guid: 11941661085329332228                                              
        nparity: 1                                                              
        metaslab_array: 23                                                      
        metaslab_shift: 31                                                      
        ashift: 9                                                               
        asize: 2994157387776                                                    
        is_log: 0                                                               
        children[0]:                                                            
            type: 'disk'                                                        
            id: 0                                                               
            guid: 4140409436293275748                                           
            path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
            DTL: 54                                                             
        children[1]:                                                            
            type: 'disk'                                                        
            id: 1                                                               
            guid: 13949890047348135266                                          
            path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
        children[2]:                                                            
            type: 'disk'                                                        
            id: 2                                                               
            guid: 12864383027183141833                                          
            path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
--------------------------------------------                                    
LABEL 3                                                                         
--------------------------------------------                                  
   version: 28                                                                 
    name: 'RAID'                                                                
    state: 0                                                                    
    txg: 192838                                                                 
    pool_guid: 10036866808421506734                                             
    hostid: 1362761028                                                          
    hostname: 'freenas.local'                                                   
    top_guid: 11941661085329332228                                              
    guid: 12864383027183141833                                                  
    vdev_children: 2                                                            
    vdev_tree:                                                                  
        type: 'raidz'                                                           
        id: 0                                                                   
        guid: 11941661085329332228                                              
        nparity: 1                                                              
        metaslab_array: 23                                                      
        metaslab_shift: 31                                                      
        ashift: 9                                                               
        asize: 2994157387776                                                    
        is_log: 0                                                               
        children[0]:                                                            
            type: 'disk'                                                        
            id: 0                                                        
  is_log: 0                                                               
        children[0]:                                                            
            type: 'disk'                                                        
            id: 0                                                               
            guid: 4140409436293275748                                           
            path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
            DTL: 54                                                             
        children[1]:                                                            
            type: 'disk'                                                        
            id: 1                                                               
            guid: 13949890047348135266                                          
            path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
        children[2]:                                                            
            type: 'disk'                                                        
            id: 2                                                               
            guid: 12864383027183141833                                          
            path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0


zdb -l /dev/ada2p2 output:
Code:
--------------------------------------------                                    
LABEL 0                                                                         
--------------------------------------------                                    
    version: 28                                                                 
    name: 'RAID'                                                                
    state: 0                                                                    
    txg: 192838                                                                 
    pool_guid: 10036866808421506734                                             
    hostid: 1362761028                                                          
    hostname: 'freenas.local'                                                   
    top_guid: 11941661085329332228                                              
    guid: 13949890047348135266                                                  
    vdev_children: 2                                                            
    vdev_tree:                                                                  
        type: 'raidz'                                                           
        id: 0                                                                   
        guid: 11941661085329332228                                              
        nparity: 1                                                              
        metaslab_array: 23                                                      
        metaslab_shift: 31                                                      
        ashift: 9                                                               
        asize: 2994157387776                                                    
        is_log: 0                                         
       children[0]:                                                            
            type: 'disk'                                                        
            id: 0                                                               
            guid: 4140409436293275748                                           
            path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
            DTL: 54                                                             
        children[1]:                                                            
            type: 'disk'                                                        
            id: 1                                                               
            guid: 13949890047348135266                                          
            path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
        children[2]:                                                            
            type: 'disk'                                                        
            id: 2                                                               
            guid: 12864383027183141833                                          
            path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
--------------------------------------------                         
LABEL 1                                                                         
--------------------------------------------                                    
    version: 28                                                                 
    name: 'RAID'                                                                
    state: 0                                                                    
    txg: 192838                                                                 
    pool_guid: 10036866808421506734                                             
    hostid: 1362761028                                                          
    hostname: 'freenas.local'                                                   
    top_guid: 11941661085329332228                                              
    guid: 13949890047348135266                                                  
    vdev_children: 2                                                            
    vdev_tree:                                                                  
        type: 'raidz'                                                           
        id: 0                                                                   
        guid: 11941661085329332228                                              
        nparity: 1                                                              
        metaslab_array: 23                                                      
        metaslab_shift: 31                                                      
        ashift: 9                                                               
        asize: 2994157387776                                                    
        is_log: 0                                                               
        children[0]:                                           
            type: 'disk'                                                        
            id: 0                                                               
            guid: 4140409436293275748                                           
            path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
            DTL: 54                                                             
        children[1]:                                                            
            type: 'disk'                                                        
            id: 1                                                               
            guid: 13949890047348135266                                          
            path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
        children[2]:                                                            
            type: 'disk'                                                        
            id: 2                                                               
            guid: 12864383027183141833                                          
            path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
--------------------------------------------                                    
LABEL 2                                                                
--------------------------------------------                                    
    version: 28                                                                 
    name: 'RAID'                                                                
    state: 0                                                                    
    txg: 192838                                                                 
    pool_guid: 10036866808421506734                                             
    hostid: 1362761028                                                          
    hostname: 'freenas.local'                                                   
    top_guid: 11941661085329332228                                              
    guid: 13949890047348135266                                                  
    vdev_children: 2                                                            
    vdev_tree:                                                                  
        type: 'raidz'                                                           
        id: 0                                                                   
        guid: 11941661085329332228                                              
        nparity: 1                                                              
        metaslab_array: 23                                                      
        metaslab_shift: 31                                                      
        ashift: 9                                                               
        asize: 2994157387776                                                    
        is_log: 0                                                               
        children[0]:                                                            
            type: 'disk'                                         
            id: 0                                                               
            guid: 4140409436293275748                                           
            path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
            DTL: 54                                                             
        children[1]:                                                            
            type: 'disk'                                                        
            id: 1                                                               
            guid: 13949890047348135266                                          
            path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
        children[2]:                                                            
            type: 'disk'                                                        
            id: 2                                                               
            guid: 12864383027183141833                                          
            path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
--------------------------------------------                                    
LABEL 3                                                                         
--------------------------------------------                              
   version: 28                                                                 
    name: 'RAID'                                                                
    state: 0                                                                    
    txg: 192838                                                                 
    pool_guid: 10036866808421506734                                             
    hostid: 1362761028                                                          
    hostname: 'freenas.local'                                                   
    top_guid: 11941661085329332228                                              
    guid: 13949890047348135266                                                  
    vdev_children: 2                                                            
    vdev_tree:                                                                  
        type: 'raidz'                                                           
        id: 0                                                                   
        guid: 11941661085329332228                                              
        nparity: 1                                                              
        metaslab_array: 23                                                      
        metaslab_shift: 31                                                      
        ashift: 9                                                               
        asize: 2994157387776                                                    
        is_log: 0                                                               
        children[0]:                                                            
            type: 'disk'                                                        
            id: 0                                               
        is_log: 0                                                               
        children[0]:                                                            
            type: 'disk'                                                        
            id: 0                                                               
            guid: 4140409436293275748                                           
            path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
            DTL: 54                                                             
        children[1]:                                                            
            type: 'disk'                                                        
            id: 1                                                               
            guid: 13949890047348135266                                          
            path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
        children[2]:                                                            
            type: 'disk'                                                        
            id: 2                                                               
            guid: 12864383027183141833                                          
            path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0


zdb -l /dev/ada3p2 output:
Code:
--------------------------------------------                                    
LABEL 0                                                                         
--------------------------------------------                                    
    version: 28                                                                 
    name: 'RAID'                                                                
    state: 0                                                                    
    txg: 192838                                                                 
    pool_guid: 10036866808421506734                                             
    hostid: 1362761028                                                          
    hostname: 'freenas.local'                                                   
    top_guid: 11941661085329332228                                              
    guid: 4140409436293275748                                                   
    vdev_children: 2                                                            
    vdev_tree:                                                                  
        type: 'raidz'                                                           
        id: 0                                                                   
        guid: 11941661085329332228                                              
        nparity: 1                                                              
        metaslab_array: 23                                                      
        metaslab_shift: 31                                                      
        ashift: 9                                                               
        asize: 2994157387776                                                    
        is_log: 0                                   
      children[0]:                                                            
            type: 'disk'                                                        
            id: 0                                                               
            guid: 4140409436293275748                                           
            path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
            DTL: 54                                                             
        children[1]:                                                            
            type: 'disk'                                                        
            id: 1                                                               
            guid: 13949890047348135266                                          
            path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
        children[2]:                                                            
            type: 'disk'                                                        
            id: 2                                                               
            guid: 12864383027183141833                                          
            path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
--------------------------------------------                               
LABEL 1                                                                         
--------------------------------------------                                    
    version: 28                                                                 
    name: 'RAID'                                                                
    state: 0                                                                    
    txg: 192838                                                                 
    pool_guid: 10036866808421506734                                             
    hostid: 1362761028                                                          
    hostname: 'freenas.local'                                                   
    top_guid: 11941661085329332228                                              
    guid: 4140409436293275748                                                   
    vdev_children: 2                                                            
    vdev_tree:                                                                  
        type: 'raidz'                                                           
        id: 0                                                                   
        guid: 11941661085329332228                                              
        nparity: 1                                                              
        metaslab_array: 23                                                      
        metaslab_shift: 31                                                      
        ashift: 9                                                               
        asize: 2994157387776                                                    
        is_log: 0                                                               
        children[0]:                                          
            type: 'disk'                                                        
            id: 0                                                               
            guid: 4140409436293275748                                           
            path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
            DTL: 54                                                             
        children[1]:                                                            
            type: 'disk'                                                        
            id: 1                                                               
            guid: 13949890047348135266                                          
            path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
        children[2]:                                                            
            type: 'disk'                                                        
            id: 2                                                               
            guid: 12864383027183141833                                          
            path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
--------------------------------------------                                    
LABEL 2                                                             
--------------------------------------------                                    
    version: 28                                                                 
    name: 'RAID'                                                                
    state: 0                                                                    
    txg: 192838                                                                 
    pool_guid: 10036866808421506734                                             
    hostid: 1362761028                                                          
    hostname: 'freenas.local'                                                   
    top_guid: 11941661085329332228                                              
    guid: 4140409436293275748                                                   
    vdev_children: 2                                                            
    vdev_tree:                                                                  
        type: 'raidz'                                                           
        id: 0                                                                   
        guid: 11941661085329332228                                              
        nparity: 1                                                              
        metaslab_array: 23                                                      
        metaslab_shift: 31                                                      
        ashift: 9                                                               
        asize: 2994157387776                                                    
        is_log: 0                                                               
        children[0]:                                                            
            type: 'disk'                               
            id: 0                                                               
            guid: 4140409436293275748                                           
            path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
            DTL: 54                                                             
        children[1]:                                                            
            type: 'disk'                                                        
            id: 1                                                               
            guid: 13949890047348135266                                          
            path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
        children[2]:                                                            
            type: 'disk'                                                        
            id: 2                                                               
            guid: 12864383027183141833                                          
            path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
--------------------------------------------                                    
LABEL 3                                                                         
--------------------------------------------                    
   version: 28                                                                 
    name: 'RAID'                                                                
    state: 0                                                                    
    txg: 192838                                                                 
    pool_guid: 10036866808421506734                                             
    hostid: 1362761028                                                          
    hostname: 'freenas.local'                                                   
    top_guid: 11941661085329332228                                              
    guid: 4140409436293275748                                                   
    vdev_children: 2                                                            
    vdev_tree:                                                                  
        type: 'raidz'                                                           
        id: 0                                                                   
        guid: 11941661085329332228                                              
        nparity: 1                                                              
        metaslab_array: 23                                                      
        metaslab_shift: 31                                                      
        ashift: 9                                                               
        asize: 2994157387776                                                    
        is_log: 0                                                               
        children[0]:                                                            
            type: 'disk'                                                        
            id: 0                                         
      is_log: 0                                                               
        children[0]:                                                            
            type: 'disk'                                                        
            id: 0                                                               
            guid: 4140409436293275748                                           
            path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
            DTL: 54                                                             
        children[1]:                                                            
            type: 'disk'                                                        
            id: 1                                                               
            guid: 13949890047348135266                                          
            path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0                                                       
        children[2]:                                                            
            type: 'disk'                                                        
            id: 2                                                               
            guid: 12864383027183141833                                          
            path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'             
            phys_path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'        
            whole_disk: 0


And, just for the hell of it, zdb -l /dev/ada4p2 output:
Code:
--------------------------------------------                                    
LABEL 0                                                                         
--------------------------------------------                                    
    version: 28                                                                 
    name: 'RAID'                                                                
    state: 0                                                                    
    txg: 192838                                                                 
    pool_guid: 10036866808421506734                                             
    hostid: 1362761028                                                          
    hostname: 'freenas.local'                                                   
    top_guid: 14728624880139133829                                              
    guid: 14728624880139133829                                                  
    vdev_children: 2                                                            
    vdev_tree:                                                                  
        type: 'disk'                                                            
        id: 1                                                                   
        guid: 14728624880139133829                                              
        path: '/dev/gptid/29ace990-0420-11e2-ba6f-000acd1fbb8d'                 
        phys_path: '/dev/gptid/29ace990-0420-11e2-ba6f-000acd1fbb8d'            
        whole_disk: 0                                                           
        metaslab_array: 742                                                     
        metaslab_shift: 30                                                      
        ashift: 9                                         
       asize: 998052462592                                                     
        is_log: 0                                                               
--------------------------------------------                                    
LABEL 1                                                                         
--------------------------------------------                                    
    version: 28                                                                 
    name: 'RAID'                                                                
    state: 0                                                                    
    txg: 192838                                                                 
    pool_guid: 10036866808421506734                                             
    hostid: 1362761028                                                          
    hostname: 'freenas.local'                                                   
    top_guid: 14728624880139133829                                              
    guid: 14728624880139133829                                                  
    vdev_children: 2                                                            
    vdev_tree:                                                                  
        type: 'disk'                                                            
        id: 1                                                                   
        guid: 14728624880139133829                                              
        path: '/dev/gptid/29ace990-0420-11e2-ba6f-000acd1fbb8d'                 
        phys_path: '/dev/gptid/29ace990-0420-11e2-ba6f-000acd1fbb8d'            
        whole_disk: 0                                                           
        metaslab_array: 742                                                
   top_guid: 14728624880139133829                                              
    guid: 14728624880139133829                                                  
    vdev_children: 2                                                            
    vdev_tree:                                                                  
        type: 'disk'                                                            
        id: 1                                                                   
        guid: 14728624880139133829                                              
        path: '/dev/gptid/29ace990-0420-11e2-ba6f-000acd1fbb8d'                 
        phys_path: '/dev/gptid/29ace990-0420-11e2-ba6f-000acd1fbb8d'            
        whole_disk: 0                                                           
        metaslab_array: 742                                                     
        metaslab_shift: 30                                                      
        ashift: 9                                                               
        asize: 998052462592                                                     
        is_log: 0                                                               
--------------------------------------------                                    
LABEL 2                                                                         
--------------------------------------------                                    
failed to unpack label 2                                                        
--------------------------------------------                                    
LABEL 3                                                                         
--------------------------------------------                                    
failed to unpack label 3                                                        

[root@freenas ~]#


Interesting output on ada4!
Now, the long tests...how do I get the results of it? When I enter the command for each one, I get the following for each one. I'm guessing it's running in the background:

Code:
[root@freenas ~]# smartctl -t long /dev/ada4                                    
smartctl 5.43 2012-06-30 r3573 [FreeBSD 8.3-RELEASE-p4 amd64] (local build)     
Copyright (C) 2002-12 by Bruce Allen, http://smartmontools.sourceforge.net      
                                                                                
=== START OF OFFLINE IMMEDIATE AND SELF-TEST SECTION ===                        
Sending command: "Execute SMART Extended self-test routine immediately in off-li
ne mode".                                                                       
Drive command "Execute SMART Extended self-test routine immediately in off-line 
mode" successful.                                                               
Testing has begun.                                                              
Please wait 176 minutes for test to complete.                                   
Test will complete after Sat Oct 13 10:40:27 2012                               
                                                                                
Use smartctl -X to abort test.                                                  
[root@freenas ~]#


I'll run the glabel status later on this afternoon, right now, if the other tests are running in the background, I don't want to stress it too much.
I've now got family bellowing to me, but wanted to get as much data as I could to you and anyone else. I appreciate this help so much, you have no idea! Thanks a bunch...regardless of the outcome, your help is very very appreciated.
 
paleoN

paleoN

Wizard
Joined
Apr 22, 2012
Messages
1,403
ghostlobster said:
Yes, that command cratered with an exception yesterday. Unfortunately, I didn't make a note of it as I had other things going on.
Click to expand...
I wouldn't mind seeing what it was, but I at least wouldn't be able to do anything with it.

ghostlobster said:
Interesting output on ada4!
Click to expand...
Yes, AFAICT this indicates that ada4 is the single disk vdev. It's missing the last two labels which are located at the end of the partition. It's also the drive that appeared to be having the most trouble.

I'm still slightly confused by some of the output of the other commands:
Code:
glabel status

gpart list

camcontrol devlist
The gpart list will long. You can cut out the part about ada0.

ghostlobster said:
Now, the long tests...how do I get the results of it? When I enter the command for each one, I get the following for each one. I'm guessing it's running in the background:
Click to expand...
Yes, the tests run in the background and are internal to each drive. Any access to the drives will slow/pause the tests.

In a separate post, full output of the following for each disk:
Code:
smartctl -q noserial -a /dev/adaX
 
G

ghostlobster

Dabbler
Joined
Oct 10, 2012
Messages
36
OK...the family has left so I can get back to work on this. Here's what I've done. I've done a complete rebuild on the box, removed the IDE drive which was being used as the freenas OS install drive, and installed FreeNAS on a USB drive. The SATA data drives are probably all connected to different SATA ports on the mobo...honestly, as messed up as things were, I did not think it would have much of a bearing on the troubleshooting here.
I added another 4BG USB drive and shared it out as a CIFS share, just so I could get to the outputs of these commands easier, and don't run the risk of missing things with a copy and paste of screens using a |more command.
So...here's what I've got:

Glabel status:
Code:
                                                              Name  Status  Components
gptid/29ace990-0420-11e2-ba6f-000acd1fbb8d     N/A  ada0p2
gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d     N/A  ada1p2
gptid/36a53dae-031e-11e2-b182-000acd1fbb8d     N/A  ada2p2
gptid/32ea520c-031e-11e2-b182-000acd1fbb8d     N/A  ada3p2
                             ufs/FreeNASs3     N/A  da0s3
                             ufs/FreeNASs4     N/A  da0s4
                            ufs/FreeNASs1a     N/A  da0s1a
                                ufs/output     N/A  da1p2


gpart list
Code:
Geom name: ada0
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 1953525134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada0p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 65536
   Mode: r1w1e0
   rawuuid: 2997569c-0420-11e2-ba6f-000acd1fbb8d
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada0p2
   Mediasize: 998057319936 (929G)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 2147549184
   Mode: r0w0e0
   rawuuid: 29ace990-0420-11e2-ba6f-000acd1fbb8d
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 998057319936
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 1953525134
   start: 4194432
Consumers:
1. Name: ada0
   Mediasize: 1000204886016 (931G)
   Sectorsize: 512
   Mode: r1w1e1

Geom name: ada1
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 1953525134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada1p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 65536
   Mode: r1w1e0
   rawuuid: 3594a100-031e-11e2-b182-000acd1fbb8d
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada1p2
   Mediasize: 998057319936 (929G)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 2147549184
   Mode: r0w0e0
   rawuuid: 35b37ca9-031e-11e2-b182-000acd1fbb8d
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 998057319936
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 1953525134
   start: 4194432
Consumers:
1. Name: ada1
   Mediasize: 1000204886016 (931G)
   Sectorsize: 512
   Mode: r1w1e1

Geom name: ada2
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 1953525134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada2p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e0
   rawuuid: 3680e0f9-031e-11e2-b182-000acd1fbb8d
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada2p2
   Mediasize: 998057319936 (929G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   rawuuid: 36a53dae-031e-11e2-b182-000acd1fbb8d
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 998057319936
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 1953525134
   start: 4194432
Consumers:
1. Name: ada2
   Mediasize: 1000204886016 (931G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1

Geom name: ada3
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 1953525134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada3p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e0
   rawuuid: 32ac0871-031e-11e2-b182-000acd1fbb8d
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada3p2
   Mediasize: 998057319936 (929G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   rawuuid: 32ea520c-031e-11e2-b182-000acd1fbb8d
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 998057319936
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 1953525134
   start: 4194432
Consumers:
1. Name: ada3
   Mediasize: 1000204886016 (931G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1

Geom name: da0
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 4050943
first: 63
entries: 4
scheme: MBR
Providers:
1. Name: da0s1
   Mediasize: 988291584 (942M)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 32256
   Mode: r1w0e1
   attrib: active
   rawtype: 165
   length: 988291584
   offset: 32256
   type: freebsd
   index: 1
   end: 1930319
   start: 63
2. Name: da0s2
   Mediasize: 988291584 (942M)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 988356096
   Mode: r0w0e0
   rawtype: 165
   length: 988291584
   offset: 988356096
   type: freebsd
   index: 2
   end: 3860639
   start: 1930383
3. Name: da0s3
   Mediasize: 1548288 (1.5M)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 1976647680
   Mode: r0w0e0
   rawtype: 165
   length: 1548288
   offset: 1976647680
   type: freebsd
   index: 3
   end: 3863663
   start: 3860640
4. Name: da0s4
   Mediasize: 21159936 (20M)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 1978195968
   Mode: r1w1e2
   rawtype: 165
   length: 21159936
   offset: 1978195968
   type: freebsd
   index: 4
   end: 3904991
   start: 3863664
Consumers:
1. Name: da0
   Mediasize: 2074083328 (2G)
   Sectorsize: 512
   Mode: r2w1e4

Geom name: da0s1
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 1930256
first: 0
entries: 8
scheme: BSD
Providers:
1. Name: da0s1a
   Mediasize: 988283392 (942M)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 40448
   Mode: r1w0e1
   rawtype: 0
   length: 988283392
   offset: 8192
   type: !0
   index: 1
   end: 1930256
   start: 16
Consumers:
1. Name: da0s1
   Mediasize: 988291584 (942M)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 32256
   Mode: r1w0e1

Geom name: da1
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 7669790
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da1p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 65536
   Mode: r1w1e0
   rawuuid: af4a6a70-17d4-11e2-95dd-001617ec2159
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: da1p2
   Mediasize: 1779383808 (1.7G)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 2147549184
   Mode: r1w1e2
   rawuuid: af86620d-17d4-11e2-95dd-001617ec2159
   rawtype: 516e7cb6-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 1779383808
   offset: 2147549184
   type: freebsd-ufs
   index: 2
   end: 7669790
   start: 4194432
Consumers:
1. Name: da1
   Mediasize: 3926949888 (3.7G)
   Sectorsize: 512
   Mode: r2w2e4


camcontrol devlist
Code:
<HP DVD Writer 640b E152>          at scbus0 target 0 lun 0 (pass0,cd0)
<ST31000528AS CC46>                at scbus2 target 0 lun 0 (pass1,ada0)
<ST31000520AS CC32>                at scbus3 target 0 lun 0 (pass2,ada1)
<ST1000DM003-9YN162 CC4B>          at scbus4 target 0 lun 0 (pass3,ada2)
<ST1000DL002-9TT153 CC32>          at scbus5 target 0 lun 0 (pass4,ada3)
< MIMOBOT 8.07>                    at scbus8 target 0 lun 0 (pass5,da0)
<Kingston DataTraveler G3 PMAP>    at scbus9 target 0 lun 0 (da1,pass6)


smartctl output coming in next post
 
G

ghostlobster

Dabbler
Joined
Oct 10, 2012
Messages
36
smartctl -q noserial -a /dev/adax:
Ada0:
Code:
smartctl 5.43 2012-06-30 r3573 [FreeBSD 8.3-RELEASE-p4 amd64] (local build)
Copyright (C) 2002-12 by Bruce Allen, http://smartmontools.sourceforge.net

=== START OF INFORMATION SECTION ===
Model Family:     Seagate Barracuda 7200.12
Device Model:     ST31000528AS
Firmware Version: CC46
User Capacity:    1,000,204,886,016 bytes [1.00 TB]
Sector Size:      512 bytes logical/physical
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   8
ATA Standard is:  ATA-8-ACS revision 4
Local Time is:    Tue Oct 16 14:17:44 2012 PDT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x82)	Offline data collection activity
					was completed without error.
					Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0)	The previous self-test routine completed
					without error or no self-test has ever 
					been run.
Total time to complete Offline 
data collection: 		(  600) seconds.
Offline data collection
capabilities: 			 (0x7b) SMART execute Offline immediate.
					Auto Offline data collection on/off support.
					Suspend Offline collection upon new
					command.
					Offline surface scan supported.
					Self-test supported.
					Conveyance Self-test supported.
					Selective Self-test supported.
SMART capabilities:            (0x0003)	Saves SMART data before entering
					power-saving mode.
					Supports SMART auto save timer.
Error logging capability:        (0x01)	Error logging supported.
					General Purpose Logging supported.
Short self-test routine 
recommended polling time: 	 (   1) minutes.
Extended self-test routine
recommended polling time: 	 ( 176) minutes.
Conveyance self-test routine
recommended polling time: 	 (   2) minutes.
SCT capabilities: 	       (0x103f)	SCT Status supported.
					SCT Error Recovery Control supported.
					SCT Feature Control supported.
					SCT Data Table supported.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   104   099   006    Pre-fail  Always       -       7289736
  3 Spin_Up_Time            0x0003   096   095   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       142
  5 Reallocated_Sector_Ct   0x0033   100   100   036    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000f   064   060   030    Pre-fail  Always       -       3117785
  9 Power_On_Hours          0x0032   099   099   000    Old_age   Always       -       1096
 10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       71
183 Runtime_Bad_Block       0x0032   100   100   000    Old_age   Always       -       0
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
188 Command_Timeout         0x0032   100   100   000    Old_age   Always       -       0
189 High_Fly_Writes         0x003a   100   100   000    Old_age   Always       -       0
190 Airflow_Temperature_Cel 0x0022   063   048   045    Old_age   Always       -       37 (Min/Max 22/37)
194 Temperature_Celsius     0x0022   037   052   000    Old_age   Always       -       37 (0 21 0 0 0)
195 Hardware_ECC_Recovered  0x001a   016   011   000    Old_age   Always       -       7289736
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       9
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       38371237823724
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       1809558843
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       1320786376

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Extended offline    Completed without error       00%      1044         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.


ADA1
Code:
smartctl 5.43 2012-06-30 r3573 [FreeBSD 8.3-RELEASE-p4 amd64] (local build)
Copyright (C) 2002-12 by Bruce Allen, http://smartmontools.sourceforge.net

=== START OF INFORMATION SECTION ===
Model Family:     Seagate Barracuda LP
Device Model:     ST31000520AS
Firmware Version: CC32
User Capacity:    1,000,204,886,016 bytes [1.00 TB]
Sector Size:      512 bytes logical/physical
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   8
ATA Standard is:  ATA-8-ACS revision 4
Local Time is:    Tue Oct 16 14:19:13 2012 PDT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x82)	Offline data collection activity
					was completed without error.
					Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0)	The previous self-test routine completed
					without error or no self-test has ever 
					been run.
Total time to complete Offline 
data collection: 		(  623) seconds.
Offline data collection
capabilities: 			 (0x7b) SMART execute Offline immediate.
					Auto Offline data collection on/off support.
					Suspend Offline collection upon new
					command.
					Offline surface scan supported.
					Self-test supported.
					Conveyance Self-test supported.
					Selective Self-test supported.
SMART capabilities:            (0x0003)	Saves SMART data before entering
					power-saving mode.
					Supports SMART auto save timer.
Error logging capability:        (0x01)	Error logging supported.
					General Purpose Logging supported.
Short self-test routine 
recommended polling time: 	 (   1) minutes.
Extended self-test routine
recommended polling time: 	 ( 222) minutes.
Conveyance self-test routine
recommended polling time: 	 (   2) minutes.
SCT capabilities: 	       (0x103f)	SCT Status supported.
					SCT Error Recovery Control supported.
					SCT Feature Control supported.
					SCT Data Table supported.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   109   099   006    Pre-fail  Always       -       25005601
  3 Spin_Up_Time            0x0003   096   095   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       250
  5 Reallocated_Sector_Ct   0x0033   100   100   036    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000f   073   060   030    Pre-fail  Always       -       24943224
  9 Power_On_Hours          0x0032   091   091   000    Old_age   Always       -       8316
 10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       125
183 Runtime_Bad_Block       0x0032   099   099   000    Old_age   Always       -       1
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
188 Command_Timeout         0x0032   100   100   000    Old_age   Always       -       0
189 High_Fly_Writes         0x003a   100   100   000    Old_age   Always       -       0
190 Airflow_Temperature_Cel 0x0022   063   056   045    Old_age   Always       -       37 (Min/Max 24/37)
194 Temperature_Celsius     0x0022   037   044   000    Old_age   Always       -       37 (0 22 0 0 0)
195 Hardware_ECC_Recovered  0x001a   022   022   000    Old_age   Always       -       25005601
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x003e   200   199   000    Old_age   Always       -       30
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       218734094459264
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       355260543
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       218645175

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Extended offline    Completed without error       00%      8264         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.


ADA2
Code:
smartctl 5.43 2012-06-30 r3573 [FreeBSD 8.3-RELEASE-p4 amd64] (local build)
Copyright (C) 2002-12 by Bruce Allen, http://smartmontools.sourceforge.net

=== START OF INFORMATION SECTION ===
Model Family:     Seagate Barracuda (SATA 3Gb/s, 4K Sectors)
Device Model:     ST1000DM003-9YN162
Firmware Version: CC4B
User Capacity:    1,000,204,886,016 bytes [1.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   8
ATA Standard is:  ATA-8-ACS revision 4
Local Time is:    Tue Oct 16 14:19:55 2012 PDT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x82)	Offline data collection activity
					was completed without error.
					Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0)	The previous self-test routine completed
					without error or no self-test has ever 
					been run.
Total time to complete Offline 
data collection: 		(  575) seconds.
Offline data collection
capabilities: 			 (0x7b) SMART execute Offline immediate.
					Auto Offline data collection on/off support.
					Suspend Offline collection upon new
					command.
					Offline surface scan supported.
					Self-test supported.
					Conveyance Self-test supported.
					Selective Self-test supported.
SMART capabilities:            (0x0003)	Saves SMART data before entering
					power-saving mode.
					Supports SMART auto save timer.
Error logging capability:        (0x01)	Error logging supported.
					General Purpose Logging supported.
Short self-test routine 
recommended polling time: 	 (   1) minutes.
Extended self-test routine
recommended polling time: 	 ( 110) minutes.
Conveyance self-test routine
recommended polling time: 	 (   2) minutes.
SCT capabilities: 	       (0x3085)	SCT Status supported.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   113   099   006    Pre-fail  Always       -       53023288
  3 Spin_Up_Time            0x0003   097   096   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       53
  5 Reallocated_Sector_Ct   0x0033   100   100   036    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000f   069   060   030    Pre-fail  Always       -       7706616
  9 Power_On_Hours          0x0032   100   100   000    Old_age   Always       -       600
 10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       53
183 Runtime_Bad_Block       0x0032   100   100   000    Old_age   Always       -       0
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
188 Command_Timeout         0x0032   100   100   000    Old_age   Always       -       0
189 High_Fly_Writes         0x003a   100   100   000    Old_age   Always       -       0
190 Airflow_Temperature_Cel 0x0022   065   049   045    Old_age   Always       -       35 (Min/Max 23/35)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       30
193 Load_Cycle_Count        0x0032   099   099   000    Old_age   Always       -       2392
194 Temperature_Celsius     0x0022   035   051   000    Old_age   Always       -       35 (0 22 0 0 0)
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       0
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       215731912311223
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       319783093330
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       74702224323

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Extended offline    Completed without error       00%       550         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.


ADA3
Code:
smartctl 5.43 2012-06-30 r3573 [FreeBSD 8.3-RELEASE-p4 amd64] (local build)
Copyright (C) 2002-12 by Bruce Allen, http://smartmontools.sourceforge.net

=== START OF INFORMATION SECTION ===
Model Family:     Seagate Barracuda Green (Adv. Format)
Device Model:     ST1000DL002-9TT153
Firmware Version: CC32
User Capacity:    1,000,204,886,016 bytes [1.00 TB]
Sector Size:      512 bytes logical/physical
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   8
ATA Standard is:  ATA-8-ACS revision 4
Local Time is:    Tue Oct 16 14:20:32 2012 PDT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x82)	Offline data collection activity
					was completed without error.
					Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0)	The previous self-test routine completed
					without error or no self-test has ever 
					been run.
Total time to complete Offline 
data collection: 		(  623) seconds.
Offline data collection
capabilities: 			 (0x7b) SMART execute Offline immediate.
					Auto Offline data collection on/off support.
					Suspend Offline collection upon new
					command.
					Offline surface scan supported.
					Self-test supported.
					Conveyance Self-test supported.
					Selective Self-test supported.
SMART capabilities:            (0x0003)	Saves SMART data before entering
					power-saving mode.
					Supports SMART auto save timer.
Error logging capability:        (0x01)	Error logging supported.
					General Purpose Logging supported.
Short self-test routine 
recommended polling time: 	 (   1) minutes.
Extended self-test routine
recommended polling time: 	 ( 179) minutes.
Conveyance self-test routine
recommended polling time: 	 (   2) minutes.
SCT capabilities: 	       (0x30b7)	SCT Status supported.
					SCT Feature Control supported.
					SCT Data Table supported.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   108   099   006    Pre-fail  Always       -       16192904
  3 Spin_Up_Time            0x0003   093   092   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       609
  5 Reallocated_Sector_Ct   0x0033   100   100   036    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000f   067   060   030    Pre-fail  Always       -       6107173
  9 Power_On_Hours          0x0032   092   092   000    Old_age   Always       -       7391
 10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       597
183 Runtime_Bad_Block       0x0032   100   100   000    Old_age   Always       -       0
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
188 Command_Timeout         0x0032   100   099   000    Old_age   Always       -       4295032834
189 High_Fly_Writes         0x003a   100   100   000    Old_age   Always       -       0
190 Airflow_Temperature_Cel 0x0022   062   053   045    Old_age   Always       -       38 (Min/Max 24/38)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       78
193 Load_Cycle_Count        0x0032   100   100   000    Old_age   Always       -       613
194 Temperature_Celsius     0x0022   038   047   000    Old_age   Always       -       38 (0 13 0 0 0)
195 Hardware_ECC_Recovered  0x001a   012   005   000    Old_age   Always       -       16192904
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x003e   200   195   000    Old_age   Always       -       12
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       241132348906756
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       3043770790
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       1619330349

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Extended offline    Completed without error       00%      7339         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.
 
G

ghostlobster

Dabbler
Joined
Oct 10, 2012
Messages
36
OK...when I get bored, I'm dangerous. I shutdown and flipped the disks on ada0 and ada1 (ada0 is now ada1). I did a zpool import and it's now returning this:
Code:
   pool: RAID
     id: 10036866808421506734
  state: UNAVAIL
 status: The pool was last accessed by another system.
 action: The pool cannot be imported due to damaged devices or data.
   see: http://www.sun.com/msg/ZFS-8000-EY
 config:

	RAID                      UNAVAIL  insufficient replicas
	  raidz1-0                UNAVAIL  insufficient replicas
	    4140409436293275748   UNAVAIL  cannot open
	    13949890047348135266  UNAVAIL  cannot open
	    12864383027183141833  UNAVAIL  cannot open
	  14728624880139133829    UNAVAIL  cannot open


Weird! Is there any way to just tell it to rebuild whatever it uses to index the disks and grab whatever I can from these disks? Still, there is nothing in the /data/zfs directory.
 
paleoN

paleoN

Wizard
Joined
Apr 22, 2012
Messages
1,403
Since the disks names swapped, after a Factory Restore an updated:
Code:
zpool import

zdb -ll /dev/ada1p2
And stop swapping disks around. If you keep changing the disks then use a live CD/USB so you always start with a clean slate.

199 UDMA_CRC_Error_Count has increased on 3 of your drives. These indicate a hardware-level problem between the host controller and the controller chip on the drive. Look for common components, i.e. cables or the controller.
 
G

ghostlobster

Dabbler
Joined
Oct 10, 2012
Messages
36
zpool import output is above in my reply above yours.

zdb outputs here:
ADA0P2:
Code:
--------------------------------------------
LABEL 0
--------------------------------------------
    version: 28
    name: 'RAID'
    state: 0
    txg: 192838
    pool_guid: 10036866808421506734
    hostid: 1362761028
    hostname: 'freenas.local'
    top_guid: 11941661085329332228
    guid: 13949890047348135266
    vdev_children: 2
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 11941661085329332228
        nparity: 1
        metaslab_array: 23
        metaslab_shift: 31
        ashift: 9
        asize: 2994157387776
        is_log: 0
        children[0]:
            type: 'disk'
            id: 0
            guid: 4140409436293275748
            path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
            DTL: 54
        children[1]:
            type: 'disk'
            id: 1
            guid: 13949890047348135266
            path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
        children[2]:
            type: 'disk'
            id: 2
            guid: 12864383027183141833
            path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
--------------------------------------------
LABEL 1
--------------------------------------------
    version: 28
    name: 'RAID'
    state: 0
    txg: 192838
    pool_guid: 10036866808421506734
    hostid: 1362761028
    hostname: 'freenas.local'
    top_guid: 11941661085329332228
    guid: 13949890047348135266
    vdev_children: 2
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 11941661085329332228
        nparity: 1
        metaslab_array: 23
        metaslab_shift: 31
        ashift: 9
        asize: 2994157387776
        is_log: 0
        children[0]:
            type: 'disk'
            id: 0
            guid: 4140409436293275748
            path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
            DTL: 54
        children[1]:
            type: 'disk'
            id: 1
            guid: 13949890047348135266
            path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
        children[2]:
            type: 'disk'
            id: 2
            guid: 12864383027183141833
            path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
--------------------------------------------
LABEL 2
--------------------------------------------
    version: 28
    name: 'RAID'
    state: 0
    txg: 192838
    pool_guid: 10036866808421506734
    hostid: 1362761028
    hostname: 'freenas.local'
    top_guid: 11941661085329332228
    guid: 13949890047348135266
    vdev_children: 2
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 11941661085329332228
        nparity: 1
        metaslab_array: 23
        metaslab_shift: 31
        ashift: 9
        asize: 2994157387776
        is_log: 0
        children[0]:
            type: 'disk'
            id: 0
            guid: 4140409436293275748
            path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
            DTL: 54
        children[1]:
            type: 'disk'
            id: 1
            guid: 13949890047348135266
            path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
        children[2]:
            type: 'disk'
            id: 2
            guid: 12864383027183141833
            path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
--------------------------------------------
LABEL 3
--------------------------------------------
    version: 28
    name: 'RAID'
    state: 0
    txg: 192838
    pool_guid: 10036866808421506734
    hostid: 1362761028
    hostname: 'freenas.local'
    top_guid: 11941661085329332228
    guid: 13949890047348135266
    vdev_children: 2
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 11941661085329332228
        nparity: 1
        metaslab_array: 23
        metaslab_shift: 31
        ashift: 9
        asize: 2994157387776
        is_log: 0
        children[0]:
            type: 'disk'
            id: 0
            guid: 4140409436293275748
            path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
            DTL: 54
        children[1]:
            type: 'disk'
            id: 1
            guid: 13949890047348135266
            path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
        children[2]:
            type: 'disk'
            id: 2
            guid: 12864383027183141833
            path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0


ADA1P2 here...major issue here I think!
Code:
--------------------------------------------
LABEL 0
--------------------------------------------
    version: 28
    name: 'RAID'
    state: 0
    txg: 192838
    pool_guid: 10036866808421506734
    hostid: 1362761028
    hostname: 'freenas.local'
    top_guid: 14728624880139133829
    guid: 14728624880139133829
    vdev_children: 2
    vdev_tree:
        type: 'disk'
        id: 1
        guid: 14728624880139133829
        path: '/dev/gptid/29ace990-0420-11e2-ba6f-000acd1fbb8d'
        phys_path: '/dev/gptid/29ace990-0420-11e2-ba6f-000acd1fbb8d'
        whole_disk: 0
        metaslab_array: 742
        metaslab_shift: 30
        ashift: 9
        asize: 998052462592
        is_log: 0
--------------------------------------------
LABEL 1
--------------------------------------------
    version: 28
    name: 'RAID'
    state: 0
    txg: 192838
    pool_guid: 10036866808421506734
    hostid: 1362761028
    hostname: 'freenas.local'
    top_guid: 14728624880139133829
    guid: 14728624880139133829
    vdev_children: 2
    vdev_tree:
        type: 'disk'
        id: 1
        guid: 14728624880139133829
        path: '/dev/gptid/29ace990-0420-11e2-ba6f-000acd1fbb8d'
        phys_path: '/dev/gptid/29ace990-0420-11e2-ba6f-000acd1fbb8d'
        whole_disk: 0
        metaslab_array: 742
        metaslab_shift: 30
        ashift: 9
        asize: 998052462592
        is_log: 0
--------------------------------------------
LABEL 2
--------------------------------------------
failed to unpack label 2
--------------------------------------------
LABEL 3
--------------------------------------------
failed to unpack label 3


ADA2P2
Code:
--------------------------------------------
LABEL 0
--------------------------------------------
    version: 28
    name: 'RAID'
    state: 0
    txg: 192838
    pool_guid: 10036866808421506734
    hostid: 1362761028
    hostname: 'freenas.local'
    top_guid: 11941661085329332228
    guid: 12864383027183141833
    vdev_children: 2
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 11941661085329332228
        nparity: 1
        metaslab_array: 23
        metaslab_shift: 31
        ashift: 9
        asize: 2994157387776
        is_log: 0
        children[0]:
            type: 'disk'
            id: 0
            guid: 4140409436293275748
            path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
            DTL: 54
        children[1]:
            type: 'disk'
            id: 1
            guid: 13949890047348135266
            path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
        children[2]:
            type: 'disk'
            id: 2
            guid: 12864383027183141833
            path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
--------------------------------------------
LABEL 1
--------------------------------------------
    version: 28
    name: 'RAID'
    state: 0
    txg: 192838
    pool_guid: 10036866808421506734
    hostid: 1362761028
    hostname: 'freenas.local'
    top_guid: 11941661085329332228
    guid: 12864383027183141833
    vdev_children: 2
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 11941661085329332228
        nparity: 1
        metaslab_array: 23
        metaslab_shift: 31
        ashift: 9
        asize: 2994157387776
        is_log: 0
        children[0]:
            type: 'disk'
            id: 0
            guid: 4140409436293275748
            path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
            DTL: 54
        children[1]:
            type: 'disk'
            id: 1
            guid: 13949890047348135266
            path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
        children[2]:
            type: 'disk'
            id: 2
            guid: 12864383027183141833
            path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
--------------------------------------------
LABEL 2
--------------------------------------------
    version: 28
    name: 'RAID'
    state: 0
    txg: 192838
    pool_guid: 10036866808421506734
    hostid: 1362761028
    hostname: 'freenas.local'
    top_guid: 11941661085329332228
    guid: 12864383027183141833
    vdev_children: 2
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 11941661085329332228
        nparity: 1
        metaslab_array: 23
        metaslab_shift: 31
        ashift: 9
        asize: 2994157387776
        is_log: 0
        children[0]:
            type: 'disk'
            id: 0
            guid: 4140409436293275748
            path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
            DTL: 54
        children[1]:
            type: 'disk'
            id: 1
            guid: 13949890047348135266
            path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
        children[2]:
            type: 'disk'
            id: 2
            guid: 12864383027183141833
            path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
--------------------------------------------
LABEL 3
--------------------------------------------
    version: 28
    name: 'RAID'
    state: 0
    txg: 192838
    pool_guid: 10036866808421506734
    hostid: 1362761028
    hostname: 'freenas.local'
    top_guid: 11941661085329332228
    guid: 12864383027183141833
    vdev_children: 2
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 11941661085329332228
        nparity: 1
        metaslab_array: 23
        metaslab_shift: 31
        ashift: 9
        asize: 2994157387776
        is_log: 0
        children[0]:
            type: 'disk'
            id: 0
            guid: 4140409436293275748
            path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
            DTL: 54
        children[1]:
            type: 'disk'
            id: 1
            guid: 13949890047348135266
            path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
        children[2]:
            type: 'disk'
            id: 2
            guid: 12864383027183141833
            path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0


ADA3P2
Code:
--------------------------------------------
LABEL 0
--------------------------------------------
    version: 28
    name: 'RAID'
    state: 0
    txg: 192838
    pool_guid: 10036866808421506734
    hostid: 1362761028
    hostname: 'freenas.local'
    top_guid: 11941661085329332228
    guid: 4140409436293275748
    vdev_children: 2
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 11941661085329332228
        nparity: 1
        metaslab_array: 23
        metaslab_shift: 31
        ashift: 9
        asize: 2994157387776
        is_log: 0
        children[0]:
            type: 'disk'
            id: 0
            guid: 4140409436293275748
            path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
            DTL: 54
        children[1]:
            type: 'disk'
            id: 1
            guid: 13949890047348135266
            path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
        children[2]:
            type: 'disk'
            id: 2
            guid: 12864383027183141833
            path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
--------------------------------------------
LABEL 1
--------------------------------------------
    version: 28
    name: 'RAID'
    state: 0
    txg: 192838
    pool_guid: 10036866808421506734
    hostid: 1362761028
    hostname: 'freenas.local'
    top_guid: 11941661085329332228
    guid: 4140409436293275748
    vdev_children: 2
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 11941661085329332228
        nparity: 1
        metaslab_array: 23
        metaslab_shift: 31
        ashift: 9
        asize: 2994157387776
        is_log: 0
        children[0]:
            type: 'disk'
            id: 0
            guid: 4140409436293275748
            path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
            DTL: 54
        children[1]:
            type: 'disk'
            id: 1
            guid: 13949890047348135266
            path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
        children[2]:
            type: 'disk'
            id: 2
            guid: 12864383027183141833
            path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
--------------------------------------------
LABEL 2
--------------------------------------------
    version: 28
    name: 'RAID'
    state: 0
    txg: 192838
    pool_guid: 10036866808421506734
    hostid: 1362761028
    hostname: 'freenas.local'
    top_guid: 11941661085329332228
    guid: 4140409436293275748
    vdev_children: 2
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 11941661085329332228
        nparity: 1
        metaslab_array: 23
        metaslab_shift: 31
        ashift: 9
        asize: 2994157387776
        is_log: 0
        children[0]:
            type: 'disk'
            id: 0
            guid: 4140409436293275748
            path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
            DTL: 54
        children[1]:
            type: 'disk'
            id: 1
            guid: 13949890047348135266
            path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
        children[2]:
            type: 'disk'
            id: 2
            guid: 12864383027183141833
            path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
--------------------------------------------
LABEL 3
--------------------------------------------
    version: 28
    name: 'RAID'
    state: 0
    txg: 192838
    pool_guid: 10036866808421506734
    hostid: 1362761028
    hostname: 'freenas.local'
    top_guid: 11941661085329332228
    guid: 4140409436293275748
    vdev_children: 2
    vdev_tree:
        type: 'raidz'
        id: 0
        guid: 11941661085329332228
        nparity: 1
        metaslab_array: 23
        metaslab_shift: 31
        ashift: 9
        asize: 2994157387776
        is_log: 0
        children[0]:
            type: 'disk'
            id: 0
            guid: 4140409436293275748
            path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/32ea520c-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
            DTL: 54
        children[1]:
            type: 'disk'
            id: 1
            guid: 13949890047348135266
            path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/35b37ca9-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0
        children[2]:
            type: 'disk'
            id: 2
            guid: 12864383027183141833
            path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'
            phys_path: '/dev/gptid/36a53dae-031e-11e2-b182-000acd1fbb8d'
            whole_disk: 0


I have another 1TB drive here...brand new. Would it be beneficial to do a complete copy of ADA2, using a raw copy utility?
 
G

ghostlobster

Dabbler
Joined
Oct 10, 2012
Messages
36
Sorry about complicvating things by swapping around, as well. I actually pulled the entire drive rack from this system and slapped it into another one just to see if the damn thing would import on another box with another controller, processor, RAM, cables and everything. No dice.
That was when I installed RC1 on a USB stick and put them back in the other system.
I'll leave them alone in that box until it's time to throw up the hands and just wipe is and rebuild the box, saying goodbye to the data...I am just realloy hoping that there is someway to retrieve at least some of the data here, though.
 
G

ghostlobster

Dabbler
Joined
Oct 10, 2012
Messages
36
Well...another interesting tidbit here. I booted from a FreeBSD 9 CD, and did a zpool import -FXfn RAID on it, just to see what it would return. The -n option tells it to just see if it'll work, without making any real changes., This test returned the following:
Would be able to return RAID to its state as of Friday October 12th (timestamp of around noonish). Woul discard appromimately 5 seconds of transactions.

Thoughts?
If I run that command and then form within that FreeBSD boot, do a zpool export RAID , would I then be able to import it to the FreeNAS setup and snag some of my data back?
 
paleoN

paleoN

Wizard
Joined
Apr 22, 2012
Messages
1,403
ghostlobster said:
zpool import output is above in my reply above yours.
Click to expand...
paleoN said:
Since the disks names swapped, after a Factory Restore an updated:
Click to expand...

ghostlobster said:
I have another 1TB drive here...brand new. Would it be beneficial to do a complete copy of ADA2, using a raw copy utility?
Click to expand...
I don't think it will help anything. The drive itself appears OK, aside from the CRC errors. Which given they are happening to 2 other drives as well suggests faulty cables, faulty SATA ports or dusty ones, faulty controller or even faulty PSU.
 
paleoN

paleoN

Wizard
Joined
Apr 22, 2012
Messages
1,403
ghostlobster said:
Thoughts?
If I run that command and then form within that FreeBSD boot, do a zpool export RAID , would I then be able to import it to the FreeNAS setup and snag some of my data back?
Click to expand...
I would try without the X to begin with & read only:
Code:
zpool import -fF -R /mnt -o rdonly=on RAID
I would also use different SATA cables before hand.
 
Status
Not open for further replies.

Similar threads

A
  • Locked
Lost boot device, after new install, zfs pool gone
Replies
5
Views
2K
SweetAndLow
SweetAndLow
T
  • Locked
ZPOOL degraded, hdd failed and so did my attempt to replace
Replies
3
Views
2K
paleoN
paleoN
L
  • Locked
Issues with two drives, looking for some help.
Replies
8
Views
1K
lpittman
L
J
  • Locked
Incorrect Volume/Dataset sizes reported.
Replies
2
Views
2K
jim82
J
R
  • Locked
Possible Bad Drive?
Replies
13
Views
3K
lpittman
L
Top