No space left on device

[sdspieg]

I installed Freenas without any difficulties, and then started copying files from various HDDs to my Storage (which has 2x3TB drives and onex1TB)

I boot Freenas from a USB-stick, and this is what my HDDs look like now in csh:

Code:

=>        34  5860533101  ada0  GPT  (2.7T)                                     
          34          94        - free -  (47k)                                 
         128     4194304     1  freebsd-swap  (2.0G)                            
     4194432  5856338696     2  freebsd-zfs  (2.7T)                             
  5860533128           7        - free -  (3.5k)  

=>       34  976773101  ada1  GPT  (465G)                                       
         34         94        - free -  (47k)                                   
        128    4194304     1  freebsd-swap  (2.0G)                              
    4194432  972578703     2  freebsd-zfs  (463G)                               
                                                                                
=>        34  5860533101  ada2  GPT  (2.7T)                                     
          34          94        - free -  (47k)                                 
         128     4194304     1  freebsd-swap  (2.0G)                            
     4194432  5856338696     2  freebsd-zfs  (2.7T)                             
  5860533128           7        - free -  (3.5k)                                
                                                                                
=>     63  3911553  da0  MBR  (1.9G)                                            
       63  1930257    1  freebsd  [active]  (942M)                              
  1930320       63       - free -  (31k)                                        
  1930383  1930257    2  freebsd  (942M)                                        
  3860640     3024    3  freebsd  (1.5M)                                        
  3863664    41328    4  freebsd  (20M)                                         
  3904992     6624       - free -  (3.2M)                                       
                                                                                
=>      0  1930257  da0s1  BSD  (942M)                                          
        0       16         - free -  (8.0k)                                     
       16  1930241      1  !0  (942M)    

And this is what's on it:

Code:

/dev/md0                        9327       9140   -559   107%    /etc           
/dev/md1                        1647          4   1512     0%    /mnt           
/dev/md2                      305583      37332 243805    13%    /var           
/dev/ufs/FreeNASs4             40527       2045  35240     5%    /data          
FreeNAS                           93         93      0   100%    /mnt/FreeNAS   
FreeNAS/Audio                     79         79      0   100%    /mnt/FreeNAS/Au
dio                                                                             
FreeNAS/Video             1589098058 1589098058      0   100%    /mnt/FreeNAS/Vi
deo                                                                             
FreeNAS/jail                  923150     923150      0   100%    /mnt/FreeNAS/ja
il                                                                              
FreeNAS/software           312849160  312849160      0   100%    /mnt/FreeNAS/so
ftware                                                                          
/mnt/FreeNAS/software      312849160  312849160      0   100%    /mnt/FreeNAS/ja
il/software/mnt/plugins                                                         
/mnt/FreeNAS/software/pbi  312849160  312849160      0   100%    /mnt/FreeNAS/ja
il/software/usr/pbi                                                             
/mnt/FreeNAS/Video        1589098058 1589098058      0   100%    /mnt/FreeNAS/ja
il/software/media                                                               
devfs                              2          2      0   100%    /mnt/FreeNAS/ja
il/software/dev                                                                 
procfs                             8          8      0   100%    /mnt/FreeNAS/ja
il/software/proc            

Can anybody help me in solving this problem? Thanks!

-Stephan

 

[William Grzybowski]

Your pool is full, thats it! What do you want us to do!?

Paste:

# zfs list
# zpool status

 

[sdspieg]

William,

Thanks. It's just that I don't understand why it would be. As you could tell from what I sent you, I don't even use on tera. And I have 6.5, which I guess should still end up giving me 3, no? Here is what you asked:

Code:

[root@freenas] ~# zfs list                                                      
NAME               USED  AVAIL  REFER  MOUNTPOINT                               
FreeNAS            907G      0  46.6K  /mnt/FreeNAS                             
FreeNAS/Audio     40.0K      0  40.0K  /mnt/FreeNAS/Audio                       
FreeNAS/Video      758G      0   758G  /mnt/FreeNAS/Video                       
FreeNAS/jail       451M      0   451M  /mnt/FreeNAS/jail                        
FreeNAS/software   149G      0   149G  /mnt/FreeNAS/software                    
[root@freenas] ~# zpool status                                                  
  pool: FreeNAS                                                                 
 state: ONLINE                                                                  
  scan: none requested                                                          
config:                                                                         
                                                                                
        NAME        STATE     READ WRITE CKSUM                                  
        FreeNAS     ONLINE       0     0     0                                  
          raidz1-0  ONLINE       0     0     0                                  
            ada1p2  ONLINE       0     0     0                                  
            ada0p2  ONLINE       0     0     0                                  
            ada2p2  ONLINE       0     0     0                                  
                                                                                
errors: No known data errors         

Thanks for the help,

-Stephan

 

[William Grzybowski]

Hi,

Please paste:

# zpool list
# zfs list -t snapshot

 

[William Grzybowski]

You're mixing a 1tb drive in the raidz, that means it is like all of the three disks had 1tb... Thats how parity works in ZFS, it will take into account the smallest drive in the array.
So in reality you should have about 1.8TiB of available space. (3-1)x1TB = 2TB ~= 1.8TiB

 

[sdspieg]

Thanks WIlliam. And hmmm...

Code:

[root@freenas] ~# zfs list -t snapshot                                          
no datasets available     

This despite the fact that I DO have datasets, as you could see in the first lists I posted. Any ideas?
Also - what would your recommendation be for storage configuration? And is there any way I could change it without losing everything? Thanks!

-Stephan

 

[William Grzybowski]

You forgot # zpool list, its different from # zfs list

You could just replace the 1tb by one of 3tb in the future and the pool would grow...

 

[sdspieg]

My apologies:

Code:

[root@freenas] ~# zpool list                                                    
NAME      SIZE  ALLOC   FREE    CAP  DEDUP  HEALTH  ALTROOT                     
FreeNAS  1.35T  1.33T  21.6G    98%  1.00x  ONLINE  /mnt  

 

[sdspieg]

You could just replace the 1tb by one of 3tb in the future and the pool would grow...

But so if I took out the 1tb, I'd actually have more than 2 times the amount of space available, is that correct (if I chose mirror)? And is there a non-destructive way of reconfiguring everything?

 

[William Grzybowski]

But so if I took out the 1tb, I'd actually have more than 2 times the amount of space available, is that correct (if I chose mirror)? And is there a non-destructive way of reconfiguring everything?

Correct. But no, you cant reconfigure without destroying data, you'd be better off replacing it with another 3TB disk...

But actually I just paid attention to your gpart show output, it is not 1TB, it is 500GB disk, thats why you're _so_ slow in disk space... (1.35TiB)