Bogus "out of space" when creating snapshot

[Jimm Chen]

I'm using FreeNAS-9.3-STABLE-201506042008, now facing a problem.

When trying to take snapshot, I got error "out of space" and no snapshot is created. But I have plenty of spaces availalbe. Why could this happen?

Code:

[root @freenas_r730 (2015-10-12 20:07:56) ~]
$ zpool status zpool_r730xd
  pool: zpool_r730xd
state: ONLINE
status: One or more devices is currently being resilvered.  The pool will
        continue to function, possibly in a degraded state.
action: Wait for the resilver to complete.
  scan: resilver in progress since Mon Oct 12 10:51:26 2015
        357G scanned out of 1.38T at 10.9M/s, 27h31m to go
        346G resilvered, 25.22% done
config:

        NAME                                              STATE     READ WRITE CKSUM
        zpool_r730xd                                      ONLINE       0     0     0
          mirror-0                                        ONLINE       0     0     0
            replacing-0                                   ONLINE       0     0     0
              gptid/26902c5b-6ef0-11e5-ba04-c81f66f25883  ONLINE       0     0     0
              gptid/20c08aef-708c-11e5-a1d5-c81f66f25883  ONLINE       0     0     0  (resilvering)
            gptid/143260d8-43f4-11e5-b9b4-000c2904df5a    ONLINE       0     0     0
          mirror-2                                        ONLINE       0     0     0
            gptid/1f1dadae-5e04-11e5-9a3a-c81f66f25883    ONLINE       0     0     0
            gptid/1f635e3d-5e04-11e5-9a3a-c81f66f25883    ONLINE       0     0     0
        logs
          mirror-1                                        ONLINE       0     0     0
            gptid/fbbdf391-269e-11e5-a111-000c2904df5a    ONLINE       0     0     0
            gptid/fc26e779-269e-11e5-a111-000c2904df5a    ONLINE       0     0     0
        cache
          gptid/322cdc11-581d-11e5-86ca-c81f66f25883      ONLINE       0     0     0

errors: No known data errors

BTW: In this forum, how can I insert pre-formatted text(HTML <pre>) so that pasting text from FreeNAS shell preserve its format?

--tried the [ code ] BBtag, look OK now in Chrome v43.

 

[danb35]

BTW: In this forum, how can I insert pre-formatted text(HTML <pre>) so that pasting text from FreeNAS shell preserve its format?

Use code tags. You can enter them manually by putting [ code ] (without the spaces) in front of the text, and [ /code ] (again, without the spaces) after it. Or, using the advanced editor (click the More Options... button below the reply box), click Insert, then Code.

 

[Bidule0hm]

BTW: In this forum, how can I insert pre-formatted text(HTML <pre>) so that pasting text from FreeNAS shell preserve its format?

Use the bbcode code tag: [c0de]

Edit: ah, Danb35 was faster.

 

[cyberjock]

Uh, that's not necessarily bogus. You have a quota or reservation somewhere? It is totally possible to have a zpool that is effectively 100% empty by visual identification, but when you try to create a dataset, zvol, snapshot, etc you get a "disk full" message. ;)

 

[Scharbag]

Yeah, check your quotas on the drives. I ran into this a while back too.

Cheers,

 

[Jimm Chen]

Back to reply my thread after some busy days.

I remember I did not carry out any quota related operation. FreeNAS webui does not provide an interface for us to set a quota on a zvol, right?

To confirm, I check with zfs get quota .

Code:

[root @freenas_r730 (2015-10-16 14:58:41) ~]
$ zfs get quota
NAME                                                           PROPERTY  VALUE  SOURCE
freenas-boot                                                   quota     none   default
freenas-boot/ROOT                                              quota     none   default
freenas-boot/ROOT/Initial-Install                              quota     none   default
freenas-boot/ROOT/default                                      quota     none   default
freenas-boot/ROOT/default@2015-07-12-21:03:11                  quota     -      -
freenas-boot/grub                                              quota     none   default
zpool_r730xd                                                   quota     none   default
zpool_r730xd/.system                                           quota     none   default
zpool_r730xd/.system/configs-903a2a7d45924e86a448cccd86aa67c2  quota     none   default
zpool_r730xd/.system/cores                                     quota     none   default
zpool_r730xd/.system/rrd-903a2a7d45924e86a448cccd86aa67c2      quota     none   default
zpool_r730xd/.system/samba4                                    quota     none   default
zpool_r730xd/.system/syslog-903a2a7d45924e86a448cccd86aa67c2   quota     none   default
zpool_r730xd/zvol1                                             quota     -      -
zpool_r730xd/zvol_small_2GB                                    quota     -      -

--no quota is set, is it?

Code:

[root @freenas_r730 (2015-10-16 15:13:00) ~]
$ zpool list
NAME           SIZE  ALLOC   FREE  EXPANDSZ   FRAG    CAP  DEDUP  HEALTH  ALTROOT
freenas-boot  14.5G   526M  14.0G         -      -     3%  1.00x  ONLINE  -
zpool_r730xd  4.53T  1.59T  2.95T         -    11%    34%  1.00x  ONLINE  /mnt

[root @freenas_r730 (2015-10-16 15:22:07) ~]
$ zfs list
NAME                                                            USED  AVAIL  REFER  MOUNTPOINT
freenas-boot                                                    525M  13.5G    31K  none
freenas-boot/ROOT                                               518M  13.5G    25K  none
freenas-boot/ROOT/Initial-Install                                 1K  13.5G   508M  legacy
freenas-boot/ROOT/default                                       518M  13.5G   511M  legacy
freenas-boot/grub                                              6.79M  13.5G  6.79M  legacy
zpool_r730xd                                                   3.63T   779G    96K  /mnt/zpool_r730xd
zpool_r730xd/.system                                           2.25M   779G   104K  legacy
zpool_r730xd/.system/configs-903a2a7d45924e86a448cccd86aa67c2    96K   779G    96K  legacy
zpool_r730xd/.system/cores                                      860K   779G   860K  legacy
zpool_r730xd/.system/rrd-903a2a7d45924e86a448cccd86aa67c2        96K   779G    96K  legacy
zpool_r730xd/.system/samba4                                     152K   779G   152K  legacy
zpool_r730xd/.system/syslog-903a2a7d45924e86a448cccd86aa67c2   1000K   779G  1000K  legacy
zpool_r730xd/zvol1                                             3.63T  2.80T  1.58T  -
zpool_r730xd/zvol_small_2GB                                    2.06G   780G  1.23G  -

This FreeNAS server is considered in production in my company; some guys doing Android development with it on Ubuntu virtual machines running on top of VMware ESXi.

Please help further explain it, or anything more I should check?

 

[cyberjock]

zvols have no quota since you set the zvol size at zvol creation. It's size is not fluid since it is block storage.

Can you post a debug? System -> Advanced -> Save Debug.

I have no doubt this is some form of user-error, there's just a bajillion ways to get it wrong and I don't want to go down the decision tree on what you did wrong or don't understand. :P

 

[Jimm Chen]

The saved debug is huge, 1.5MB after zip, consisting many discrete files. Shall I post it here all, or only some key file is relevant?