Dataset's refer is empty

[John Doe]

When I run

Code:

zfs list -r

I get:

Code:

raid/files  124G  2.10T  96K  /mnt/raid/files

How can a dataset of 124GB refer to 96K?

The probable cause:
Before having this dataset I had a folder on the same path called files.
Later I moved the folder to files2 and created a dataset called files.
I then migrated the date from files2 to files with rsync and deleted files2.
Now it's like I have a ghost. It seems like it's pointing to files2 somehow.

The main issue is that I can't create snapshoots. All snapshoots created are empty (96K).
Any ideas?

 

[titan_rw]

Code:

zfs get usedbysnapshosts raid/files

I assume the 'live' copy got deleted from this dataset, and it's snapshots holding on to the data.

Can't be sure if you have the data elsewhere at this point without more info.

 

[John Doe]

Running your command I get:

Code:

NAME  PROPERTY  VALUE  SOURCE
raid/files  usedbysnapshots  64K  -

It doesn't seem to be held by old snapshots.
Moreover, before I had this dataset I was snapshoting raid instead of individual datasets...

What other information can I give you?

 

[titan_rw]

I assume it's another dataset using the space.

Can you list the full contents of:

Code:

zfs list -r
zfs list -r -t snapshot

 

[John Doe]

Before I had the separated dataset, I used to snapshot entire raid volume.

Code:

[root@freenas] /mnt/raid# zfs list -r
NAME                                                      USED  AVAIL  REFER  MOUNTPOINT
freenas-boot                                             3.40G  3.80G    31K  none
freenas-boot/ROOT                                        3.36G  3.80G    31K  none
freenas-boot/ROOT/FreeNAS-9.3-STABLE-201503071634        3.81M  3.80G   918M  /
freenas-boot/ROOT/FreeNAS-9.3-STABLE-201506292332        14.3M  3.80G  1011M  /
freenas-boot/ROOT/FreeNAS-9.3-STABLE-201511040813        16.3M  3.80G  1.02G  /
freenas-boot/ROOT/FreeNAS-9.3-STABLE-201602031011        3.32G  3.80G  1.02G  /
freenas-boot/ROOT/default                                3.43M  3.80G   918M  legacy
freenas-boot/grub                                        41.3M  3.80G  11.2M  legacy
raid                                                     2.17T  3.10T  53.5M  /mnt/raid
raid/.system                                              224M  3.10T   152K  legacy
raid/.system/configs-2dc45e4232454dfe9b2f92c180720729    41.1M  3.10T  41.1M  legacy
raid/.system/cores                                       44.3M  3.10T  44.3M  legacy
raid/.system/rrd-2dc45e4232454dfe9b2f92c180720729         144K  3.10T   144K  legacy
raid/.system/samba4                                      18.9M  3.10T  18.9M  legacy
raid/.system/syslog-2dc45e4232454dfe9b2f92c180720729      120M  3.10T   120M  legacy
raid/backups                                             1.24T  3.10T   609G  /mnt/raid/backups
raid/files                                                124G  3.10T    96K  /mnt/raid/files
raid/jails                                                 96K  3.10T    96K  /mnt/raid/jails

[root@freenas] /mnt/raid# zfs list -r -t snapshot
NAME                                                                    USED  AVAIL  REFER  MOUNTPOINT
freenas-boot/ROOT/FreeNAS-9.3-STABLE-201602031011@2015-03-08-01:24:40  13.9M      -   918M  -
freenas-boot/ROOT/FreeNAS-9.3-STABLE-201602031011@2015-07-30-00:17:25  14.2M      -   918M  -
freenas-boot/ROOT/FreeNAS-9.3-STABLE-201602031011@2015-11-09-23:54:21  1010M      -  1011M  -
freenas-boot/ROOT/FreeNAS-9.3-STABLE-201602031011@2016-02-11-05:31:30   412M      -  1.02G  -
freenas-boot/grub@Pre-Upgrade-FreeNAS-9.3-STABLE-201503071634            42K      -  7.77M  -
freenas-boot/grub@Pre-Upgrade-FreeNAS-9.3-STABLE-201506292332          46.5K      -  7.78M  -
freenas-boot/grub@Pre-Upgrade-FreeNAS-9.3-STABLE-201511040813          11.2M      -  11.2M  -
freenas-boot/grub@Pre-Upgrade-FreeNAS-9.3-STABLE-201602031011          11.2M      -  11.2M  -
raid@auto-20160217.1230-2w                                              306M      -   233G  -
raid@auto-20160217.1430-2w                                              318M      -   233G  -
raid@auto-20160217.1630-2w                                              208M      -   233G  -
raid@auto-20160217.1830-2w                                                 0      -   233G  -
raid@auto-20160217.2030-2w                                                 0      -   233G  -
raid@auto-20160218.0630-2w                                             1.03G      -  27.8G  -
raid@auto-20160218.0830-2w                                                 0      -  53.5M  -
raid@auto-20160218.1030-2w                                                 0      -  53.5M  -
raid@auto-20160218.1230-2w                                                 0      -  53.5M  -
raid@auto-20160218.1430-2w                                                 0      -  53.5M  -
raid@auto-20160218.1630-2w                                                 0      -  53.5M  -
raid@auto-20160218.1830-2w                                                 0      -  53.5M  -
raid@auto-20160218.2030-2w                                                 0      -  53.5M  -
raid@auto-20160219.0630-2w                                                 0      -  53.5M  -
raid@auto-20160219.0830-2w                                                 0      -  53.5M  -
raid@auto-20160219.1030-2w                                                 0      -  53.5M  -
raid@auto-20160219.1230-2w                                                 0      -  53.5M  -
raid/backups@auto-20160221.2300-1w                                     2.53M      -   604G  -
raid/backups@auto-20160222.2300-1w                                     2.46M      -   600G  -
raid/backups@auto-20160223.2300-1w                                     2.36M      -   606G  -
raid/files@auto-20160223.0900-3m                                           0      -    96K  -
raid/files@auto-20160223.1000-3m                                           0      -    96K  -
raid/files@auto-20160223.1100-3m                                           0      -    96K  -
raid/files@auto-20160223.1200-3m                                           0      -    96K  -
raid/files@auto-20160223.1300-3m                                           0      -    96K  -
raid/files@auto-20160223.1400-3m                                           0      -    96K  -
raid/files@auto-20160223.1500-3m                                           0      -    96K  -
raid/files@auto-20160223.1600-3m                                           0      -    96K  -
raid/files@auto-20160223.1700-3m                                           0      -    96K  -
raid/files@auto-20160223.1800-3m                                           0      -    96K  -
raid/files@auto-20160224.0900-3m                                           0      -    96K  -
raid/files@auto-20160224.1000-3m                                           0      -    96K  -

 

[titan_rw]

Sorry, I've been busy at work.

It looks like around 233 gigs was deleted from the root dataset between the 17th and 18th.

I don't see what would be taking the space of raid/files. Maybe a reservation?

Can you post "zfs get all raid/files"

 

[John Doe]

Not really deleted. The data was moved to raid/files.

Code:

[root@freenas] ~# zfs get all raid/files
NAME             PROPERTY              VALUE                  SOURCE
raid/files  type                  filesystem             -
raid/files  creation              Thu Feb 11  6:29 2016  -
raid/files  used                  123G                   -
raid/files  available             3.09T                  -
raid/files  referenced            96K                    -
raid/files  compressratio         1.39x                  -
raid/files  mounted               yes                    -
raid/files  quota                 none                   default
raid/files  reservation           none                   default
raid/files  recordsize            128K                   default
raid/files  mountpoint            /mnt/raid/files        default
raid/files  sharenfs              off                    default
raid/files  checksum              on                     default
raid/files  compression           off                    default
raid/files  atime                 on                     default
raid/files  devices               on                     default
raid/files  exec                  on                     default
raid/files  setuid                on                     default
raid/files  readonly              off                    default
raid/files  jailed                off                    default
raid/files  snapdir               hidden                 default
raid/files  aclmode               passthrough            inherited from raid
raid/files  aclinherit            passthrough            inherited from raid
raid/files  canmount              on                     default
raid/files  xattr                 off                    temporary
raid/files  copies                1                      default
raid/files  version               5                      -
raid/files  utf8only              off                    -
raid/files  normalization         none                   -
raid/files  casesensitivity       sensitive              -
raid/files  vscan                 off                    default
raid/files  nbmand                off                    default
raid/files  sharesmb              off                    default
raid/files  refquota              none                   default
raid/files  refreservation        none                   default
raid/files  primarycache          all                    default
raid/files  secondarycache        all                    default
raid/files  usedbysnapshots       64K                    -
raid/files  usedbydataset         96K                    -
raid/files  usedbychildren        123G                   -
raid/files  usedbyrefreservation  0                      -
raid/files  logbias               latency                default
raid/files  dedup                 off                    default
raid/files  mlslabel                                     -
raid/files  sync                  standard               default
raid/files  refcompressratio      1.00x                  -
raid/files  written               0                      -
raid/files  logicalused           168G                   -
raid/files  logicalreferenced     9.50K                  -
raid/files  volmode               default                default
raid/files  filesystem_limit      none                   default
raid/files  snapshot_limit        none                   default
raid/files  filesystem_count      none                   default
raid/files  snapshot_count        none                   default
raid/files  redundant_metadata    all                    default

 

[titan_rw]

Code:

raid/files  usedbychildren        123G

I don't know. It's saying that children of raid/files is 123G, but I don't see any children datasets. Usedbysnapshots is virtually 0. Actual data stored was 168G, compressed at 1.39:1 down to 123G.

If anybody else knows, feel free to chime in.

 

[Fei]

Hi,

Can you provide zpool history ?