Datasets don't show up under 'pools' after upgrade.

Stoffern · Sep 6, 2021

Hello!

I recently upgraded my server (both hardware, then from FreeNAS to the latest TrueNAS).

After the upgrade, things worked for a bit. I got Plex up and running and I could watch my movies and so on. Though when I went to access the SMB share, everything went south. Now my Plex can't find any media anymore, and I can't access any shares or get anything working.

When I go to SMB shares to add a new share (I unshared everything to start from scratch again) I do see my "Media" folders in both my pools, and the movies and so on that go along with them. So they are clearly there. But from what I understand, I need to edit ACL permissions from the pools section and datasets. The issue is that I don't see any of my datasets there, and I have no idea how to recover them.

As seen in the pictures above, I can't add a dataset called "Media" as it already exists, however, I can't find it under my pools. I can create new ones with different names, and they do show up.

I am completely lost, as I'm quite scared of losing all my data and don't want to do anything wrong that could result in such a disaster. I'm fairly certain that the problem here exists between the chair and keyboard, and googling hasn't gotten me far, seeing as I'm not even sure what to google for.

If anyone can help me out, I would greatly appreciate it!!

winnielinnie · Sep 6, 2021

Looks like you have residual "phantom" folders.

What is the output of the following (filter/hide any sensitive names or information):

This might output too much, but under the assumption nothing is properly mounted, you'll only see a bunch of empty folders.
ls -lR /mnt/Mirror14TB/

You can see what ZFS datasets are currently mounted.
zfs mount

And any legacy mount points.
mount

To check all datasets that exist under Mirror14TB.
zfs list -r Mirror14TB

Stoffern · Sep 7, 2021

winnielinnie said:
Looks like you have residual "phantom" folders.

What is the output of the following (filter/hide any sensitive names or information):

This might output too much, but under the assumption nothing is properly mounted, you'll only see a bunch of empty folders.
ls -lR /mnt/Mirror14TB/

You can see what ZFS datasets are currently mounted.
zfs mount

And any legacy mount points.
mount

To check all datasets that exist under Mirror14TB.
zfs list -r Mirror14TB

The first command did indeed output too much. It simply output all of my movie folders:
/mnt/Mirror14TB/Media/Movies/MovieX
/mnt/Mirror14TB/Media/Movies/MovieY
/mnt/Mirror14TB/Media/Movies/MovieZ

The second command shows more or less the same as I see under the "Pools" GUI section, just iocage and .system folders and etc.

Code:

root@freenas[~]# zfs mount
boot-pool/ROOT/default          /
Mirror14TB                      /mnt/Mirror14TB
Mirror4TB                       /mnt/Mirror4TB
Mirror4TB/.system               /mnt/Mirror4TB/.system
Mirror4TB/iocage                /mnt/Mirror4TB/iocage
Mirror4TB/.system/cores         /mnt/Mirror4TB/.system/cores
Mirror4TB/iocage/releases       /mnt/Mirror4TB/iocage/releases
Mirror4TB/iocage/log            /mnt/Mirror4TB/iocage/log
Mirror4TB/iocage/images         /mnt/Mirror4TB/iocage/images
Mirror4TB/.system/rrd-1c36823397d74dbc9e7d4fbefe8b455e  /mnt/Mirror4TB/.system/rrd-1c36823397d74dbc9e7d4fbefe8b455e
Mirror4TB/iocage/download       /mnt/Mirror4TB/iocage/download
Mirror4TB/iocage/releases/11.3-RELEASE  /mnt/Mirror4TB/iocage/releases/11.3-RELEASE
Mirror4TB/.system/webui         /mnt/Mirror4TB/.system/webui
Mirror4TB/iocage/releases/11.2-RELEASE  /mnt/Mirror4TB/iocage/releases/11.2-RELEASE
Mirror4TB/iocage/templates      /mnt/Mirror4TB/iocage/templates
Mirror4TB/.system/samba4        /mnt/Mirror4TB/.system/samba4
Mirror4TB/iocage/jails          /mnt/Mirror4TB/iocage/jails
Mirror4TB/.system/syslog-1c36823397d74dbc9e7d4fbefe8b455e  /mnt/Mirror4TB/.system/syslog-1c36823397d74dbc9e7d4fbefe8b455e
Mirror4TB/iocage/releases/11.2-RELEASE/root  /mnt/Mirror4TB/iocage/releases/11.2-RELEASE/root
Mirror4TB/.system/configs-1c36823397d74dbc9e7d4fbefe8b455e  /mnt/Mirror4TB/.system/configs-1c36823397d74dbc9e7d4fbefe8b455e
Mirror4TB/iocage/releases/11.3-RELEASE/root  /mnt/Mirror4TB/iocage/releases/11.3-RELEASE/root
Mirror4TB/iocage/jails/plex     /mnt/Mirror4TB/iocage/jails/plex
Mirror4TB/iocage/download/11.2-RELEASE  /mnt/Mirror4TB/iocage/download/11.2-RELEASE
Mirror4TB/iocage/jails/plex/root  /mnt/Mirror4TB/iocage/jails/plex/root
Mirror4TB/iocage/download/11.3-RELEASE  /mnt/Mirror4TB/iocage/download/11.3-RELEASE
Mirror14TB/.system              /var/db/system
Mirror14TB/.system/cores        /var/db/system/cores
Mirror14TB/.system/samba4       /var/db/system/samba4
Mirror14TB/.system/syslog-f5932e1cad854466b62026d8437aa9bc  /var/db/system/syslog-f5932e1cad854466b62026d8437aa9bc
Mirror14TB/.system/rrd-f5932e1cad854466b62026d8437aa9bc  /var/db/system/rrd-f5932e1cad854466b62026d8437aa9bc
Mirror14TB/.system/configs-f5932e1cad854466b62026d8437aa9bc  /var/db/system/configs-f5932e1cad854466b62026d8437aa9bc
Mirror14TB/.system/webui        /var/db/system/webui
Mirror14TB/.system/services     /var/db/system/services

The third command (mount) shows a lot of iocage and jail stuff. Only thing relevant to my Media folders were two lines:

/mnt/Mirror4TB/Media on /mnt/Mirror4TB/iocage/jails/plex/root/media (nullfs, local)
/mnt/Mirror14TB/Media on /mnt/Mirror4TB/iocage/jails/plex/root/mnt (nullfs, local)

Code:

root@freenas[~]# mount
boot-pool/ROOT/default on / (zfs, local, noatime, nfsv4acls)
devfs on /dev (devfs, local, multilabel)
tmpfs on /etc (tmpfs, local)
tmpfs on /mnt (tmpfs, local)
tmpfs on /var (tmpfs, local)
fdescfs on /dev/fd (fdescfs)
Mirror14TB on /mnt/Mirror14TB (zfs, local, nfsv4acls)
Mirror4TB on /mnt/Mirror4TB (zfs, local, nfsv4acls)
Mirror4TB/.system on /mnt/Mirror4TB/.system (zfs, local, nfsv4acls)
Mirror4TB/iocage on /mnt/Mirror4TB/iocage (zfs, local, nfsv4acls)
Mirror4TB/.system/cores on /mnt/Mirror4TB/.system/cores (zfs, local, nfsv4acls)
Mirror4TB/iocage/releases on /mnt/Mirror4TB/iocage/releases (zfs, local, nfsv4acls)
Mirror4TB/iocage/log on /mnt/Mirror4TB/iocage/log (zfs, local, nfsv4acls)
Mirror4TB/iocage/images on /mnt/Mirror4TB/iocage/images (zfs, local, nfsv4acls)
Mirror4TB/.system/rrd-1c36823397d74dbc9e7d4fbefe8b455e on /mnt/Mirror4TB/.system/rrd-1c36823397d74dbc9e7d4fbefe8b455e (zfs, local, nfsv4acls)
Mirror4TB/iocage/download on /mnt/Mirror4TB/iocage/download (zfs, local, nfsv4acls)
Mirror4TB/iocage/releases/11.3-RELEASE on /mnt/Mirror4TB/iocage/releases/11.3-RELEASE (zfs, local, nfsv4acls)
Mirror4TB/.system/webui on /mnt/Mirror4TB/.system/webui (zfs, local, nfsv4acls)
Mirror4TB/iocage/releases/11.2-RELEASE on /mnt/Mirror4TB/iocage/releases/11.2-RELEASE (zfs, local, nfsv4acls)
Mirror4TB/iocage/templates on /mnt/Mirror4TB/iocage/templates (zfs, local, nfsv4acls)
Mirror4TB/.system/samba4 on /mnt/Mirror4TB/.system/samba4 (zfs, local, nfsv4acls)
Mirror4TB/iocage/jails on /mnt/Mirror4TB/iocage/jails (zfs, local, nfsv4acls)
Mirror4TB/.system/syslog-1c36823397d74dbc9e7d4fbefe8b455e on /mnt/Mirror4TB/.system/syslog-1c36823397d74dbc9e7d4fbefe8b455e (zfs, local, nfsv4acls)
Mirror4TB/iocage/releases/11.2-RELEASE/root on /mnt/Mirror4TB/iocage/releases/11.2-RELEASE/root (zfs, local, nfsv4acls)
Mirror4TB/.system/configs-1c36823397d74dbc9e7d4fbefe8b455e on /mnt/Mirror4TB/.system/configs-1c36823397d74dbc9e7d4fbefe8b455e (zfs, local, nfsv4acls)
Mirror4TB/iocage/releases/11.3-RELEASE/root on /mnt/Mirror4TB/iocage/releases/11.3-RELEASE/root (zfs, local, nfsv4acls)
Mirror4TB/iocage/jails/plex on /mnt/Mirror4TB/iocage/jails/plex (zfs, local, nfsv4acls)
Mirror4TB/iocage/download/11.2-RELEASE on /mnt/Mirror4TB/iocage/download/11.2-RELEASE (zfs, local, nfsv4acls)
Mirror4TB/iocage/jails/plex/root on /mnt/Mirror4TB/iocage/jails/plex/root (zfs, local, nfsv4acls)
Mirror4TB/iocage/download/11.3-RELEASE on /mnt/Mirror4TB/iocage/download/11.3-RELEASE (zfs, local, nfsv4acls)
Mirror14TB/.system on /var/db/system (zfs, local, nfsv4acls)
Mirror14TB/.system/cores on /var/db/system/cores (zfs, local, nfsv4acls)
Mirror14TB/.system/samba4 on /var/db/system/samba4 (zfs, local, nfsv4acls)
Mirror14TB/.system/syslog-f5932e1cad854466b62026d8437aa9bc on /var/db/system/syslog-f5932e1cad854466b62026d8437aa9bc (zfs, local, nfsv4acls)
Mirror14TB/.system/rrd-f5932e1cad854466b62026d8437aa9bc on /var/db/system/rrd-f5932e1cad854466b62026d8437aa9bc (zfs, local, nfsv4acls)
Mirror14TB/.system/configs-f5932e1cad854466b62026d8437aa9bc on /var/db/system/configs-f5932e1cad854466b62026d8437aa9bc (zfs, local, nfsv4acls)
Mirror14TB/.system/webui on /var/db/system/webui (zfs, local, nfsv4acls)
Mirror14TB/.system/services on /var/db/system/services (zfs, local, nfsv4acls)
/mnt/Mirror4TB/iocage/releases/11.2-RELEASE/root/bin on /mnt/Mirror4TB/iocage/jails/plex/root/bin (nullfs, local, read-only)
/mnt/Mirror4TB/iocage/releases/11.2-RELEASE/root/boot on /mnt/Mirror4TB/iocage/jails/plex/root/boot (nullfs, local, read-only)
/mnt/Mirror4TB/iocage/releases/11.2-RELEASE/root/lib on /mnt/Mirror4TB/iocage/jails/plex/root/lib (nullfs, local, read-only)
/mnt/Mirror4TB/iocage/releases/11.2-RELEASE/root/libexec on /mnt/Mirror4TB/iocage/jails/plex/root/libexec (nullfs, local, read-only)
/mnt/Mirror4TB/iocage/releases/11.2-RELEASE/root/rescue on /mnt/Mirror4TB/iocage/jails/plex/root/rescue (nullfs, local, read-only)
/mnt/Mirror4TB/iocage/releases/11.2-RELEASE/root/sbin on /mnt/Mirror4TB/iocage/jails/plex/root/sbin (nullfs, local, read-only)
/mnt/Mirror4TB/iocage/releases/11.2-RELEASE/root/usr/bin on /mnt/Mirror4TB/iocage/jails/plex/root/usr/bin (nullfs, local, read-only)
/mnt/Mirror4TB/iocage/releases/11.2-RELEASE/root/usr/include on /mnt/Mirror4TB/iocage/jails/plex/root/usr/include (nullfs, local, read-only)
/mnt/Mirror4TB/iocage/releases/11.2-RELEASE/root/usr/lib on /mnt/Mirror4TB/iocage/jails/plex/root/usr/lib (nullfs, local, read-only)
/mnt/Mirror4TB/iocage/releases/11.2-RELEASE/root/usr/libexec on /mnt/Mirror4TB/iocage/jails/plex/root/usr/libexec (nullfs, local, read-only)
/mnt/Mirror4TB/iocage/releases/11.2-RELEASE/root/usr/sbin on /mnt/Mirror4TB/iocage/jails/plex/root/usr/sbin (nullfs, local, read-only)
/mnt/Mirror4TB/iocage/releases/11.2-RELEASE/root/usr/share on /mnt/Mirror4TB/iocage/jails/plex/root/usr/share (nullfs, local, read-only)
/mnt/Mirror4TB/iocage/releases/11.2-RELEASE/root/usr/libdata on /mnt/Mirror4TB/iocage/jails/plex/root/usr/libdata (nullfs, local, read-only)
/mnt/Mirror4TB/iocage/releases/11.2-RELEASE/root/usr/lib32 on /mnt/Mirror4TB/iocage/jails/plex/root/usr/lib32 (nullfs, local, read-only)
/mnt/Mirror4TB/Media on /mnt/Mirror4TB/iocage/jails/plex/root/media (nullfs, local)
/mnt/Mirror14TB/Media on /mnt/Mirror4TB/iocage/jails/plex/root/mnt (nullfs, local)
devfs on /mnt/Mirror4TB/iocage/jails/plex/root/dev (devfs, local, multilabel)
fdescfs on /mnt/Mirror4TB/iocage/jails/plex/root/dev/fd (fdescfs)

But that's just that I have mounted my Media folders so that Plex could access them, I believe?

Fourth command outputs this:

Code:

root@freenas[~]# zfs list -r Mirror14TB

NAME                                                          USED  AVAIL     REFER  MOUNTPOINT

Mirror14TB                                                   3.34T  8.89T     3.34T  /mnt/Mirror14TB

Mirror14TB/.system                                           10.6M  8.89T      104K  legacy

Mirror14TB/.system/configs-f5932e1cad854466b62026d8437aa9bc    88K  8.89T       88K  legacy

Mirror14TB/.system/cores                                       88K  1024M       88K  legacy

Mirror14TB/.system/rrd-f5932e1cad854466b62026d8437aa9bc      9.37M  8.89T     9.37M  legacy

Mirror14TB/.system/samba4                                     360K  8.89T      360K  legacy

Mirror14TB/.system/services                                    96K  8.89T       96K  legacy

Mirror14TB/.system/syslog-f5932e1cad854466b62026d8437aa9bc    408K  8.89T      408K  legacy

Mirror14TB/.system/webui                                       88K  8.89T       88K  legacy

Does this mean the Media folder datasets on both Mirror4TB and Mirror14TB aren't mounted properly?

winnielinnie · Sep 7, 2021

Something funky is going on. You have a ".system dataset" on both pools: Mirror4TB and Mirror14TB

Secondly, it looks like you don't even have a Media dataset. It looks like you have a folder named "Media" that lives on your top-level root dataset (Mirror14TB).

How did you initially construct this pool? It looks like you just have a top-level root dataset, in which you shared via SMB, and then just created a bunch of folders within, and this is where you dumped your media?

Stoffern · Sep 7, 2021

I guess so. I don't remember how I initially set up the pools and so on, as I did that many years ago. Obviously I did something wrong, but I've at least managed to gain access to the shares now via SMB.

Only issue now is that Plex doesn't seem to be able to read any of my movies anymore, for some odd reason. Though I believe I've figured out why; the two folders I've mounted my media to in my plex jail and under root so that plex can actually access it is configured as my user to be the owner, rather than root. Everything else in the "root" folder in my plex jail is configured as root being the owner, but my two folders; mnt & media are configured as my user.

Any tips on changing the rights from my user to root the correct way? As I don't think I've done a lot regarding this server the 'correct way' over the past years.

Edit: When attempting to add a new folder in plex for media, it shows them as file icons but grayed out.

In WinSCP I see the rights and owners:

I don't know what to change to make it work again.

cheekymonkey · Nov 4, 2021

I'm having a similar issue. Did you ever resolve it?

I have also 'phantom' folders that are under my /mnt/Nas pool but do not show with either in the webgui, zfs mount, or mount.

There is a little bit of good news, however. I can create samba shares and access files under those folders, so I guess I can create some new datasets and move the files over.

Stoffern · Nov 5, 2021

cheekymonkey said:
I'm having a similar issue. Did you ever resolve it?

I have also 'phantom' folders that are under my /mnt/Nas pool but do not show with either in the webgui, zfs mount, or mount.

There is a little bit of good news, however. I can create samba shares and access files under those folders, so I guess I can create some new datasets and move the files over.

View attachment 50537

View attachment 50538

I never did find a solution. Though I was able to access the folders through SMB as well, which was my workaround as well. It's a real janky solution on my end, but it works; even if it's just barely.

The best solution would be the one you mentioned; to create a new dataset and copy everything over, but that would mean I'd have to reconfigure all my movies on Plex, which is why I haven't done so. Three years of customizing movies, reorganizing, thumbnails and everything and a little janky solutions seems a lot more worthwhile.

I hope you do find a fix! If you do, please do let me know! :)

Patrick M. Hausen · Nov 5, 2021

What kind of fix do you expect? These are just folders inside the top level dataset that you "somehow" created. So they are not showing up in the "Storage" section of the UI, because they are not datasets.

If you prefer separate datasets or if folders are what is actually desired, only you can decide. There is no malfunction here, just two different kinds of artefacts present.

To "convert" a folder into a dataset without the need to reorganize - let's assume the folder is named "X":

Code:

# stop service using the folder
cd /mnt/<poolname>
mv X X.bak
# create dataset X in the UI
cd X.bak
mv * .??* ../X
# the above might take a while
cd ..
rmdir X.bak
# start service

William Bravin · Oct 23, 2022

Hello all

I had a very stupid moment last august and i had to rebuild both servers. Finally today I manage to get everything up configured and running.

My last task was to upgrade my oldest server (thios is the one who had disks and HD controller issues) from freenas 11.2 to the current truenas core
In doing this all my ACLs were reset why i do not know (i must have done something wrong). I just reconfigured them

However I looking at my servers and how they are today i see many issues.

The main one is (what i call ghost data sets) In the GUI all my data sets are correct and have no issues with ACL SMB or Rsync

they configured are as follows:
Pool name Media
dataset Name:
- Movies
- Documents
- Music
- Tv Shows

However I i go to the shell and then go to /mnt/media and do an ls I get the following

oot@Freenas[~]# cd mnt/mediacd /mnt/Media
cd: string not in pwd: mnt/mediacd
root@Freenas[~]# cd /mnt/media
root@Freenas[/mnt/media]# los
zsh: command not found: los
root@Freenas[/mnt/media]# ls
.windows Documents movies music Tv Shows
documents iocage Movies Music wbravin
root@Freenas[/mnt/media]# mount
freenas-boot/ROOT/FreeNAS-12.0-U8.1 on / (zfs, local, noatime, nfsv4acls)
devfs on /dev (devfs, local, multilabel)
tmpfs on /etc (tmpfs, local)
tmpfs on /mnt (tmpfs, local)
tmpfs on /var (tmpfs, local)
fdescfs on /dev/fd (fdescfs)
media on /mnt/media (zfs, local, nfsv4acls)

Please notice the data set with upper and lower first letter case. The correct dataset is the one that starts with an upper case letter.

Please tell me how to remove the datasets that have a lowe case first letter (docments music movies). I do not want to try this without some guidfance

Thank you in advance for your help and teachings

Important Announcement for the TrueNAS Community.

Datasets don't show up under 'pools' after upgrade.

Stoffern

Dabbler

winnielinnie

MVP

Stoffern

Dabbler

winnielinnie

MVP

Stoffern

Dabbler

cheekymonkey

Cadet

Stoffern

Dabbler

Patrick M. Hausen

Hall of Famer

William Bravin

Contributor

Similar threads