Upgrading FreeNAS 11.2 to 11.3 and jails. Corrupt jails and wrong versions

floogy

Dabbler
Joined
Oct 24, 2012
Messages
22
Hi, I recently upgraded my FreeNAS (hp microserver N40L, 8GB RAM) from 11.2-U8 to 11.3-U4.
Before this I stored the configuration and migrated the warden jails to iocage jails. Some of the jails like the pluginjail and the dlna_1 jail lost their network ability, but I managed it with the GUI to get them back and up running.

Then I started the Backup in the system>update UI. It stucked at 65% 1/4 and pressing shift+F5 gave me the webinspector in FF, F5 switched me back into the webGUI, and I retried the upgrade.

After some time I pressed F5 again, due to the 65% 1/4 hanging screen, and on a particular Window, that I can't remember, it instructed me to reboot, because the system had been upgraded.

After the reboot the webGUI only worked particulary. Only the sub menue under system worked properly. All other buttons were without function. On the right in the head of the webUI there was a possibility to switch the webUI to the older one(?), but I don't remember exactly. Can I switch back to the other webUI? Do I have the recent webUI running?

That webUI worked and responsed normally.

I then tried to get the iocage jails working, but they didn't.

I noticed bizarre behavior regarding versions, and the oldest warden Jails with 8.3 and 9.1-RELEASE (pluginjail, dlna_1).

Before upgrading, after migrate_warden.py
Code:
root@floogy:~ # iocage
+-----+-------------+-------+--------------+---------------+
| JID |    NAME     | STATE |   RELEASE    |      IP4      |
+=====+=============+=======+==============+===============+
| -   | FAMP        | down  | 11.0-RELEASE | -             |
+-----+-------------+-------+--------------+---------------+
| -   | dlna_1      | down  | 9.1-RELEASE  | -             |
+-----+-------------+-------+--------------+---------------+
| -   | firefly_1   | down  | 11.0-RELEASE | -             |
+-----+-------------+-------+--------------+---------------+
| 10  | nextcloud   | up    | 11.2-RELEASE | DHCP          |
+-----+-------------+-------+--------------+---------------+
| -   | nextcloud_1 | down  | 10.3-RELEASE | -             |
+-----+-------------+-------+--------------+---------------+
| -   | pluginjail  | down  | 8.3-RELEASE  | 172.16.240.25 |
+-----+-------------+-------+--------------+---------------+

root@floogy:~ # iocage df
+-------------+-------+------+------+-------+-------+
|    NAME     |  CRT  | RES  | QTA  |  USE  |  AVA  |
+=============+=======+======+======+=======+=======+
| FAMP        | 2.50x | none | none | 3.19G | 3.40T |
+-------------+-------+------+------+-------+-------+
| dlna_1      | 2.82x | none | none | 1.13G | 3.40T |
+-------------+-------+------+------+-------+-------+
| firefly_1   | 2.59x | none | none | 794M  | 3.40T |
+-------------+-------+------+------+-------+-------+
| nextcloud   | 1.27x | none | none | 16.9G | 3.40T |
+-------------+-------+------+------+-------+-------+
| nextcloud_1 | 1.50x | none | none | 4.94G | 3.40T |
+-------------+-------+------+------+-------+-------+
| pluginjail  | 1.96x | none | none | 3.62G | 3.40T |
+-------------+-------+------+------+-------+-------+

root@floogy:~ # bash -c  in {dlna_1,firefly_1,nextcloud_1,FAMP} ; do  /usr/local/sbin/migrate_warden.py -v -j ${jail} -p datapool ; done '
-- Migrating: dlna_1 --
  dlna_1 is running, please stop it first.
-- Migrating: firefly_1 --
  firefly_1 is running, please stop it first.
-- Migrating: nextcloud_1 --
  nextcloud_1 is running, please stop it first.
-- Migrating: FAMP --
  FAMP is running, please stop it first.
root@floogy:~ # warden list
ID                       AUTOSTART    STATUS       TYPE
---------------------------------------------------------------------------
dlna_1                   Enabled      Running      pluginjail
FAMP                     Enabled      Running      standard
firefly_1                Enabled      Running      pluginjail
nextcloud_1              Enabled      Running      pluginjail
pluginjail               Enabled      Running      standard
root@floogy:~ # iocage list
+-----+-----------+-------+--------------+------+
| JID |   NAME    | STATE |   RELEASE    | IP4  |
+=====+===========+=======+==============+======+
| 10  | nextcloud | up    | 11.2-RELEASE | DHCP |
+-----+-----------+-------+--------------+------+


root@floogy:~ # bash -c 'for jail in {pluginjail,fly_1,nextcloud_1,FAMP} ; do  /usr/local/sbin/migrate_warden.py -v -j ${jail} -p datapool ; done'
dne'
-- Migrating: pluginjail --
  NAT isn't supported by iocage, not migrating property.
TIME        SENT   SNAPSHOT
18:36:40    125K   datapool/jails/pluginjail@WardenMigration_2020-08-24
[...]
18:38:51   5.20G   datapool/jails/pluginjail@WardenMigration_2020-08-24
-- Migrating: dlna_1 --
TIME        SENT   SNAPSHOT
18:39:05   1.26M   datapool/jails/dlna_1@WardenMigration_2020-08-24
[...]
18:40:17   2.58G   datapool/jails/dlna_1@WardenMigration_2020-08-24
-- Migrating: firefly_1 --
TIME        SENT   SNAPSHOT
18:40:32   9.31M   datapool/jails/firefly_1@WardenMigration_2020-08-24
[...]
18:41:11   1.63G   datapool/jails/firefly_1@WardenMigration_2020-08-24
-- Migrating: nextcloud_1 --
TIME        SENT   SNAPSHOT
18:41:25    241K   datapool/jails/nextcloud_1@WardenMigration_2020-08-24
[...]
18:44:12   6.96G   datapool/jails/nextcloud_1@WardenMigration_2020-08-24
-- Migrating: FAMP --
TIME        SENT   SNAPSHOT
18:44:27    171K   datapool/jails/FAMP@WardenMigration_2020-08-24
[...]
18:46:57   5.48G   datapool/jails/FAMP@WardenMigration_2020-08-24
root@floogy:~ #


root@floogy:~ # bash -c 'for i in {dlna_1,firefly_1,nextcloud_1,FAMP,pluginjail} ; do warden auto ${i} ; done'
Disabled autostart for dlna_1
Disabled autostart for firefly_1
Disabled autostart for nextcloud_1
Disabled autostart for FAMP
Disabled autostart for pluginjail

root@floogy:~ # warden list
ID                       AUTOSTART    STATUS       TYPE
---------------------------------------------------------------------------
dlna_1                   Disabled     Stopped      pluginjail
FAMP                     Disabled     Stopped      standard
firefly_1                Disabled     Stopped      pluginjail
nextcloud_1              Disabled     Stopped      pluginjail
pluginjail               Disabled     Stopped      standard



After
Code:
root@floogy:~ # iocage upgrade -r 11.3-RELEASE nextcloud
Snapshotting nextcloud...
Snapshot already exists
Updating plugin INDEX...
Running upgrade...
Snapshotting nextcloud...
Updating plugin INDEX...
Updating plugin artifact...
Cloning git repository

Branch 11.3-RELEASE does not exist at https://github.com/freenas/iocage-plugin-nextcloud.git!
Using "master" branch for plugin, this may not work with your RELEASE
Removing old pkgs...
Checking integrity... done (0 conflicting)
Deinstallation has been requested for the following 69 packages (of 0 packages in the universe):

Installed packages to be REMOVED:
        ca_root_nss-3.55
        curl-7.72.0

[...]
        php74-zlib-7.4.9
        pkg-1.14.7
        png-1.6.37
        protobuf-3.12.4,1
        tiff-4.1.0
        webp-1.1.0

Number of packages to be removed: 69

The operation will free 712 MiB.
[nextcloud] [1/69] Deinstalling nextcloud-php74-19.0.1...
You may need to manually remove /usr/local/www/nextcloud/config/config.php if it is no longer needed.
[nextcloud] [1/69] Deleting files for nextcloud-php74-19.0.1: .......... done
[nextcloud] [2/69] Deinstalling php74-xsl-7.4.9...
[...]
[nextcloud] [68/69] Deinstalling png-1.6.37...
[nextcloud] [68/69] Deleting files for png-1.6.37: .......... done
[nextcloud] [69/69] Deinstalling protobuf-3.12.4,1...
[nextcloud] [69/69] Deleting files for protobuf-3.12.4,1: .......... done
Installing new pkgs...
Repo: iocage-plugins already exists, skipping!

Testing Host DNS response to pkg.FreeBSD.org
Testing nextcloud's SRV response to pkg.FreeBSD.org
Testing nextcloud's DNSSEC response to pkg.FreeBSD.org

Installing plugin packages:
  - nextcloud-php74...
  - nginx...
  - mysql57-server...
Cloning git repository

Branch 11.3-RELEASE does not exist at https://github.com/freenas/iocage-plugin-nextcloud.git!
Using "master" branch for plugin, this may not work with your RELEASE

nextcloud successfully upgraded!
root@floogy:~ # iocage exec nextcloud freebsd-version
11.2-RELEASE-p15
root@floogy:~ # iocage exec nextcloud freebsd-version
11.2-RELEASE-p15
root@floogy:~ # iocage list
freebsd-version could not be found at /mnt/datapool/iocage/jails/dlna_1/root/bin/freebsd-version
freebsd-version could not be found at /mnt/datapool/iocage/jails/pluginjail/root/bin/freebsd-version
+-----+-------------+---------+--------------+---------------+
| JID |    NAME     |  STATE  |   RELEASE    |      IP4      |
+=====+=============+=========+==============+===============+
| 2   | FAMP        | up      | 11.0-RELEASE | DHCP          |
+-----+-------------+---------+--------------+---------------+
| -   | dlna_1      | CORRUPT | N/A          | N/A           |
+-----+-------------+---------+--------------+---------------+
| -   | firefly_1   | down    | 11.0-RELEASE | 172.16.240.23 |
+-----+-------------+---------+--------------+---------------+
| 8   | nextcloud   | up      | 11.3-RELEASE | DHCP          |
+-----+-------------+---------+--------------+---------------+
| -   | nextcloud_1 | down    | 10.3-RELEASE | 172.16.240.16 |
+-----+-------------+---------+--------------+---------------+
| -   | pluginjail  | CORRUPT | N/A          | N/A           |
+-----+-------------+---------+--------------+---------------+
root@floogy:~ # iocage exec nextcloud freebsd-version
11.2-RELEASE-p15
root@floogy:~ # iocage upgrade -r 11.3-RELEASE FAMP
src component not installed, skipped
Looking up update.FreeBSD.org mirrors... 3 mirrors found.
Fetching public key from update2.freebsd.org... done.
Fetching metadata signature for 11.0-RELEASE from update2.freebsd.org... done.
Fetching metadata index... done.
Fetching 2 metadata files... done.
Inspecting system... done.

The following components of FreeBSD seem to be installed:
world/base world/doc world/lib32

The following components of FreeBSD do not seem to be installed:
world/base-dbg world/lib32-dbg

Does this look reasonable (y/n)? ^C
Aborted!
root@floogy:~ # iocage df
freebsd-version could not be found at /mnt/datapool/iocage/jails/dlna_1/root/bin/freebsd-version
root@floogy:~ # iocage upgrade -r 11.0-RELEASE pluginjail
freebsd-version could not be found at /mnt/datapool/iocage/jails/pluginjail/root/bin/freebsd-version
root@floogy:~ # iocage exec FAMP freebsd-version
11.0-RELEASE-p1



There is also an issue with mysql and php-fpm in the nextcloud iocage, which was 11.2-RELEASE before upgrading.

Undefined symbol "setproctitle_fast@FBSD_1.5"
Code:
root@floogy:~ # iocage console nextcloud
Last login: Tue Aug 25 00:02:31 on pts/5
FreeBSD 11.3-RELEASE-p11 (FreeNAS.amd64) #0 r325575+fb17f3e15b8(HEAD): Tue Jul 28 11:09:10 EDT 2020
Welcome to FreeBSD!
[...]
root@nextcloud:~ # freebsd-version ; uname -a
11.2-RELEASE-p15
FreeBSD nextcloud 11.3-RELEASE-p11 FreeBSD 11.3-RELEASE-p11 #0 r325575+fb17f3e15b8(HEAD): Tue Jul 28 11:09:10 EDT 2020     root@tnbuilds05.tn.ixsystems.net:/freenas-releng/freenas/_BE/objs/freenas-releng/freenas/_BE/os/sys/FreeNAS.amd64  amd64
root@nextcloud:~ # ps axu | egrep 'ngin|mysql|fpm'
root  61898  0.0  0.1 11672 7384  -  IsJ  00:10   0:00.00 nginx: master process /usr/local/sbin/nginx
www   61899  0.0  0.1 11672 7848  -  IJ   00:10   0:00.00 nginx: worker process (nginx)
www   61900  0.0  0.1 11672 7844  -  IJ   00:10   0:00.00 nginx: worker process (nginx)
root  86949  0.0  0.0  6740 2584  4  R+J  10:23   0:00.00 egrep ngin|mysql|fpm
root@nextcloud:/usr/local/www/nextcloud # /usr/local/etc/rc.d/mysql-server status
mysql is not running.
root@nextcloud:/usr/local/www/nextcloud # /usr/local/etc/rc.d/mysql-server start
Starting mysql.
/root/.acme.sh/acme.sh.csh: Permission denied.
root@nextcloud:/usr/local/www/nextcloud # /usr/local/etc/rc.d/mysql-server status
mysql is not running.
root@nextcloud:/usr/local/www/nextcloud #
root@nextcloud:/usr/local/www/nextcloud # ls -l .acme.sh/acme.sh.csh
-rwxr-xr-x  1 root  wheel  78 Apr  4  2019 /root/.acme.sh/acme.sh.csh
root@nextcloud:/usr/local/www/nextcloud # head /root/.acme.sh/acme.sh.csh
setenv LE_WORKING_DIR "/root/.acme.sh"
alias acme.sh "/root/.acme.sh/acme.sh"
root@nextcloud:/usr/local/www/nextcloud # tail /.acme.sh/acme.sh.csh
setenv LE_WORKING_DIR "/root/.acme.sh"
alias acme.sh "/root/.acme.sh/acme.sh"
root@nextcloud:/usr/local/www/nextcloud # head /root/.acme.sh/acme.sh.
#!/usr/local/bin/bash

VER=2.8.7

PROJECT_NAME="acme.sh"

PROJECT_ENTRY="acme.sh"

PROJECT="https://github.com/acmesh-official/$PROJECT_NAME"

root@nextcloud:~ # /usr/local/etc/rc.d/php-fpm restart
Performing sanity check on php-fpm configuration:
[25-Aug-2020 12:16:15] NOTICE: configuration file /usr/local/etc/php-fpm.conf test is successful

php_fpm not running? (check /var/run/php-fpm.pid).
Performing sanity check on php-fpm configuration:
[25-Aug-2020 12:16:15] NOTICE: configuration file /usr/local/etc/php-fpm.conf test is successful

Starting php_fpm.
/usr/local/sbin/php-fpm: Undefined symbol "setproctitle_fast@FBSD_1.5"
[25-Aug-2020 12:16:16] ERROR: no data have been read from pipe
/usr/local/etc/rc.d/php-fpm: WARNING: failed to start php_fpm


Pastebin https://pastebin.ubuntu.com/p/WhF36S2r9X/
 
Last edited:

floogy

Dabbler
Joined
Oct 24, 2012
Messages
22
I got some success with reanimation of the dlna_1 iocage jail (from warden) with 9.1-RELEASE.
I simply copied the requested freebsd-version over.


Code:
root@floogy:~ # cp -a /bin/freebsd-version /mnt/datapool/iocage/jails/dlna_1/root/bin/freebsd-version

root@floogy:~ # diff -s /bin/freebsd-version /mnt/datapool/iocage/jails/dlna_1/root/bin/freebsd-version
Files /bin/freebsd-version and /mnt/datapool/iocage/jails/dlna_1/root/bin/freebsd-version are identical
root@floogy:~ # ls /mnt/datapool/iocage/jails/dlna_1/bin
ls: /mnt/datapool/iocage/jails/dlna_1/bin: No such file or directory
root@floogy:~ # ls /mnt/datapool/iocage/jails/dlna_1/root/bin
[               cp              echo            kenv            mv              pwd             rmdir           tcsh
bash            csh             ed              kill            pax             rcp             setfacl         test
cat             date            expr            link            pgrep           realpath        sh              unlink
chflags         dd              freebsd-version ln              pkill           red             sleep           uuidgen
chio            df              getfacl         ls              ps              rm              stty
chmod           domainname      hostname        mkdir           pwait           rmail           sync
root@floogy:~ # iocage snaplist dlna_1
+-------------------------------------------------------+-----------------------+-------+------+
|                         NAME                          |        CREATED        | RSIZE | USED |
+=======================================================+=======================+=======+======+
| dlna_1_corrupt_recursive_manual-2020-08-24_22-08      | Mon Aug 24 22:08 2020 | 128K  | 0    |
+-------------------------------------------------------+-----------------------+-------+------+
| dlna_1_corrupt_recursive_manual-2020-08-24_22-08/root | Mon Aug 24 22:08 2020 | 1.13G | 330K |
+-------------------------------------------------------+-----------------------+-------+------+
root@floogy:~ # iocage import -p /mnt/datapool/iocage/jails/dlna_1/root-WardenMigration_2020-08-24-clone  dlna_1_clone
dlna_1_clone not found!
root@floogy:~ # iocage import -p /mnt/datapool/iocage/jails/dlna_1/root-WardenMigration_2020-08-24-clone root-WardenMigration_2020-08-24-clone
root-WardenMigration_2020-08-24-clone not found!
root@floogy:~ # iocage import -p /mnt/datapool/iocage/jails/dlna_1 root-WardenMigration_2020-08-24-clone
root-WardenMigration_2020-08-24-clone not found!
root@floogy:~ # iocage snaplist pluginjail
freebsd-version could not be found at /mnt/datapool/iocage/jails/pluginjail/root/bin/freebsd-version
root@floogy:~ # iocage starta_1
* Starting dlna_1
  + Started OK
  + Using devfs_ruleset: 7
  + Configuring VNET FAILED
  route: writing to routing socket: Network is unreachable
add net default: gateway 172.16.240.3: Network is unreachable

Stopped dlna_1 due to VNET failure
root@floogy:~ # iocage upgrade -r 11.2-RELEASE dlna_1

Stopped dlna_1 due to VNET failure
root@floogy:~ # iocage snapshot dlna_1
Snapshot: datapool/iocage/jails/dlna_1@2020-08-25_14:19:24 created.
root@floogy:~ # iocage snaplista_1
+-------------------------------------------------------+-----------------------+-------+-------+
|                         NAME                          |        CREATED        | RSIZE | USED  |
+=======================================================+=======================+=======+=======+
| dlna_1_corrupt_recursive_manual-2020-08-24_22-08      | Mon Aug 24 22:08 2020 | 128K  | 0     |
+-------------------------------------------------------+-----------------------+-------+-------+
| dlna_1_corrupt_recursive_manual-2020-08-24_22-08/root | Mon Aug 24 22:08 2020 | 1.13G | 1018K |
+-------------------------------------------------------+-----------------------+-------+-------+
| 2020-08-25_14:19:24                                   | Tue Aug 25 16:19 2020 | 144K  | 0     |
+-------------------------------------------------------+-----------------------+-------+-------+
| 2020-08-25_14:19:24/root                              | Tue Aug 25 16:19 2020 | 1.13G | 0     |
+-------------------------------------------------------+-----------------------+-------+-------+
root@floogy:~ # iocage upgrade -r 11.2-RELEASE
src component not installed, skipped
Looking up update.FreeBSD.org mirrors... 3 mirrors found.
Fetching public key from update4.freebsd.org... done.
Fetching metadata signature for 9.1-RELEASE from update4.freebsd.org... done.
Fetching metadata index... done.
Fetching 2 metadata files... done.
Inspecting system... done.

The following components of FreeBSD seem to be installed:
world/base world/doc world/games world/lib32

The following components of FreeBSD do not seem to be installed:

Does this look reasonable (y/n)? n
Command: /tmp/tmpsxt9fsjp -b /mnt/datapool/iocage/jails/dlna_1/root -d /mnt/datapool/iocage/jails/dlna_1/root/var/db/freebsd-update/ -f /mnt/datapool/iocage/jails/dlna_1/root/etc/freebsd-update.conf --not-running-from-cron --currently-running 9.1-RELEASE -r 11.2-RELEASE upgrade failed!
root@floogy:~ #

root@floogy:~ # iocage exec freebsd-version dlna_1
jail 'freebsd-version' not found!
root@floogy:~ # iocage exec dlna_1 freebsd-version
11.3-RELEASE-p11

root@floogy:~ # iocage list
freebsd-version could not be found at /mnt/datapool/iocage/jails/pluginjail/root/bin/freebsd-version
+-----+-------------+---------+--------------+---------------+
| JID |    NAME     |  STATE  |   RELEASE    |      IP4      |
+=====+=============+=========+==============+===============+
| 2   | FAMP        | up      | 11.0-RELEASE | DHCP          |
+-----+-------------+---------+--------------+---------------+
| 13  | dlna_1      | up      | 9.1-RELEASE  | 172.16.240.19 |
+-----+-------------+---------+--------------+---------------+
| -   | firefly_1   | down    | 11.0-RELEASE | 172.16.240.23 |
+-----+-------------+---------+--------------+---------------+
| 8   | nextcloud   | up      | 11.3-RELEASE | DHCP          |
+-----+-------------+---------+--------------+---------------+
| -   | nextcloud_1 | down    | 10.3-RELEASE | 172.16.240.16 |
+-----+-------------+---------+--------------+---------------+
| -   | pluginjail  | CORRUPT | N/A          | N/A           |
+-----+-------------+---------+--------------+---------------+


Code:

root@floogy:~ # iocage exec freebsd-version dlna_1
jail 'freebsd-version' not found!
root@floogy:~ # iocage exec dlna_1 freebsd-version
11.3-RELEASE-p11
root@floogy:~ # jls
   JID  IP Address      Hostname                      Path
     2                  FAMP                          /mnt/datapool/iocage/jails/FAMP/root
     8                  nextcloud                     /mnt/datapool/iocage/jails/nextcloud/root
    13                  dlna_1                        /mnt/datapool/iocage/jails/dlna_1/root
root@floogy:~ # jexec 13
root@dlna_1:/ # freebsd-version
11.3-RELEASE-p11
root@dlna_1:/ # ps axu | grep dlna
root 31540  0.0  0.0 16280 2124  4  R+J   4:31PM 0:00.00 grep dlna
root@dlna_1:/ # ps axu
USER   PID %CPU %MEM   VSZ  RSS TT  STAT STARTED    TIME COMMAND
root 30075  0.0  0.0 12052 1848 ??  SsJ   4:18PM 0:00.01 /usr/sbin/syslogd -s
root 30096  0.0  0.0 12052 1592 ??  IsJ   4:18PM 0:00.00 daemon: /usr/local/sbin/pbid[30097] (daemon)
root 30097  0.0  0.0 18600 3408 ??  IJ    4:18PM 0:00.06 /bin/sh /usr/local/sbin/pbid
root 30158  0.0  0.1 46744 5400 ??  IsJ   4:18PM 0:00.00 /usr/sbin/sshd
root 30169  0.0  0.0 14128 1888 ??  IsJ   4:18PM 0:00.00 /usr/sbin/cron -s
root 30214  0.0  0.0 11992 1568 ??  IsJ   4:18PM 0:00.00 /usr/sbin/rtsold -a
root 31360  0.0  0.0  3776 1448 ??  IJ    4:28PM 0:00.00 sleep 300
root 31526  0.0  0.0 17532 3480  4  SJ    4:30PM 0:00.02 /bin/csh -i
root 31541  0.0  0.0 14188 2064  4  R+J   4:31PM 0:00.00 ps axu
root@dlna_1:/ # /usr/local/etc/rc.d/
dbus*     minidlna@ pbid*     svnserve*
root@dlna_1:/ # /usr/local/etc/rc.d/
dbus*     minidlna@ pbid*     svnserve*
root@dlna_1:/ # /usr/local/etc/rc.d/minidlna start
Cannot 'start' minidlna. Set minidlna_enable to YES in /etc/rc.conf or use 'onestart' instead of 'start'.
root@dlna_1:/ # /usr/local/etc/rc.d/minidlna status
Cannot 'status' minidlna. Set minidlna_enable to YES in /etc/rc.conf or use 'onestatus' instead of 'status'.
root@dlna_1:/ # /usr/local/etc/rc.d/minidlna onestart
Starting minidlna.
[2020/08/25 16:32:49] minidlna.c:631: error: Media directory "/opt" not accessible [No such file or directory]
root@dlna_1:/ # ls /opt
ls: /opt: No such file or directory
root@dlna_1:/ # ls /
+COMPACT_MANIFEST       COPYRIGHT               dev                     libexec                 rescue                  tmp
.cshrc                  access.log              etc                     media                   root                    usr
.plugins                bin                     home                    mnt                     sbin                    var
.profile                boot                    lib                     proc                    sys
 
Top