Error: Cannot remove file /tmp

TranceKat

Dabbler
Joined
Feb 17, 2020
Messages
21
Hello All,
I'm finally going to try to upgrade from FreeNAS-11.3-U3.2.

My first attempt was to upgrade to 11.3-U5:
OperationName
Upgradebase-os-11.3-U3.2-34e407923c7ab791e652f69528c42184 -> base-os-11.3-U5-e1b01c8c85d9ad63759e484f30efb325
Upgradefreebsd-pkgdb-11.3-U3.2-34e407923c7ab791e652f69528c42184 -> freebsd-pkgdb-11.3-U5-e1b01c8c85d9ad63759e484f30efb325
Upgradefreenas-pkg-tools-11.3-U3.2-34e407923c7ab791e652f69528c42184 -> freenas-pkg-tools-11.3-U5-e1b01c8c85d9ad63759e484f30efb325
UpgradeFreeNASUI-11.3-U3.2-34e407923c7ab791e652f69528c42184 -> FreeNASUI-11.3-U5-e1b01c8c85d9ad63759e484f30efb325

When I attempt to do so, I get: Error: Cannot remove file /tmp

# ls -l / | grep tmp
lrwxr-xr-x 1 root wheel 13 Jun 4 2020 .rnd -> /var/tmp/.rnd
drwxr-xr-x 4 root wheel 1227 Mar 18 22:25 tmp

What am I doing wrong, please? Is it safe to delete all the contents of /tmp?

Thank you.
 

TranceKat

Dabbler
Joined
Feb 17, 2020
Messages
21
Bump.. Any thoughts / assistance on where I can go from here to solve this, please?
 

rvassar

Guru
Joined
May 2, 2018
Messages
972
"/tmp" is a directory, not a file. Try "ls -lai /tmp" and post the results.
 

TranceKat

Dabbler
Joined
Feb 17, 2020
Messages
21
"/tmp" is a directory, not a file. Try "ls -lai /tmp" and post the results.
Thank you.

I didn't post the original output because it's just a massive list of files, but here's the output of the ls you suggested; I had to truncate it since the message is over 30000 characters with the full list. Thank you for helping.

There are 1229 lines/files in the directory.
# ls -lai /tmp
total 686
199317 drwxr-xr-x 4 root wheel 1228 Mar 22 10:42 .
4 drwxr-xr-x 21 root wheel 27 Mar 19 23:21 ..
199579 -rw-r--r-- 1 root wheel 0 Mar 19 23:22 .bootready
199836 -rw------- 1 root wheel 241 Aug 2 2020 .hist15991
199633 -rw------- 1 root wheel 1264 Jun 14 2020 .hist1728
201366 -rw------- 1 root wheel 364 Mar 18 22:15 .hist1820
199603 -rw------- 1 root wheel 199 Jun 16 2020 .hist1830
201374 -rw------- 1 root wheel 213 Mar 18 22:03 .hist1868
199857 -rw------- 1 root wheel 1515 Jun 17 2020 .hist1937
201455 -rw------- 1 root wheel 513 Mar 18 23:04 .hist2072
199827 -rw------- 1 root wheel 84 Jun 17 2020 .hist20792
199657 -rw------- 1 root wheel 617 Aug 2 2021 .hist2279
199891 -rw------- 1 root wheel 410 Jun 17 2020 .hist23415
199584 -rw------- 1 root wheel 159 Aug 1 2020 .hist2349
200058 -rw------- 1 root wheel 423 Jun 17 2020 .hist24706
199593 -rw------- 1 root wheel 38 Aug 2 2021 .hist2513
199476 -rw------- 1 root wheel 303 Jun 13 2020 .hist2674
199694 -rw------- 1 root wheel 74 Aug 2 2020 .hist2760
199626 -rw------- 1 root wheel 122 Aug 2 2021 .hist2877
201381 -rw------- 1 root wheel 41 Mar 18 22:16 .hist3061
212669 -rw------- 1 root wheel 156 Sep 30 2020 .hist3110
200219 -rw------- 1 root wheel 250 Jun 18 2020 .hist31184
200863 -rw------- 1 root wheel 189 Aug 13 2020 .hist33244
199635 -rw------- 1 root wheel 180 Jun 16 2020 .hist3371
346892 -rw------- 1 root wheel 4 May 28 2021 .hist36649
200203 -rw------- 1 root wheel 68 Jun 15 2020 .hist42023
199637 -rw------- 1 root wheel 176 Jun 16 2020 .hist4433
210208 -rw------- 1 root wheel 73 Aug 25 2021 .hist45058
199643 -rw------- 1 root wheel 10 Aug 11 2020 .hist4512
200254 -rw------- 1 root wheel 874 Jun 15 2020 .hist45377
200582 -rw------- 1 root wheel 84 Jun 20 2020 .hist45589
200989 -rw------- 1 root wheel 5 Aug 3 2020 .hist49886
201028 -rw------- 1 root wheel 219 Aug 22 2020 .hist50096
200482 -rw------- 1 root wheel 414 Jun 16 2020 .hist60769
200497 -rw------- 1 root wheel 157 Jun 16 2020 .hist61345
199661 -rw------- 1 root wheel 31 Jun 16 2020 .hist6302
200952 -rw------- 1 root wheel 256 Jun 21 2020 .hist64108
199666 -rw------- 1 root wheel 8 Jun 16 2020 .hist6683
201392 -rw------- 1 root wheel 9 Aug 7 2020 .hist67235
202094 -rw------- 1 root wheel 38 Jul 18 2020 .hist69505
202139 -rw------- 1 root wheel 102 Jul 18 2020 .hist75842
228514 -rw------- 1 root wheel 4 Oct 29 2020 .hist8165
223793 -rw------- 1 root wheel 334 Aug 2 2021 .hist92757
199338 -rw-r--r-- 1 root wheel 0 Mar 19 23:21 .middleware-started
198763 -rw-r--r-- 1 root wheel 0 Jun 16 2020 .middlewared-console-once
199863 drwxr-xr-x 3 root wheel 3 Jun 15 2020 iocage
199332 -rw-r--r-- 1 root wheel 0 Mar 22 10:42 mail.queue
199318 drwxr-xr-x 4 root wheel 4 May 5 2021 mako
202294 -rw------- 1 root wheel 235717 Mar 22 10:42 nginx-access.log
202295 -rw-r----- 1 root wheel 7663 Mar 22 00:00 nginx-access.log.0.bz2
201026 -rw------- 1 root wheel 16 Nov 19 11:23 SEMDmp-_0b8vyp1
201308 -rw------- 1 root wheel 16 Mar 19 23:21 SEMDmp-_20v4rgx
201304 -rw------- 1 root wheel 16 Mar 19 23:21 SEMDmp-_2707xiy
201107 -rw------- 1 root wheel 16 Nov 21 10:38 SEMDmp-_2l_pp6h
200928 -rw------- 1 root wheel 16 Nov 18 22:18 SEMDmp-_2wzkb70
199693 -rw------- 1 root wheel 16 Oct 31 14:49 SEMDmp-_4wpi5ms
200808 -rw------- 1 root wheel 16 Nov 18 15:59 SEMDmp-_81yk4g1
200869 -rw------- 1 root wheel 16 Nov 18 21:43 SEMDmp-_8rlj90b
200983 -rw------- 1 root wheel 16 Nov 19 10:20 SEMDmp-_a4dpjvl
201133 -rw------- 1 root wheel 16 Nov 21 14:08 SEMDmp-_akjv4_k
200876 -rw------- 1 root wheel 16 Nov 18 21:32 SEMDmp-_amlk1dj
200986 -rw------- 1 root wheel 16 Nov 19 10:20 SEMDmp-_c50tlp9
200166 -rw------- 1 root wheel 16 Oct 31 16:12 SEMDmp-_dmbo67h
200735 -rw------- 1 root wheel 16 Nov 16 13:24 SEMDmp-_easg57r
200535 -rw------- 1 root wheel 16 Nov 12 10:59 SEMDmp-_eer44fh
201196 -rw------- 1 root wheel 16 Nov 21 14:44 SEMDmp-_g_tfi0w
200571 -rw------- 1 root wheel 16 Nov 15 11:37 SEMDmp-_hav7z0k
199742 -rw------- 1 root wheel 16 Oct 31 14:49 SEMDmp-_i899bq9
199435 -rw------- 1 root wheel 16 Oct 30 12:46 SEMDmp-_j18uk3s
200521 -rw------- 1 root wheel 16 Nov 12 10:28 SEMDmp-_js41nxp
199746 -rw------- 1 root wheel 16 Oct 31 15:14 SEMDmp-_kjvetb3
201188 -rw------- 1 root wheel 16 Nov 21 14:44 SEMDmp-_kpfzoo4
199698 -rw------- 1 root wheel 16 Oct 31 14:49 SEMDmp-_ln2j3ga
199683 -rw------- 1 root wheel 16 Oct 31 13:07 SEMDmp-_lwasskr
201030 -rw------- 1 root wheel 16 Nov 19 11:23 SEMDmp-_mjh61tu
201111 -rw------- 1 root wheel 16 Nov 21 10:38 SEMDmp-_oqn5htf
200813 -rw------- 1 root wheel 16 Nov 18 15:59 SEMDmp-_pex6pvu
199751 -rw------- 1 root wheel 16 Oct 31 15:14 SEMDmp-_ppknuqs
199912 -rw------- 1 root wheel 16 Oct 31 15:53 SEMDmp-_qjjklni
199699 -rw------- 1 root wheel 16 Oct 31 14:49 SEMDmp-_ru5v6jl
200171 -rw------- 1 root wheel 16 Oct 31 16:26 SEMDmp-_skpingl
199571 -rw------- 1 root wheel 16 Oct 31 11:17 SEMDmp-_ss1r6si
201012 -rw------- 1 root wheel 16 Nov 19 10:32 SEMDmp-_t9t6pp2
201091 -rw------- 1 root wheel 16 Nov 21 08:02 SEMDmp-_tg4972n
200480 -rw------- 1 root wheel 16 Nov 12 10:59 SEMDmp-_wowjf5u
200509 -rw------- 1 root wheel 16 Nov 12 10:28 SEMDmp-00n6_cuv
199645 -rw------- 1 root wheel 16 Oct 31 10:59 SEMDmp-03_sc3o5
200448 -rw------- 1 root wheel 16 Nov 12 10:00 SEMDmp-03qd4dfo
199835 -rw------- 1 root wheel 16 Oct 31 16:05 SEMDmp-05mbi16i
200170 -rw------- 1 root wheel 16 Oct 31 16:12 SEMDmp-06g2z3nv
201231 -rw------- 1 root wheel 16 Nov 21 16:41 SEMDmp-07awogfb
200850 -rw------- 1 root wheel 16 Nov 18 17:40 SEMDmp-07erltgm
199762 -rw------- 1 root wheel 16 Oct 31 14:58 SEMDmp-08gbi72x
201082 -rw------- 1 root wheel 16 Nov 21 08:02 SEMDmp-0a4uxeiv
199642 -rw------- 1 root wheel 16 Oct 31 10:59 SEMDmp-0axak8an
199587 -rw------- 1 root wheel 16 Oct 30 12:46 SEMDmp-0ersqaxq
200746 -rw------- 1 root wheel 16 Nov 16 17:06 SEMDmp-0gtn0qmk
200978 -rw------- 1 root wheel 16 Nov 19 10:32 SEMDmp-0k6egxrg
200169 -rw------- 1 root wheel 16 Oct 31 16:12 SEMDmp-0ket6l_i
199822 -rw------- 1 root wheel 16 Oct 31 15:53 SEMDmp-0l14gn4z
199773 -rw------- 1 root wheel 16 Oct 31 15:44 SEMDmp-0peq35s3
201011 -rw------- 1 root wheel 16 Nov 19 10:32 SEMDmp-0qrihx3u
200459 -rw------- 1 root wheel 16 Nov 12 10:00 SEMDmp-0r8c7xfn
201124 -rw------- 1 root wheel 16 Nov 21 14:07 SEMDmp-0s0vqk9b
200731 -rw------- 1 root wheel 16 Nov 15 12:01 SEMDmp-0s2mr_td
199754 -rw------- 1 root wheel 16 Oct 31 15:35 SEMDmp-0uoxt51a
199989 -rw------- 1 root wheel 16 Oct 31 19:25 SEMDmp-0uq0wrmn
200819 -rw------- 1 root wheel 16 Nov 18 15:59 SEMDmp-0vadv8fw
199662 -rw------- 1 root wheel 16 Oct 31 13:26 SEMDmp-0vecxyx8
200465 -rw------- 1 root wheel 16 Nov 12 10:00 SEMDmp-0wgtgbcg
200891 -rw------- 1 root wheel 16 Nov 18 21:32 SEMDmp-1_szdwet
201243 -rw------- 1 root wheel 16 Nov 21 19:42 SEMDmp-110rs8f6
201228 -rw------- 1 root wheel 16 Nov 21 16:41 SEMDmp-11fv6_hm
200494 -rw------- 1 root wheel 16 Nov 12 10:15 SEMDmp-11zudxrw
200506 -rw------- 1 root wheel 16 Nov 12 10:59 SEMDmp-13_ewm2k
199600 -rw------- 1 root wheel 16 Oct 31 10:51 SEMDmp-14qtbn4h
200971 -rw------- 1 root wheel 16 Nov 19 10:32 SEMDmp-15l99rha
199900 -rw------- 1 root wheel 16 Oct 31 15:53 SEMDmp-15wb9nkb
200835 -rw------- 1 root wheel 16 Nov 18 21:32 SEMDmp-16109k5p
201197 -rw------- 1 root wheel 16 Nov 21 14:44 SEMDmp-161hbe70
199676 -rw------- 1 root wheel 16 Oct 31 13:07 SEMDmp-17ilf78r
200908 -rw------- 1 root wheel 16 Nov 18 21:43 SEMDmp-19_0pvvj
199823 -rw------- 1 root wheel 16 Oct 31 15:53 SEMDmp-190r50bx
201216 -rw------- 1 root wheel 16 Nov 21 19:42 SEMDmp-19bo0p1i
199708 -rw------- 1 root wheel 16 Oct 31 13:26 SEMDmp-1afhbc7o
200206 -rw------- 1 root wheel 16 Oct 31 16:26 SEMDmp-1b44qppf
200470 -rw------- 1 root wheel 16 Nov 12 10:15 SEMDmp-1cm56n6j
200178 -rw------- 1 root wheel 16 Oct 31 16:19 SEMDmp-1dwpv37b
200181 -rw------- 1 root wheel 16 Oct 31 16:19 SEMDmp-1ek6f9ym
200930 -rw------- 1 root wheel 16 Nov 18 22:18 SEMDmp-1em3d1p7
200771 -rw------- 1 root wheel 16 Nov 16 17:06 SEMDmp-1fnrpc8u
199704 -rw------- 1 root wheel 16 Oct 31 13:26 SEMDmp-1j6c3z0a
200426 -rw------- 1 root wheel 16 Nov 15 11:37 SEMDmp-1k4dmpmr
199656 -rw------- 1 root wheel 16 Oct 31 13:26 SEMDmp-1l5u0xgd
200190 -rw------- 1 root wheel 16 Oct 31 16:19 SEMDmp-1mlj_ld0
201042 -rw------- 1 root wheel 16 Nov 19 10:52 SEMDmp-1n9k9j_m
200996 -rw------- 1 root wheel 16 Nov 19 10:20 SEMDmp-1q3w8spd
199779 -rw------- 1 root wheel 16 Oct 31 15:14 SEMDmp-1qlzthf_
201010 -rw------- 1 root wheel 16 Nov 19 11:23 SEMDmp-1qv7dhmj
200579 -rw------- 1 root wheel 16 Nov 16 13:23 SEMDmp-1ryk9fj6
200904 -rw------- 1 root wheel 16 Nov 18 21:43 SEMDmp-1s3_qrr6
199572 -rw------- 1 root wheel 16 Oct 30 12:46 SEMDmp-1s7qjewz
200361 -rw------- 1 root wheel 16 Oct 31 16:36 SEMDmp-1tfclq2z
201186 -rw------- 1 root wheel 16 Nov 21 16:41 SEMDmp-1vxx4uuw
199720 -rw------- 1 root wheel 16 Oct 31 14:58 SEMDmp-1wl7x_4f
201061 -rw------- 1 root wheel 16 Nov 21 08:02 SEMDmp-1wzxfb7o
200195 -rw------- 1 root wheel 16 Oct 31 16:35 SEMDmp-1zdsx2zd
199576 -rw------- 1 root wheel 16 Oct 30 12:46 SEMDmp-1ztji28z
199434 -rw------- 1 root wheel 16 Oct 30 12:46 SEMDmp-2_iqpmv9
196612 -rw------- 1 root wheel 16 Oct 30 12:28 SEMDmp-2_va0yqt
199793 -rw------- 1 root wheel 16 Oct 31 15:44 SEMDmp-21gl8b4m
200076 -rw------- 1 root wheel 16 Oct 31 16:12 SEMDmp-22654q21
200588 -rw------- 1 root wheel 16 Nov 15 12:01 SEMDmp-23_9gwdg
199675 -rw------- 1 root wheel 16 Oct 31 13:07 SEMDmp-24odctn4
201134 -rw------- 1 root wheel 16 Nov 21 11:21 SEMDmp-26za12q5
200471 -rw------- 1 root wheel 16 Nov 12 10:15 SEMDmp-28ookc5e
199715 -rw------- 1 root wheel 16 Oct 31 13:26 SEMDmp-29xhu7h3
199809 -rw------- 1 root wheel 16 Oct 31 15:35 SEMDmp-2b9qs56p
199845 -rw------- 1 root wheel 16 Oct 31 15:44 SEMDmp-2efil76o
201041 -rw------- 1 root wheel 16 Nov 19 10:52 SEMDmp-2eh0pa75
201043 -rw------- 1 root wheel 16 Nov 19 10:52 SEMDmp-2eke6ygz
199647 -rw------- 1 root wheel 16 Oct 31 10:59 SEMDmp-2fnwmv5b
200174 -rw------- 1 root wheel 16 Oct 31 16:26 SEMDmp-2h1vgwv8
200843 -rw------- 1 root wheel 16 Nov 18 21:32 SEMDmp-2h74a05r
200947 -rw------- 1 root wheel 16 Nov 19 10:32 SEMDmp-2h8bfdxa
201067 -rw------- 1 root wheel 16 Nov 19 11:23 SEMDmp-2inc2sbj
199748 -rw------- 1 root wheel 16 Oct 31 14:58 SEMDmp-2jvwvv1w
200855 -rw------- 1 root wheel 16 Nov 18 17:40 SEMDmp-2k8ktvw7
201063 -rw------- 1 root wheel 16 Nov 19 11:23 SEMDmp-2kt6s2qm
201025 -rw------- 1 root wheel 16 Nov 19 10:32 SEMDmp-2l4y0ypo
200546 -rw------- 1 root wheel 16 Nov 15 11:37 SEMDmp-2mvo2ar2
199646 -rw------- 1 root wheel 16 Oct 31 10:59 SEMDmp-2nndd1xu
199436 -rw------- 1 root wheel 16 Oct 30 12:46 SEMDmp-2owur4ug
201174 -rw------- 1 root wheel 16 Nov 21 14:08 SEMDmp-2pp6pber
201059 -rw------- 1 root wheel 16 Nov 19 11:23 SEMDmp-2qbt77ir
199278 -rw------- 1 root wheel 16 Oct 31 10:50 SEMDmp-2s43ayty
200536 -rw------- 1 root wheel 16 Nov 12 10:59 SEMDmp-2tdoxs87
200831 -rw------- 1 root wheel 16 Nov 18 17:39 SEMDmp-2ti6cz0d
200764 -rw------- 1 root wheel 16 Nov 18 08:56 SEMDmp-2u21czeh
201241 -rw------- 1 root wheel 16 Nov 21 16:41 SEMDmp-2whvzshl
200046 -rw------- 1 root wheel 16 Oct 31 16:05 SEMDmp-2ycfutvi
199341 -rw------- 1 root wheel 16 Oct 31 10:50 SEMDmp-3__6rzv7
200525 -rw------- 1 root wheel 16 Nov 12 10:28 SEMDmp-30kpz_7b
200485 -rw------- 1 root wheel 16 Nov 12 10:15 SEMDmp-33696cbj
201055 -rw------- 1 root wheel 16 Nov 21 08:02 SEMDmp-35i520yc
201238 -rw------- 1 root wheel 16 Nov 21 16:41 SEMDmp-384ejii5
200583 -rw------- 1 root wheel 16 Nov 15 12:01 SEMDmp-39enn2md
199731 -rw------- 1 root wheel 16 Oct 31 14:49 SEMDmp-3it6s9px
200936 -rw------- 1 root wheel 16 Nov 18 22:18 SEMDmp-3ivis00h
201200 -rw------- 1 root wheel 16 Nov 21 14:44 SEMDmp-3ivtfe7k
200729 -rw------- 1 root wheel 16 Nov 15 12:01 SEMDmp-3jwjs6js
200113 -rw------- 1 root wheel 16 Oct 31 16:26 SEMDmp-3llivu8c
201160 -rw------- 1 root wheel 16 Nov 21 14:44 SEMDmp-3mivza10
199669 -rw------- 1 root wheel 16 Oct 31 13:07 SEMDmp-3mzzyent
199797 -rw------- 1 root wheel 16 Oct 31 15:44 SEMDmp-3oa5usdd
201203 -rw------- 1 root wheel 16 Nov 21 14:44 SEMDmp-3pq6nj1m
200455 -rw------- 1 root wheel 16 Nov 12 10:00 SEMDmp-3ps5b1zi
200201 -rw------- 1 root wheel 16 Oct 31 16:35 SEMDmp-3qkel1wm
201181 -rw------- 1 root wheel 16 Nov 21 14:08 SEMDmp-3r_br985
199651 -rw------- 1 root wheel 16 Oct 31 10:59 SEMDmp-3s3e6qk8
200500 -rw------- 1 root wheel 16 Nov 12 10:15 SEMDmp-3sq_lqxl
201275 -rw------- 1 root wheel 16 Nov 21 19:42 SEMDmp-3stfgn4u
199851 -rw------- 1 root wheel 16 Oct 31 16:05 SEMDmp-3v8zr1mj
200069 -rw------- 1 root wheel 16 Oct 31 16:19 SEMDmp-3vb0x3li
200737 -rw------- 1 root wheel 16 Nov 16 13:24 SEMDmp-3wc10j9v
201315 -rw------- 1 root wheel 16 Mar 19 23:21 SEMDmp-3wdf_bbv
201068 -rw------- 1 root wheel 16 Nov 19 11:23 SEMDmp-3wmcq5_x
200787 -rw------- 1 root wheel 16 Nov 18 08:56 SEMDmp-3x0kxrt2
199896 -rw------- 1 root wheel 16 Oct 31 15:53 SEMDmp-3xmeessx
199632 -rw------- 1 root wheel 16 Oct 31 10:59 SEMDmp-3ygvc08f
200900 -rw------- 1 root wheel 16 Nov 18 22:18 SEMDmp-3yxwo5w6
199828 -rw------- 1 root wheel 16 Oct 31 15:44 SEMDmp-3zlot70z
199585 -rw------- 1 root wheel 16 Oct 30 12:46 SEMDmp-4_syn7m4
200193 -rw------- 1 root wheel 16 Oct 31 16:19 SEMDmp-40pluu3s
201054 -rw------- 1 root wheel 16 Nov 21 08:02 SEMDmp-41evu4au
201227 -rw------- 1 root wheel 16 Nov 21 19:42 SEMDmp-41m0zu_z
201120 -rw------- 1 root wheel 16 Nov 21 10:38 SEMDmp-4447py7e
199848 -rw------- 1 root wheel 16 Oct 31 15:44 SEMDmp-44exz4gm
201137 -rw------- 1 root wheel 16 Nov 21 16:41 SEMDmp-4520g3so
201232 -rw------- 1 root wheel 16 Nov 21 16:41 SEMDmp-48vy1vny
 

rvassar

Guru
Joined
May 2, 2018
Messages
972
Interesting... That's a bunch of really old cruft, some dating back to 2020. Have you rebooted the machine recently? The /tmp directory on a traditional BSD / Linux system generally gets cleaned up at reboot. But I can't say what the FreeNAS / TrueNAS default is. But you certainly cannot delete a directory that contains files without a recuse/force flag. I looked in mine to compare, and there's some similar stuff ala "SEMDmp-*", and nginx & mako directories. I do not have any of the ".histNNNN" files, nor an iocage directory. Before you clean this up, you'll have to check your iocage configuration.
 

rvassar

Guru
Joined
May 2, 2018
Messages
972
No jails running is a start, but we need to find out what's in the /tmp/iocage directory. Yes, you can clean up /tmp manually, but you probably need to do so selectively. Check the timestamps, etc... My TrueNAS system has an "uptime" of 17 days. Here's what my /tmp looks like:


Code:
% ls -l
total 176
drwx------  2 www    wheel      0 Mar  5 09:53 firmware
-rw-r--r--  1 root   wheel      0 Mar  5 10:03 mail.queue
drwxr-xr-x  3 root   wheel     64 Mar  5 09:53 mako
drwxr-xr-x  3 root   wheel     64 Mar  5 10:34 middlewared
-rw-r--r--  1 root   wheel      3 Mar  5 09:53 middlewared_startup.seq
drwxr-xr-x  2 minio  minio      0 Feb  3 21:23 minio
drwxr-xr-x  6 root   wheel    256 Mar  5 09:53 nginx
-rw-------  1 root   wheel  59178 Mar 20 00:00 nginx-access.log
-rw-r-----  1 root   wheel   4623 Mar 13 00:00 nginx-access.log.0.bz2
-rw-------  1 root   wheel     16 Mar  5 09:53 SEMDmp-2scogknl
-rw-------  1 root   wheel     16 Mar  5 09:53 SEMDmp-2uy9pcfc
-rw-------  1 root   wheel     16 Mar 22 11:37 SEMDmp-78u4czl0
-rw-------  1 root   wheel     16 Mar  5 09:53 SEMDmp-7n0rupag
-rw-------  1 root   wheel     16 Mar  5 09:53 SEMDmp-9rn9wdq5
-rw-------  1 root   wheel     16 Mar 22 11:37 SEMDmp-bbss3uz3
-rw-------  1 root   wheel     16 Mar  5 09:53 SEMDmp-f59880uo
-rw-------  1 root   wheel     16 Mar 22 11:37 SEMDmp-fj15y4xr
-rw-------  1 root   wheel     16 Mar  5 09:53 SEMDmp-gvkj3z6j
-rw-------  1 root   wheel     16 Mar 22 11:37 SEMDmp-hkeysy8_
-rw-------  1 root   wheel     16 Mar  5 09:53 SEMDmp-hwdsmtxq
-rw-------  1 root   wheel     16 Mar 22 11:37 SEMDmp-kuuzrqtj
-rw-------  1 root   wheel     16 Mar  5 09:53 SEMDmp-m8x9oygl
-rw-------  1 root   wheel     16 Mar  5 09:53 SEMDmp-p2f_kpy1
-rw-------  1 root   wheel     16 Mar  5 09:53 SEMDmp-qanzekxv
-rw-------  1 root   wheel     16 Mar  5 09:53 SEMDmp-ri56nnb1
-rw-------  1 root   wheel     16 Mar  5 09:53 SEMDmp-sglcmre3
-rw-------  1 root   wheel     16 Mar  5 09:53 SEMDmp-tdyoc7dl
-rw-------  1 root   wheel     16 Mar  5 09:53 SEMDmp-tj42m72d
-rw-------  1 root   wheel     16 Mar  5 09:53 SEMDmp-u8jwzi1v
-rw-------  1 root   wheel     16 Mar 22 11:37 SEMDmp-v86l_pwj
-rw-------  1 root   wheel     16 Mar  5 09:53 SEMDmp-vlb9vveb
-rw-------  1 root   wheel     16 Mar  5 09:53 SEMDmp-ycpwbmo5
-rw-------  1 root   wheel     16 Mar 22 11:37 SEMDmp-yju54te0
-rw-------  1 root   wheel     16 Mar 22 11:37 SEMDmp-z6929349
-rw-------  1 root   wheel     16 Mar 22 11:37 SEMDmp-zza9ltk4
drwxrwxrwt  2 root   wheel      0 Feb  3 21:23 vi.recover


As you can see, the only thing older than the last reboot is "vi.recover" & "minio". The vi.recover is known to me, and I know I installed minio and deleted it, so are likely safe for me to delete.
 

TranceKat

Dabbler
Joined
Feb 17, 2020
Messages
21
I found the log file where the debug messages are sent. I've bolded the error sections:
[2022/03/23 13:58:59] (DEBUG) urllib3.connectionpool._new_conn():959 - Starting new HTTPS connection (1): update-master.ixsystems.com:443
[2022/03/23 13:59:00] (DEBUG) urllib3.connectionpool._make_request():437 - https://update-master.ixsystems.com:443 "GET /FreeNAS/trains_redir.json HTTP/1.1" 200 465
[2022/03/23 13:59:00] (DEBUG) freenasOS.Configuration.TryGetNetworkFile():606 - TryGetNetworkFile(['https://update.ixsystems.com/FreeNAS/trains.txt', 'https://update-master.ixsystems.com/FreeNAS/trains.txt'])
[2022/03/23 13:59:00] (DEBUG) urllib3.connectionpool._new_conn():959 - Starting new HTTPS connection (1): update.ixsystems.com:443
[2022/03/23 13:59:00] (DEBUG) urllib3.connectionpool._make_request():437 - https://update.ixsystems.com:443 "GET /FreeNAS/trains.txt HTTP/1.1" 301 169
[2022/03/23 13:59:00] (DEBUG) urllib3.connectionpool._new_conn():959 - Starting new HTTPS connection (1): update.freenas.org:443
[2022/03/23 13:59:00] (DEBUG) urllib3.connectionpool._make_request():437 - https://update.freenas.org:443 "GET /FreeNAS/trains.txt HTTP/1.1" 200 475
[2022/03/23 13:59:00] (DEBUG) freenasOS.Configuration.TryGetNetworkFile():745 - TryGetNetworkFile(['https://update.ixsystems.com/FreeNAS/trains.txt', 'https://update-master.ixsystems.com/FreeNAS/trains.txt']): Read 475 bytes total
[2022/03/23 13:59:00] (DEBUG) freenasOS.Configuration.TryGetNetworkFile():606 - TryGetNetworkFile(['https://update-master.ixsystems.com/FreeNAS/FreeNAS-11.3-STABLE/LATEST'])
[2022/03/23 13:59:00] (DEBUG) urllib3.connectionpool._new_conn():959 - Starting new HTTPS connection (1): update-master.ixsystems.com:443
[2022/03/23 13:59:01] (DEBUG) urllib3.connectionpool._make_request():437 - https://update-master.ixsystems.com:443 "GET /FreeNAS/FreeNAS-11.3-STABLE/LATEST HTTP/1.1" 200 1957
[2022/03/23 13:59:01] (DEBUG) freenasOS.Configuration.TryGetNetworkFile():745 - TryGetNetworkFile(['https://update-master.ixsystems.com/FreeNAS/FreeNAS-11.3-STABLE/LATEST']): Read 1957 bytes total
[2022/03/23 13:59:01] (DEBUG) freenasOS.Configuration.TryGetNetworkFile():606 - TryGetNetworkFile(['https://update-master.ixsystems.com/updates/ix_crl.pem'])
[2022/03/23 13:59:01] (DEBUG) urllib3.connectionpool._new_conn():959 - Starting new HTTPS connection (1): update-master.ixsystems.com:443
[2022/03/23 13:59:01] (DEBUG) urllib3.connectionpool._make_request():437 - https://update-master.ixsystems.com:443 "GET /updates/ix_crl.pem HTTP/1.1" 200 1028
[2022/03/23 13:59:01] (DEBUG) freenasOS.Configuration.CheckFreeSpace():77 - CheckFreeSpace(path=/tmp/tmpwmyhkcke.pem, pool=None, required=1028)
[2022/03/23 13:59:01] (DEBUG) freenasOS.Configuration.TryGetNetworkFile():745 - TryGetNetworkFile(['https://update-master.ixsystems.com/updates/ix_crl.pem']): Read 1028 bytes total
[2022/03/23 13:59:01] (DEBUG) freenasOS.Configuration.TryGetNetworkFile():606 - TryGetNetworkFile(['https://update-master.ixsystems.com/updates/ix_crl.pem'])
[2022/03/23 13:59:01] (DEBUG) urllib3.connectionpool._new_conn():959 - Starting new HTTPS connection (1): update-master.ixsystems.com:443
[2022/03/23 13:59:01] (DEBUG) urllib3.connectionpool._make_request():437 - https://update-master.ixsystems.com:443 "GET /updates/ix_crl.pem HTTP/1.1" 200 1028
[2022/03/23 13:59:01] (DEBUG) freenasOS.Configuration.CheckFreeSpace():77 - CheckFreeSpace(path=/tmp/tmplrrla2gx.pem, pool=None, required=1028)
[2022/03/23 13:59:01] (DEBUG) freenasOS.Configuration.TryGetNetworkFile():745 - TryGetNetworkFile(['https://update-master.ixsystems.com/updates/ix_crl.pem']): Read 1028 bytes total
[2022/03/23 13:59:03] (DEBUG) freenasOS.Configuration.TryGetNetworkFile():606 - TryGetNetworkFile(['https://update-master.ixsystems.com/updates/ix_crl.pem'])
[2022/03/23 13:59:03] (DEBUG) urllib3.connectionpool._new_conn():959 - Starting new HTTPS connection (1): update-master.ixsystems.com:443
[2022/03/23 13:59:04] (DEBUG) urllib3.connectionpool._make_request():437 - https://update-master.ixsystems.com:443 "GET /updates/ix_crl.pem HTTP/1.1" 200 1028
[2022/03/23 13:59:04] (DEBUG) freenasOS.Configuration.CheckFreeSpace():77 - CheckFreeSpace(path=/tmp/tmpqypwkn1j.pem, pool=None, required=1028)
[2022/03/23 13:59:04] (DEBUG) freenasOS.Configuration.TryGetNetworkFile():745 - TryGetNetworkFile(['https://update-master.ixsystems.com/updates/ix_crl.pem']): Read 1028 bytes total
[2022/03/23 13:59:04] (DEBUG) freenasOS.Update.DownloadUpdate():991 - DownloadUpdate: Cache directory has latest manifest
[2022/03/23 13:59:04] (DEBUG) freenasOS.Configuration.TryGetNetworkFile():606 - TryGetNetworkFile(['https://update-master.ixsystems.com/updates/ix_crl.pem'])
[2022/03/23 13:59:04] (DEBUG) urllib3.connectionpool._new_conn():959 - Starting new HTTPS connection (1): update-master.ixsystems.com:443
[2022/03/23 13:59:04] (DEBUG) urllib3.connectionpool._make_request():437 - https://update-master.ixsystems.com:443 "GET /updates/ix_crl.pem HTTP/1.1" 200 1028
[2022/03/23 13:59:04] (DEBUG) freenasOS.Configuration.CheckFreeSpace():77 - CheckFreeSpace(path=/tmp/tmp4vq8zk0w.pem, pool=None, required=1028)
[2022/03/23 13:59:04] (DEBUG) freenasOS.Configuration.TryGetNetworkFile():745 - TryGetNetworkFile(['https://update-master.ixsystems.com/updates/ix_crl.pem']): Read 1028 bytes total
[2022/03/23 13:59:04] (DEBUG) freenasOS.Configuration.TryGetNetworkFile():606 - TryGetNetworkFile(['https://update-master.ixsystems.com/updates/ix_crl.pem'])
[2022/03/23 13:59:04] (DEBUG) urllib3.connectionpool._new_conn():959 - Starting new HTTPS connection (1): update-master.ixsystems.com:443
[2022/03/23 13:59:04] (DEBUG) urllib3.connectionpool._make_request():437 - https://update-master.ixsystems.com:443 "GET /updates/ix_crl.pem HTTP/1.1" 200 1028
[2022/03/23 13:59:04] (DEBUG) freenasOS.Configuration.CheckFreeSpace():77 - CheckFreeSpace(path=/tmp/tmp411c_lku.pem, pool=None, required=1028)
[2022/03/23 13:59:04] (DEBUG) freenasOS.Configuration.TryGetNetworkFile():745 - TryGetNetworkFile(['https://update-master.ixsystems.com/updates/ix_crl.pem']): Read 1028 bytes total
[2022/03/23 13:59:06] (DEBUG) freenasOS.Configuration.TryGetNetworkFile():606 - TryGetNetworkFile(['https://update-master.ixsystems.com/updates/ix_crl.pem'])
[2022/03/23 13:59:06] (DEBUG) urllib3.connectionpool._new_conn():959 - Starting new HTTPS connection (1): update-master.ixsystems.com:443
[2022/03/23 13:59:06] (DEBUG) urllib3.connectionpool._make_request():437 - https://update-master.ixsystems.com:443 "GET /updates/ix_crl.pem HTTP/1.1" 200 1028
[2022/03/23 13:59:06] (DEBUG) freenasOS.Configuration.CheckFreeSpace():77 - CheckFreeSpace(path=/tmp/tmpl5w0eu9e.pem, pool=None, required=1028)
[2022/03/23 13:59:06] (DEBUG) freenasOS.Configuration.TryGetNetworkFile():745 - TryGetNetworkFile(['https://update-master.ixsystems.com/updates/ix_crl.pem']): Read 1028 bytes total
[2022/03/23 13:59:06] (DEBUG) freenasOS.Configuration.TryGetNetworkFile():606 - TryGetNetworkFile(['https://update-master.ixsystems.com/updates/ix_crl.pem'])
[2022/03/23 13:59:06] (DEBUG) urllib3.connectionpool._new_conn():959 - Starting new HTTPS connection (1): update-master.ixsystems.com:443
[2022/03/23 13:59:07] (DEBUG) urllib3.connectionpool._make_request():437 - https://update-master.ixsystems.com:443 "GET /updates/ix_crl.pem HTTP/1.1" 200 1028
[2022/03/23 13:59:07] (DEBUG) freenasOS.Configuration.CheckFreeSpace():77 - CheckFreeSpace(path=/tmp/tmpnw38qk1g.pem, pool=None, required=1028)
[2022/03/23 13:59:07] (DEBUG) freenasOS.Configuration.TryGetNetworkFile():745 - TryGetNetworkFile(['https://update-master.ixsystems.com/updates/ix_crl.pem']): Read 1028 bytes total
[2022/03/23 13:59:07] (DEBUG) freenasOS.Update.ApplyUpdate():1342 - Upgrade package base-os-11.3-U3.2-34e407923c7ab791e652f69528c42184 to base-os-11.3-U5-e1b01c8c85d9ad63759e484f30efb325
[2022/03/23 13:59:07] (DEBUG) freenasOS.Update.ApplyUpdate():1342 - Upgrade package freebsd-pkgdb-11.3-U3.2-34e407923c7ab791e652f69528c42184 to freebsd-pkgdb-11.3-U5-e1b01c8c85d9ad63759e484f30efb325
[2022/03/23 13:59:07] (DEBUG) freenasOS.Update.ApplyUpdate():1342 - Upgrade package freenas-pkg-tools-11.3-U3.2-34e407923c7ab791e652f69528c42184 to freenas-pkg-tools-11.3-U5-e1b01c8c85d9ad63759e484f30efb325
[2022/03/23 13:59:07] (DEBUG) freenasOS.Update.ApplyUpdate():1342 - Upgrade package FreeNASUI-11.3-U3.2-34e407923c7ab791e652f69528c42184 to FreeNASUI-11.3-U5-e1b01c8c85d9ad63759e484f30efb325
[2022/03/23 13:59:07] (DEBUG) freenasOS.Update.ApplyUpdate():1352 - new_boot_name = 11.3-U5, reboot = True
[2022/03/23 13:59:07] (DEBUG) freenasOS.Configuration.FindPackageFile():1214 - Searching for base-os-11.3-U5-e1b01c8c85d9ad63759e484f30efb325.tgz
[2022/03/23 13:59:07] (DEBUG) freenasOS.Configuration.FindPackageFile():1220 - Found package file /var/db/system/update/base-os-11.3-U5-e1b01c8c85d9ad63759e484f30efb325.tgz
[2022/03/23 13:59:09] (DEBUG) freenasOS.Configuration.FindPackageFile():1214 - Searching for freebsd-pkgdb-11.3-U5-e1b01c8c85d9ad63759e484f30efb325.tgz
[2022/03/23 13:59:09] (DEBUG) freenasOS.Configuration.FindPackageFile():1220 - Found package file /var/db/system/update/freebsd-pkgdb-11.3-U5-e1b01c8c85d9ad63759e484f30efb325.tgz
[2022/03/23 13:59:09] (DEBUG) freenasOS.Configuration.FindPackageFile():1214 - Searching for freenas-pkg-tools-11.3-U5-e1b01c8c85d9ad63759e484f30efb325.tgz
[2022/03/23 13:59:09] (DEBUG) freenasOS.Configuration.FindPackageFile():1220 - Found package file /var/db/system/update/freenas-pkg-tools-11.3-U5-e1b01c8c85d9ad63759e484f30efb325.tgz
[2022/03/23 13:59:09] (DEBUG) freenasOS.Configuration.FindPackageFile():1214 - Searching for FreeNASUI-11.3-U5-e1b01c8c85d9ad63759e484f30efb325.tgz
[2022/03/23 13:59:09] (DEBUG) freenasOS.Configuration.FindPackageFile():1220 - Found package file /var/db/system/update/FreeNASUI-11.3-U5-e1b01c8c85d9ad63759e484f30efb325.tgz
[2022/03/23 13:59:09] (DEBUG) freenasOS.Update.ApplyUpdate():1363 - Installer got packages [{'base-os': <_io.BufferedReader name='/var/db/system/update/base-os-11.3-U5-e1b01c8c85d9ad63759e484f30efb325.tgz'>}, {'freebsd-pkgdb': <_io.BufferedReader name='/var/db/system/update/freebsd-pkgdb-11.3-U5-e1b01c8c85d9ad63759e484f30efb325.tgz'>}, {'freenas-pkg-tools': <_io.BufferedReader name='/var/db/system/update/freenas-pkg-tools-11.3-U5-e1b01c8c85d9ad63759e484f30efb325.tgz'>}, {'FreeNASUI': <_io.BufferedReader name='/var/db/system/update/FreeNASUI-11.3-U5-e1b01c8c85d9ad63759e484f30efb325.tgz'>}]
[2022/03/23 13:59:09] (DEBUG) freenasOS.Configuration.CheckFreeSpace():77 - CheckFreeSpace(path=None, pool=freenas-boot, required=2142564352)
[2022/03/23 13:59:09] (DEBUG) freenasOS.Update.PruneClones():402 - No pruning necessary
[2022/03/23 13:59:09] (DEBUG) freenasOS.Update.RunCommand():254 - RunCommand(/usr/local/sbin/beadm, ['create', '11.3-U5'])
[2022/03/23 13:59:10] (DEBUG) freenasOS.Update.modified_call():105 - Created successfully
[2022/03/23 13:59:10] (DEBUG) freenasOS.Update.RunCommand():254 - RunCommand(/usr/local/sbin/beadm, ['mount', '11.3-U5', '/tmp/tmp2167byli'])
[2022/03/23 13:59:10] (DEBUG) freenasOS.Update.modified_call():105 - Mounted successfully on '/tmp/tmp2167byli'
[2022/03/23 13:59:10] (DEBUG) freenasOS.Update.RunCommand():254 - RunCommand(/sbin/mount, ['-t', 'devfs', 'devfs', '/tmp/tmp2167byli/dev'])
[2022/03/23 13:59:10] (DEBUG) freenasOS.Update.RunCommand():254 - RunCommand(/sbin/mount, ['-t', 'tmpfs', 'tmpfs', '/tmp/tmp2167byli/var/tmp'])
[2022/03/23 13:59:10] (DEBUG) freenasOS.Installer.InstallPackages():1083 - Installing package {'base-os': <_io.BufferedReader name='/var/db/system/update/base-os-11.3-U5-e1b01c8c85d9ad63759e484f30efb325.tgz'>}
[2022/03/23 13:59:11] (DEBUG) freenasOS.Installer.install_file():711 - base-os-11.3-U5-e1b01c8c85d9ad63759e484f30efb325
[2022/03/23 13:59:11] (DEBUG) freenasOS.Installer.install_file():745 - upgrade_aware = True
[2022/03/23 13:59:11] (ERROR) freenasOS.Update.ApplyUpdate():1594 - Update got exception during update: Cannot remove file /tmp
Traceback (most recent call last):
File "/usr/local/lib/freenasOS/Update.py", line 1559, in ApplyUpdate
if installer.InstallPackages(progressFunc=progressFunc, handler=install_handler) is False:
File "/usr/local/lib/freenasOS/Installer.py", line 1088, in InstallPackages
trampoline=self.trampoline) is False:
File "/usr/local/lib/freenasOS/Installer.py", line 823, in install_file
if pkgdb.RemovePackageFiles(pkgName) == False:
File "/usr/local/lib/freenasOS/Configuration.py", line 347, in RemovePackageFiles
raise Exception("Cannot remove file %s" % path)
Exception: Cannot remove file /tmp

[2022/03/23 13:59:11] (DEBUG) freenasOS.Update.RunCommand():254 - RunCommand(/sbin/umount, ['-f', '/tmp/tmp2167byli/dev'])
[2022/03/23 13:59:11] (DEBUG) freenasOS.Update.RunCommand():254 - RunCommand(/sbin/umount, ['-f', '/tmp/tmp2167byli/var/tmp'])
[2022/03/23 13:59:11] (DEBUG) freenasOS.Update.RunCommand():254 - RunCommand(/usr/local/sbin/beadm, ['unmount', '-f', '11.3-U5'])
[2022/03/23 13:59:11] (DEBUG) freenasOS.Update.modified_call():105 - Unmounted successfully
[2022/03/23 13:59:12] (DEBUG) freenasOS.Update.RunCommand():254 - RunCommand(/usr/local/sbin/beadm, ['destroy', '-F', '11.3-U5'])
[2022/03/23 13:59:12] (DEBUG) freenasOS.Update.modified_call():105 - Destroyed successfully
 

TranceKat

Dabbler
Joined
Feb 17, 2020
Messages
21
Found the solution for this issue. There has to be a link between /tmp and /var/tmp
Code:
# ln -isv /var/tmp /tmp

Reran the upgrade and it went through without issue.
 
Top