Register for the iXsystems Community to get an ad-free experience and exclusive discounts in our eBay Store.

iocage list is very slow after upgrade to FN-11.3-RC1

ornias

Neophyte Sage
Joined
Mar 6, 2020
Messages
624
Ok but I'm running 11.3-U1 and still see the dramatic slowdowns if I have a large number of snapshots on my system.
You call that a dramatic slowdown? Meet 11.3 (non-u), which could be 3-4 MINUTES based on snapshots.
 

Patrick M. Hausen

Dedicated Sage
Joined
Nov 25, 2013
Messages
2,208
Well there's still room for improvement, isn't it?
Code:
root@freenas-pmh[~]# time iocage list
+-----+-----------+-------+--------------+---------------+
| JID |   NAME    | STATE |   RELEASE    |      IP4      |
+=====+===========+=======+==============+===============+
| 5   | gitea     | up    | 11.3-RELEASE | 192.168.93.51 |
+-----+-----------+-------+--------------+---------------+
| 6   | grafana   | up    | 11.3-RELEASE | 192.168.93.56 |
+-----+-----------+-------+--------------+---------------+
| 4   | guacamole | up    | 11.3-RELEASE | 192.168.93.52 |
+-----+-----------+-------+--------------+---------------+
| 7   | monit     | up    | 11.3-RELEASE | 192.168.93.55 |
+-----+-----------+-------+--------------+---------------+
| 3   | nextcloud | up    | 11.3-RELEASE | 192.168.93.53 |
+-----+-----------+-------+--------------+---------------+
| 1   | openvpn   | up    | 11.3-RELEASE | 192.168.93.54 |
+-----+-----------+-------+--------------+---------------+
| 2   | proxy     | up    | 11.3-RELEASE | 192.168.93.50 |
+-----+-----------+-------+--------------+---------------+
iocage list  1.62s user 8.86s system 92% cpu 11.347 total
root@freenas-pmh[~]# zfs list -t snap -r hdd/iocage/jails | wc -l
    5026


But performance in real production environments is an ongoing iocage topic it seems ...

Patrick
 

ornias

Neophyte Sage
Joined
Mar 6, 2020
Messages
624
But performance in real production environments is an ongoing iocage topic it seems ...

Patrick
There primarily seem to be a lot of issues based on how iocage also tries to deal with snapshotting a lot...
This 11.3non-u performance issues where due to iocage also trying to read ALL snapshots for ALL jails every list command and to be frankfully honest, they where quite arogant about it...

So I share your doubts about it being being ready for production performance wise...
 

Patrick M. Hausen

Dedicated Sage
Joined
Nov 25, 2013
Messages
2,208
We based our "proServer" hosting environment on iocage and have been struggling with performance ever since, unfortunately. OTOH the tool is quite capable and we have yet to find a suitable replacement. Creating an ansible module that understands jails and using just the base system would be one option. py-libiocage is another one.

Sometimes it was just ecosystem/middleware problems, for example we first diagnosed the problem with python rather stupidly closing all fd's from 3 to MAXFDS indivdually ... https://reviews.freebsd.org/D21627

And of course a system running hundreds of jails will have tens of thousands of snapshots - that's the point ;)

Patrick
 

Patrick M. Hausen

Dedicated Sage
Joined
Nov 25, 2013
Messages
2,208

ornias

Neophyte Sage
Joined
Mar 6, 2020
Messages
624
My architecture talk in Paris 2017:

Our product website:

English still being worked on, sorry.

Patrick
Skimmed through it a bit, going to watch the whole talk, seems interesting indeed...

Don't worry about english, if it was in german it would only be a good training to get my german freshed-up a bit ;)
 

BetYourBottom

Member
Joined
Nov 26, 2016
Messages
110
Same.
Iocage list is relatively fast taking only a second or two before displaying
Jails in the GUI takes much much longer 15 seconds or more.
 
Top