I'm getting a series of errors from the middlewares:
This makes the middleware almost unreachable or extremely slow
Code:
Sep 24 01:28:44 freenas 1 2021-09-24T01:28:43.869720-05:00 freenas.gohilton.com collectd 4495 - - Timeout collecting disk temperatures
Sep 24 02:38:36 freenas 1 2021-09-24T02:38:36.431910-05:00 freenas.gohilton.com collectd 4495 - - Timeout collecting disk temperatures
Sep 24 03:45:50 freenas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 1179801, size: 12288
Sep 24 04:06:51 freenas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 685158, size: 8192
Sep 24 04:16:24 freenas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 1185596, size: 20480
Sep 24 04:20:03 freenas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 662275, size: 12288
Sep 24 04:28:57 freenas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 1329289, size: 12288
Sep 24 04:28:57 freenas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 1321851, size: 4096
Sep 24 04:30:53 freenas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 220546, size: 12288
Sep 24 04:36:29 freenas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 578817, size: 4096
Sep 24 05:10:27 freenas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 1349542, size: 32768
Sep 24 05:11:21 freenas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 266777, size: 20480
Sep 24 05:11:45 freenas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 1341077, size: 16384
Sep 24 05:18:45 freenas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 293880, size: 4096
Sep 24 05:22:29 freenas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 1341880, size: 20480
Sep 24 05:22:52 freenas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 1354295, size: 8192
Sep 24 05:30:30 freenas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 826570, size: 8192
Sep 24 05:35:54 freenas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 233123, size: 4096
Sep 24 06:10:20 freenas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 803181, size: 28672
Sep 24 06:47:52 freenas 1 2021-09-24T06:47:48.655539-05:00 freenas.gohilton.com collectd 4495 - - Traceback (most recent call last):
File "/usr/local/lib/collectd_pyplugins/disktemp.py", line 62, in read
with Client() as c:
File "/usr/local/lib/python3.9/site-packages/middlewared/client/client.py", line 282, in __init__
self._ws.connect()
File "/usr/local/lib/python3.9/site-packages/middlewared/client/client.py", line 124, in connect
rv = super(WSClient, self).connect()
File "/usr/local/lib/python3.9/site-packages/ws4py/client/__init__.py", line 223, in connect
bytes = self.sock.recv(128)
socket.timeout: timed out
Sep 24 06:50:42 freenas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 1055034, size: 16384
Sep 24 06:54:56 freenas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 266799, size: 4096
Sep 24 06:56:44 freenas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 1190528, size: 8192
Sep 24 07:10:48 freenas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 153741, size: 65536
Sep 24 07:37:47 freenas 1 2021-09-24T07:37:47.847711-05:00 freenas.gohilton.com collectd 4495 - - Traceback (most recent call last):
File "/usr/local/lib/collectd_pyplugins/disktemp.py", line 62, in read
with Client() as c:
File "/usr/local/lib/python3.9/site-packages/middlewared/client/client.py", line 282, in __init__
self._ws.connect()
File "/usr/local/lib/python3.9/site-packages/middlewared/client/client.py", line 124, in connect
rv = super(WSClient, self).connect()
File "/usr/local/lib/python3.9/site-packages/ws4py/client/__init__.py", line 223, in connect
bytes = self.sock.recv(128)
socket.timeout: timed out
Sep 24 07:39:26 freenas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 1309857, size: 4096
Sep 24 08:17:36 freenas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 164172, size: 16384
Sep 24 08:25:23 freenas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 329781, size: 36864
Sep 24 08:27:50 freenas 1 2021-09-24T08:27:50.094941-05:00 freenas.gohilton.com collectd 4495 - - Traceback (most recent call last):
File "/usr/local/lib/collectd_pyplugins/disktemp.py", line 62, in read
with Client() as c:
File "/usr/local/lib/python3.9/site-packages/middlewared/client/client.py", line 282, in __init__
self._ws.connect()
File "/usr/local/lib/python3.9/site-packages/middlewared/client/client.py", line 124, in connect
rv = super(WSClient, self).connect()
File "/usr/local/lib/python3.9/site-packages/ws4py/client/__init__.py", line 223, in connect
bytes = self.sock.recv(128)
socket.timeout: timed out
Sep 24 08:32:15 freenas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 1371467, size: 65536
Sep 24 08:32:46 freenas 1 2021-09-24T08:32:46.209820-05:00 freenas.gohilton.com collectd 4495 - - Traceback (most recent call last):
File "/usr/local/lib/collectd_pyplugins/disktemp.py", line 62, in read
with Client() as c:
File "/usr/local/lib/python3.9/site-packages/middlewared/client/client.py", line 282, in __init__
self._ws.connect()
File "/usr/local/lib/python3.9/site-packages/middlewared/client/client.py", line 124, in connect
rv = super(WSClient, self).connect()
File "/usr/local/lib/python3.9/site-packages/ws4py/client/__init__.py", line 223, in connect
bytes = self.sock.recv(128)
socket.timeout: timed out
Sep 24 08:38:49 freenas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 823647, size: 57344
This makes the middleware almost unreachable or extremely slow
