replication failure, cannot unmount '/var/db/system/samba4': pool or dataset is busy

[john60]

I am trying to replicate from 192.168.1.80 (primary nas) to 192.168.1.90 (backup nas).
I deleted pool (backup-14TB-z2) on xxx.90, replaced disks, and created a new pool backup-60TB-z2 on xxx.90
On xxx.80,
- Edited existing replication and replaced 14TB with 60TB and it failed when i tried to run it.
- So, I deleted my old replication task and created a new one, but it is still failing with the following logs:

[2023/08/24 16:53:41] INFO [Thread-666] [zettarepl.paramiko.replication_task__task_2] Connected (version 2.0, client OpenSSH_8.4p1)
[2023/08/24 16:53:41] INFO [Thread-666] [zettarepl.paramiko.replication_task__task_2] Authentication (publickey) successful!
[2023/08/24 16:53:47] INFO [replication_task__task_2] [zettarepl.replication.pre_retention] Pre-retention destroying snapshots: []
[2023/08/24 16:53:48] INFO [replication_task__task_2] [zettarepl.replication.run] For replication task 'task_2': doing push from 'jjg-14TB-z2' to 'backup-60TB-z2' of snapshot='auto-2022-01-06_09-36' incremental_base=None include_intermediate=False receive_resume_token=None encryption=False
[2023/08/24 16:53:48] ERROR [replication_task__task_2] [zettarepl.replication.run] For task 'task_2' unhandled replication error ExecException(1, "cannot unmount '/var/db/system/samba4': pool or dataset is busy\n")
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/zettarepl/replication/run.py", line 181, in run_replication_tasks
retry_contains_partially_complete_state(
File "/usr/lib/python3/dist-packages/zettarepl/replication/partially_complete_state.py", line 16, in retry_contains_partially_complete_state
return func()
... 9 more lines ...
ReplicationProcessRunner(process, monitor).run()
File "/usr/lib/python3/dist-packages/zettarepl/replication/process_runner.py", line 33, in run
raise self.process_exception
File "/usr/lib/python3/dist-packages/zettarepl/replication/process_runner.py", line 37, in _wait_process
self.replication_process.wait()
File "/usr/lib/python3/dist-packages/zettarepl/transport/ssh.py", line 159, in wait
stdout = self.async_exec.wait()
File "/usr/lib/python3/dist-packages/zettarepl/transport/async_exec_tee.py", line 104, in wait
raise ExecException(exit_event.returncode, self.output)
zettarepl.transport.interface.ExecException: cannot unmount '/var/db/system/samba4': pool or dataset is busy

Could someone offer a suggestion on what to do next?

The error message is kind of suggesting i need to shut something down, I never did this before.
Previously, I would power up the xxx.90 when I wanted to do a backup from xxx.80 to xx.90 and either let the replication run from xxx.80 on its schedule or I would force it from xxx.80.

Did I miss configure the xxx.90 ?
Version:
TrueNAS-SCALE-22.12.2

 

[john60]

on level1 forum a similar problem was solved by "I move the system data from the nas drives to my array of boot ssds and it has solved the problem".

So where in the truenas scale is the "system data" location listed and how do i change this location?

root@truenas90[~]# df /data
Filesystem 1K-blocks Used Available Use% Mounted on
boot-pool/ROOT/22.12.0 28929024 2748544 26180480 10% /

So i suspect this is not the problem.

 

[john60]

Looks like there is a bug. A reboot is needed after deleting a pool and replacing with a new pool.