SOLVED More replication problems - cannot receive incremental stream: dataset is busy.

[adrianwi]

I'd hoped 11.3-U4 had fixed my replication issues, and I think it had, but applying 4.1 has given me a new error.

I'm just trying to recursively replicate the iocage dataset on 1 machine to another (both running 11.3-U4.1 so I have a backup of all my jails, but have the following errors:

Code:

send from @auto-2020-07-31_00-00 to APEpool0s/iocage/jails/calibre@auto-2020-08-01_00-00 estimated size is 26.6K
send from @auto-2020-07-31_00-00 to APEpool0s/iocage/jails/calibre@auto-2020-08-01_00-00 estimated size is 26.6K
cannot receive incremental stream: dataset is busy.

Code:

[2020/08/01 00:00:07] INFO     [Thread-568] [zettarepl.paramiko.replication_task__task_47] Connected (version 2.0, client OpenSSH_8.0-hpn14v15)
[2020/08/01 00:00:07] INFO     [Thread-568] [zettarepl.paramiko.replication_task__task_47] Authentication (publickey) successful!
[2020/08/01 00:00:30] INFO     [replication_task__task_47] [zettarepl.replication.run] For replication task 'task_47': doing push from 'APEpool0s/iocage' to 'APEpool1/iocage' of snapshot='auto-2020-08-01_00-00' incremental_base='auto-2020-07-31_00-00' receive_resume_token=None
[2020/08/01 00:03:59] INFO     [replication_task__task_47] [zettarepl.replication.run] For replication task 'task_47': doing push from 'APEpool0s/iocage/download' to 'APEpool1/iocage/download' of snapshot='auto-2020-08-01_00-00' incremental_base='auto-2020-07-31_00-00' receive_resume_token=None
[2020/08/01 00:04:15] INFO     [replication_task__task_47] [zettarepl.replication.run] For replication task 'task_47': doing push from 'APEpool0s/iocage/download/11.1-RELEASE' to 'APEpool1/iocage/download/11.1-RELEASE' of snapshot='auto-2020-08-01_00-00' incremental_base='auto-2020-07-31_00-00' receive_resume_token=None
[2020/08/01 00:04:23] INFO     [replication_task__task_47] [zettarepl.replication.run] For replication task 'task_47': doing push from 'APEpool0s/iocage/download/11.2-RELEASE' to 'APEpool1/iocage/download/11.2-RELEASE' of snapshot='auto-2020-08-01_00-00' incremental_base='auto-2020-07-31_00-00' receive_resume_token=None
[2020/08/01 00:04:31] INFO     [replication_task__task_47] [zettarepl.replication.run] For replication task 'task_47': doing push from 'APEpool0s/iocage/download/11.3-RELEASE' to 'APEpool1/iocage/download/11.3-RELEASE' of snapshot='auto-2020-08-01_00-00' incremental_base='auto-2020-07-31_00-00' receive_resume_token=None
[2020/08/01 00:04:38] INFO     [replication_task__task_47] [zettarepl.replication.run] For replication task 'task_47': doing push from 'APEpool0s/iocage/images' to 'APEpool1/iocage/images' of snapshot='auto-2020-08-01_00-00' incremental_base='auto-2020-07-31_00-00' receive_resume_token=None
[2020/08/01 00:04:46] INFO     [replication_task__task_47] [zettarepl.replication.run] For replication task 'task_47': doing push from 'APEpool0s/iocage/jails' to 'APEpool1/iocage/jails' of snapshot='auto-2020-08-01_00-00' incremental_base='auto-2020-07-31_00-00' receive_resume_token=None
[2020/08/01 00:05:57] INFO     [replication_task__task_47] [zettarepl.replication.run] For replication task 'task_47': doing push from 'APEpool0s/iocage/jails/airsonic' to 'APEpool1/iocage/jails/airsonic' of snapshot='auto-2020-08-01_00-00' incremental_base='auto-2020-07-31_00-00' receive_resume_token=None
... 15 more lines ...
    raise self.process_exception
  File "/usr/local/lib/python3.7/site-packages/zettarepl/replication/process_runner.py", line 37, in _wait_process
    self.replication_process.wait()
  File "/usr/local/lib/python3.7/site-packages/zettarepl/transport/ssh.py", line 146, in wait
    self.async_exec.wait()
  File "/usr/local/lib/python3.7/site-packages/zettarepl/transport/async_exec_tee.py", line 100, in wait
    raise ExecException(exit_event.returncode, self.output)
zettarepl.transport.interface.ExecException: send from @auto-2020-07-31_00-00 to APEpool0s/iocage/jails/calibre@auto-2020-08-01_00-00 estimated size is 26.6K
send from @auto-2020-07-31_00-00 to APEpool0s/iocage/jails/calibre@auto-2020-08-01_00-00 estimated size is 26.6K
cannot receive incremental stream: dataset is busy

Is this another bug?

 

[adrianwi]

Not sure what the problem was, but after a few days of the error message I now have all the Tasks and Periodic Snapshots showing as 'Finished' so replication appears to be fixed again