Replication stuck

[altano]

Hello,

I've been trying to get replication of a pool to a remote server working and I keep hitting roadblocks (like this guy). My current issue: the replication stalled. In the Replication Tasks UI it says it is running but it hasn't made progress in over a week. I can see in Task Manager that there's a "replication.run" still running but there are past runs that failed, and I can see the error logs for those.

The replication task config:

The errors:

Code:

[2021/09/15 15:52:16] INFO     [Thread-50] [zettarepl.paramiko.replication_task__task_1] Connected (version 2.0, client OpenSSH_8.4-hpn14v15)
[2021/09/15 15:52:16] INFO     [Thread-50] [zettarepl.paramiko.replication_task__task_1] Authentication (publickey) successful!
[2021/09/15 15:52:22] INFO     [replication_task__task_1] [zettarepl.replication.run] For replication task 'task_1': doing push from 'tank' to 'backup/holodeck4-tank' of snapshot='auto-2021-09-11_17-00' incremental_base='auto-2021-09-11_16-00' receive_resume_token=None encryption=False
[2021/09/15 19:21:26] ERROR    [replication_task__task_1] [zettarepl.replication.run] For task 'task_1' unhandled replication error ExecException(1, "Warning: backup/holodeck4-tank/root/truenas-VMs/pbs: property 'sharenfs' does not apply to datasets of this type\nWarning: backup/holodeck4-tank/root/truenas-VMs/pbs: property 'mountpoint' does not apply to datasets of this type\nWarning: backup/holodeck4-tank/root/truenas-VMs/pbs: property 'sharesmb' does not apply to datasets of this type\ncannot receive incremental stream: destination 'backup/holodeck4-tank/root/videos' does not exist\n")
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/zettarepl/replication/run.py", line 163, in run_replication_tasks
    retry_stuck_replication(
  File "/usr/local/lib/python3.9/site-packages/zettarepl/replication/stuck.py", line 18, in retry_stuck_replication
    return func()
  File "/usr/local/lib/python3.9/site-packages/zettarepl/replication/run.py", line 164, in <lambda>
    lambda: run_replication_task_part(replication_task, source_dataset, src_context, dst_context,
  File "/usr/local/lib/python3.9/site-packages/zettarepl/replication/run.py", line 257, in run_replication_task_part
    run_replication_steps(step_templates, observer)
  File "/usr/local/lib/python3.9/site-packages/zettarepl/replication/run.py", line 586, in run_replication_steps
    replicate_snapshots(step_template, incremental_base, snapshots, encryption, observer)
  File "/usr/local/lib/python3.9/site-packages/zettarepl/replication/run.py", line 637, in replicate_snapshots
    run_replication_step(step, observer)
  File "/usr/local/lib/python3.9/site-packages/zettarepl/replication/run.py", line 714, in run_replication_step
    ReplicationProcessRunner(process, monitor).run()
  File "/usr/local/lib/python3.9/site-packages/zettarepl/replication/process_runner.py", line 33, in run
    raise self.process_exception
  File "/usr/local/lib/python3.9/site-packages/zettarepl/replication/process_runner.py", line 37, in _wait_process
    self.replication_process.wait()
  File "/usr/local/lib/python3.9/site-packages/zettarepl/transport/ssh.py", line 151, in wait
    stdout = self.async_exec.wait()
  File "/usr/local/lib/python3.9/site-packages/zettarepl/transport/async_exec_tee.py", line 103, in wait
    raise ExecException(exit_event.returncode, self.output)
zettarepl.transport.interface.ExecException: Warning: backup/holodeck4-tank/root/truenas-VMs/pbs: property 'sharenfs' does not apply to datasets of this type
Warning: backup/holodeck4-tank/root/truenas-VMs/pbs: property 'mountpoint' does not apply to datasets of this type
Warning: backup/holodeck4-tank/root/truenas-VMs/pbs: property 'sharesmb' does not apply to datasets of this type
cannot receive incremental stream: destination 'backup/holodeck4-tank/root/videos' does not exist

I believe the last line about the destination not existing is the error that killed the replication. I can confirm with zfs list that the dataset mentioned does not exist on the destination. Why is this one dataset not being automatically created? I didn't create any of the others manually and the backup should obviously handle that.