I have two servers running TrueNas-Scale-12.12.0 and receiving the afore mentioned error when I try to run a replication task.
Here is log of error I am receiving on the task:
[2022/12/30 11:03:26] INFO [Thread-32] [zettarepl.paramiko.replication_task__task_1] Connected (version 2.0, client OpenSSH_8.4p1)
[2022/12/30 11:03:26] INFO [Thread-32] [zettarepl.paramiko.replication_task__task_1] Authentication (publickey) successful!
[2022/12/30 11:03:27] INFO [replication_task__task_1] [zettarepl.replication.pre_retention] Pre-retention destroying snapshots: []
[2022/12/30 11:03:27] INFO [replication_task__task_1] [zettarepl.replication.run] For replication task 'task_1': doing push from 'BabyYoda' to 'Skywalker/Backup' of snapshot='auto-2022-12-29_00-00' incremental_base=None include_intermediate=False receive_resume_token=None encryption=False
[2022/12/30 11:03:28] WARNING [replication_task__task_1] [zettarepl.replication.run] For task 'task_1' at attempt 1 recoverable replication error RecoverableReplicationError('cannot receive new filesystem stream: permission denied\nBroken pipe.')
[2022/12/30 11:03:28] INFO [replication_task__task_1] [zettarepl.replication.run] After recoverable error sleeping for 1 seconds
[2022/12/30 11:03:29] INFO [replication_task__task_1] [zettarepl.replication.pre_retention] Pre-retention destroying snapshots: []
[2022/12/30 11:03:29] INFO [replication_task__task_1] [zettarepl.replication.run] For replication task 'task_1': doing push from 'BabyYoda' to 'Skywalker/Backup' of snapshot='auto-2022-12-29_00-00' incremental_base=None include_intermediate=False receive_resume_token=None encryption=False
[2022/12/30 11:03:30] WARNING [replication_task__task_1] [zettarepl.replication.run] For task 'task_1' at attempt 2 recoverable replication error RecoverableReplicationError('cannot receive new filesystem stream: permission denied\nBroken pipe.')
[2022/12/30 11:03:30] INFO [replication_task__task_1] [zettarepl.replication.run] After recoverable error sleeping for 2 seconds
[2022/12/30 11:03:32] INFO [replication_task__task_1] [zettarepl.replication.pre_retention] Pre-retention destroying snapshots: []
[2022/12/30 11:03:32] INFO [replication_task__task_1] [zettarepl.replication.run] For replication task 'task_1': doing push from 'BabyYoda' to 'Skywalker/Backup' of snapshot='auto-2022-12-29_00-00' incremental_base=None include_intermediate=False receive_resume_token=None encryption=False
[2022/12/30 11:03:33] WARNING [replication_task__task_1] [zettarepl.replication.run] For task 'task_1' at attempt 3 recoverable replication error RecoverableReplicationError('cannot receive new filesystem stream: permission denied\nBroken pipe.')
[2022/12/30 11:03:33] INFO [replication_task__task_1] [zettarepl.replication.run] After recoverable error sleeping for 4 seconds
[2022/12/30 11:03:38] INFO [replication_task__task_1] [zettarepl.replication.pre_retention] Pre-retention destroying snapshots: []
[2022/12/30 11:03:38] INFO [replication_task__task_1] [zettarepl.replication.run] For replication task 'task_1': doing push from 'BabyYoda' to 'Skywalker/Backup' of snapshot='auto-2022-12-29_00-00' incremental_base=None include_intermediate=False receive_resume_token=None encryption=False
[2022/12/30 11:03:38] WARNING [replication_task__task_1] [zettarepl.replication.run] For task 'task_1' at attempt 4 recoverable replication error RecoverableReplicationError('cannot receive new filesystem stream: permission denied\nBroken pipe.')
[2022/12/30 11:03:38] INFO [replication_task__task_1] [zettarepl.replication.run] After recoverable error sleeping for 8 seconds
[2022/12/30 11:03:47] INFO [replication_task__task_1] [zettarepl.replication.pre_retention] Pre-retention destroying snapshots: []
[2022/12/30 11:03:47] INFO [replication_task__task_1] [zettarepl.replication.run] For replication task 'task_1': doing push from 'BabyYoda' to 'Skywalker/Backup' of snapshot='auto-2022-12-29_00-00' incremental_base=None include_intermediate=False receive_resume_token=None encryption=False
[2022/12/30 11:03:48] WARNING [replication_task__task_1] [zettarepl.replication.run] For task 'task_1' at attempt 5 recoverable replication error RecoverableReplicationError('cannot receive new filesystem stream: permission denied\nBroken pipe.')
[2022/12/30 11:03:48] ERROR [replication_task__task_1] [zettarepl.replication.run] Failed replication task 'task_1' after 5 retries
Here is what I have in var/log/auth.log - I have masked the key:
Dec 30 11:02:57 shadow sshd[857969]: Accepted publickey for admin from 10.10.1.1 port 54906 ssh2: RSA SHA256:XXXXX
Dec 30 11:03:26 shadow sshd[858217]: Accepted publickey for admin from 10.10.1.1 port 59712 ssh2: RSA SHA256:XXXXX
Dec 30 11:03:27 shadow sshd[858231]: Accepted publickey for admin from 10.10.1.1 port 59720 ssh2: RSA SHA256:XXXXX
Dec 30 11:03:27 shadow sshd[858233]: Received disconnect from 10.10.1.1 port 59720:11: disconnected by user
The one log states there is a permission problem yet the other log appears to show permission given.
I am confident this is a simple issue and I am overlooking some minor detail. Appreciate any insight anyone would have toward a resolution.
Here is log of error I am receiving on the task:
[2022/12/30 11:03:26] INFO [Thread-32] [zettarepl.paramiko.replication_task__task_1] Connected (version 2.0, client OpenSSH_8.4p1)
[2022/12/30 11:03:26] INFO [Thread-32] [zettarepl.paramiko.replication_task__task_1] Authentication (publickey) successful!
[2022/12/30 11:03:27] INFO [replication_task__task_1] [zettarepl.replication.pre_retention] Pre-retention destroying snapshots: []
[2022/12/30 11:03:27] INFO [replication_task__task_1] [zettarepl.replication.run] For replication task 'task_1': doing push from 'BabyYoda' to 'Skywalker/Backup' of snapshot='auto-2022-12-29_00-00' incremental_base=None include_intermediate=False receive_resume_token=None encryption=False
[2022/12/30 11:03:28] WARNING [replication_task__task_1] [zettarepl.replication.run] For task 'task_1' at attempt 1 recoverable replication error RecoverableReplicationError('cannot receive new filesystem stream: permission denied\nBroken pipe.')
[2022/12/30 11:03:28] INFO [replication_task__task_1] [zettarepl.replication.run] After recoverable error sleeping for 1 seconds
[2022/12/30 11:03:29] INFO [replication_task__task_1] [zettarepl.replication.pre_retention] Pre-retention destroying snapshots: []
[2022/12/30 11:03:29] INFO [replication_task__task_1] [zettarepl.replication.run] For replication task 'task_1': doing push from 'BabyYoda' to 'Skywalker/Backup' of snapshot='auto-2022-12-29_00-00' incremental_base=None include_intermediate=False receive_resume_token=None encryption=False
[2022/12/30 11:03:30] WARNING [replication_task__task_1] [zettarepl.replication.run] For task 'task_1' at attempt 2 recoverable replication error RecoverableReplicationError('cannot receive new filesystem stream: permission denied\nBroken pipe.')
[2022/12/30 11:03:30] INFO [replication_task__task_1] [zettarepl.replication.run] After recoverable error sleeping for 2 seconds
[2022/12/30 11:03:32] INFO [replication_task__task_1] [zettarepl.replication.pre_retention] Pre-retention destroying snapshots: []
[2022/12/30 11:03:32] INFO [replication_task__task_1] [zettarepl.replication.run] For replication task 'task_1': doing push from 'BabyYoda' to 'Skywalker/Backup' of snapshot='auto-2022-12-29_00-00' incremental_base=None include_intermediate=False receive_resume_token=None encryption=False
[2022/12/30 11:03:33] WARNING [replication_task__task_1] [zettarepl.replication.run] For task 'task_1' at attempt 3 recoverable replication error RecoverableReplicationError('cannot receive new filesystem stream: permission denied\nBroken pipe.')
[2022/12/30 11:03:33] INFO [replication_task__task_1] [zettarepl.replication.run] After recoverable error sleeping for 4 seconds
[2022/12/30 11:03:38] INFO [replication_task__task_1] [zettarepl.replication.pre_retention] Pre-retention destroying snapshots: []
[2022/12/30 11:03:38] INFO [replication_task__task_1] [zettarepl.replication.run] For replication task 'task_1': doing push from 'BabyYoda' to 'Skywalker/Backup' of snapshot='auto-2022-12-29_00-00' incremental_base=None include_intermediate=False receive_resume_token=None encryption=False
[2022/12/30 11:03:38] WARNING [replication_task__task_1] [zettarepl.replication.run] For task 'task_1' at attempt 4 recoverable replication error RecoverableReplicationError('cannot receive new filesystem stream: permission denied\nBroken pipe.')
[2022/12/30 11:03:38] INFO [replication_task__task_1] [zettarepl.replication.run] After recoverable error sleeping for 8 seconds
[2022/12/30 11:03:47] INFO [replication_task__task_1] [zettarepl.replication.pre_retention] Pre-retention destroying snapshots: []
[2022/12/30 11:03:47] INFO [replication_task__task_1] [zettarepl.replication.run] For replication task 'task_1': doing push from 'BabyYoda' to 'Skywalker/Backup' of snapshot='auto-2022-12-29_00-00' incremental_base=None include_intermediate=False receive_resume_token=None encryption=False
[2022/12/30 11:03:48] WARNING [replication_task__task_1] [zettarepl.replication.run] For task 'task_1' at attempt 5 recoverable replication error RecoverableReplicationError('cannot receive new filesystem stream: permission denied\nBroken pipe.')
[2022/12/30 11:03:48] ERROR [replication_task__task_1] [zettarepl.replication.run] Failed replication task 'task_1' after 5 retries
Here is what I have in var/log/auth.log - I have masked the key:
Dec 30 11:02:57 shadow sshd[857969]: Accepted publickey for admin from 10.10.1.1 port 54906 ssh2: RSA SHA256:XXXXX
Dec 30 11:03:26 shadow sshd[858217]: Accepted publickey for admin from 10.10.1.1 port 59712 ssh2: RSA SHA256:XXXXX
Dec 30 11:03:27 shadow sshd[858231]: Accepted publickey for admin from 10.10.1.1 port 59720 ssh2: RSA SHA256:XXXXX
Dec 30 11:03:27 shadow sshd[858233]: Received disconnect from 10.10.1.1 port 59720:11: disconnected by user
The one log states there is a permission problem yet the other log appears to show permission given.
I am confident this is a simple issue and I am overlooking some minor detail. Appreciate any insight anyone would have toward a resolution.