Silverstar24
Dabbler
- Joined
- Jan 22, 2020
- Messages
- 11
Hi
I run into an ZFS replication error. Since a few day I got the following error during ZFS Replication PULL Job's.
It looks like a connection issue but I change nothing on this configuration and PUSH replications work fine. SSH login on the system works so I can connect to the root user with out username and password (public key).
Now it tried the following things:
- Update both NAS to TrueNAS 13 U3.1
- Delete all snapshot's on both NAS
- Scrub source and destination pool
- Delete one of the Datasets in the destination NAS and start from scratch.
But nothing helps. Any ideas?
The Log:
I run into an ZFS replication error. Since a few day I got the following error during ZFS Replication PULL Job's.
truenas zfs replication Timeout in head().
It looks like a connection issue but I change nothing on this configuration and PUSH replications work fine. SSH login on the system works so I can connect to the root user with out username and password (public key).
Now it tried the following things:
- Update both NAS to TrueNAS 13 U3.1
- Delete all snapshot's on both NAS
- Scrub source and destination pool
- Delete one of the Datasets in the destination NAS and start from scratch.
But nothing helps. Any ideas?
The Log:
[2022/11/28 20:04:49] INFO [Thread-13] [zettarepl.paramiko.replication_task__task_26] Connected (version 2.0, client OpenSSH_8.8-hpn14v15)
[2022/11/28 20:04:49] INFO [Thread-13] [zettarepl.paramiko.replication_task__task_26] Authentication (publickey) successful!
[2022/11/28 20:04:50] INFO [replication_task__task_26] [zettarepl.replication.pre_retention] Pre-retention destroying snapshots: []
[2022/11/28 20:04:50] INFO [replication_task__task_26] [zettarepl.replication.run] For replication task 'task_26': doing pull from 'ERB_Pool/xxx' to 'NUN_DATA2_Pool/xxx' of snapshot='auto-2022-11-28_20-03-2m' incremental_base=None receive_resume_token=None encryption=False
[2022/11/28 20:05:00] WARNING [replication_task__task_26] [zettarepl.replication.run] For task 'task_26' at attempt 1 recoverable replication error RecoverableReplicationError('Timeout in head()')
[2022/11/28 20:05:00] INFO [replication_task__task_26] [zettarepl.replication.run] After recoverable error sleeping for 1 seconds
[2022/11/28 20:05:01] INFO [replication_task__task_26] [zettarepl.replication.pre_retention] Pre-retention destroying snapshots: []
[2022/11/28 20:05:01] INFO [replication_task__task_26] [zettarepl.replication.run] For replication task 'task_26': doing pull from 'ERB_Pool/xxx' to 'NUN_DATA2_Pool/xxx' of snapshot='auto-2022-11-28_20-03-2m' incremental_base=None receive_resume_token=None encryption=False
[2022/11/28 20:05:11] WARNING [replication_task__task_26] [zettarepl.replication.run] For task 'task_26' at attempt 2 recoverable replication error RecoverableReplicationError('Timeout in head()')
[2022/11/28 20:05:11] INFO [replication_task__task_26] [zettarepl.replication.run] After recoverable error sleeping for 2 seconds
... 2 more lines ...
[2022/11/28 20:05:24] WARNING [replication_task__task_26] [zettarepl.replication.run] For task 'task_26' at attempt 3 recoverable replication error RecoverableReplicationError('Timeout in head()')
[2022/11/28 20:05:24] INFO [replication_task__task_26] [zettarepl.replication.run] After recoverable error sleeping for 4 seconds
[2022/11/28 20:05:29] INFO [replication_task__task_26] [zettarepl.replication.pre_retention] Pre-retention destroying snapshots: []
[2022/11/28 20:05:29] INFO [replication_task__task_26] [zettarepl.replication.run] For replication task 'task_26': doing pull from 'ERB_Pool/xxx' to 'NUN_DATA2_Pool/xxx' of snapshot='auto-2022-11-28_20-03-2m' incremental_base=None receive_resume_token=None encryption=False
[2022/11/28 20:05:39] WARNING [replication_task__task_26] [zettarepl.replication.run] For task 'task_26' at attempt 4 recoverable replication error RecoverableReplicationError('Timeout in head()')
[2022/11/28 20:05:39] INFO [replication_task__task_26] [zettarepl.replication.run] After recoverable error sleeping for 8 seconds
[2022/11/28 20:05:47] INFO [replication_task__task_26] [zettarepl.replication.pre_retention] Pre-retention destroying snapshots: []
[2022/11/28 20:05:47] INFO [replication_task__task_26] [zettarepl.replication.run] For replication task 'task_26': doing pull from 'ERB_Pool/xxx' to 'NUN_DATA2_Pool/xxx' of snapshot='auto-2022-11-28_20-03-2m' incremental_base=None receive_resume_token=None encryption=False
[2022/11/28 20:05:57] WARNING [replication_task__task_26] [zettarepl.replication.run] For task 'task_26' at attempt 5 recoverable replication error RecoverableReplicationError('Timeout in head()')
[2022/11/28 20:05:57] ERROR [replication_task__task_26] [zettarepl.replication.run] Failed replication task 'task_26' after 5 retries