Most Efficient Way To Resume Replication After ~1 year

Dave Hob

Contributor
Joined
Jun 15, 2014
Messages
106
Hi

I have Truenas Core installed on both servers main and backup.

For whatever reason, I turned off the backup server for the past year or so.

I tried to continue the replication process (maybe started a new one) and I an error.

Looks like it has to do with the fact that there's no snapshot/replication at the moment on the backup that matches the main server.

What is the best approach at this point? Start fresh? Chatgpt proposed I send a snapshot to the backup?

To consider main is 4.68T and backup is 3.07T.

Is there any major pressure on the high reads on the main server disks if theres a lot of data like 1.5 -> 5T (considering to start fresh too)


The error I am getting:

Code:
Error
No incremental base on dataset 'FreeNasPool/EmaStorage' and replication from scratch is not allowed.
Logs
[2023/09/24 00:00:02] INFO     [Thread-27] [zettarepl.paramiko.replication_task__task_1] Connected (version 2.0, client OpenSSH_8.8-hpn14v15)
[2023/09/24 00:00:02] INFO     [Thread-27] [zettarepl.paramiko.replication_task__task_1] Authentication (publickey) successful!
[2023/09/24 00:00:02] INFO     [replication_task__task_1] [zettarepl.retention.calculate] Not destroying 'auto-2023-01-20_03-00' as it is the only snapshot left for naming schema 'auto-%Y-%m-%d_%H-%M'
[2023/09/24 00:00:02] INFO     [replication_task__task_1] [zettarepl.replication.pre_retention] Pre-retention destroying snapshots: [('Backup4EmaStorage/Ema_Storage_Backup', 'auto-2022-12-24_03-00'), ('Backup4EmaStorage/Ema_Storage_Backup', 'auto-2022-12-25_03-00'), ('Backup4EmaStorage/Ema_Storage_Backup', 'auto-2022-12-26_03-00'), ('Backup4EmaStorage/Ema_Storage_Backup', 'auto-2022-12-27_03-00'), ('Backup4EmaStorage/Ema_Storage_Backup', 'auto-2022-12-28_03-00'), ('Backup4EmaStorage/Ema_Storage_Backup', 'auto-2022-12-29_03-00'), ('Backup4EmaStorage/Ema_Storage_Backup', 'auto-2022-12-30_03-00'), ('Backup4EmaStorage/Ema_Storage_Backup', 'auto-2022-12-31_03-00'), ('Backup4EmaStorage/Ema_Storage_Backup', 'auto-2023-01-01_03-00'), ('Backup4EmaStorage/Ema_Storage_Backup', 'auto-2023-01-02_03-00'), ('Backup4EmaStorage/Ema_Storage_Backup', 'auto-2023-01-03_03-00'), ('Backup4EmaStorage/Ema_Storage_Backup', 'auto-2023-01-04_03-00'), ('Backup4EmaStorage/Ema_Storage_Backup', 'auto-2023-01-05_03-00'), ('Backup4EmaStorage/Ema_Storage_Backup', 'auto-2023-01-06_03-00'), ('Backup4EmaStorage/Ema_Storage_Backup', 'auto-2023-01-07_03-00'), ('Backup4EmaStorage/Ema_Storage_Backup', 'auto-2023-01-08_03-00'), ('Backup4EmaStorage/Ema_Storage_Backup', 'auto-2023-01-09_03-00'), ('Backup4EmaStorage/Ema_Storage_Backup', 'auto-2023-01-10_03-00'), ('Backup4EmaStorage/Ema_Storage_Backup', 'auto-2023-01-11_03-00'), ('Backup4EmaStorage/Ema_Storage_Backup', 'auto-2023-01-12_03-00'), ('Backup4EmaStorage/Ema_Storage_Backup', 'auto-2023-01-13_03-00'), ('Backup4EmaStorage/Ema_Storage_Backup', 'auto-2023-01-14_03-00'), ('Backup4EmaStorage/Ema_Storage_Backup', 'auto-2023-01-15_03-00'), ('Backup4EmaStorage/Ema_Storage_Backup', 'auto-2023-01-16_03-00'), ('Backup4EmaStorage/Ema_Storage_Backup', 'auto-2023-01-17_03-00'), ('Backup4EmaStorage/Ema_Storage_Backup', 'auto-2023-01-18_03-00')]
[2023/09/24 00:00:02] INFO     [replication_task__task_1] [zettarepl.snapshot.destroy] On )> for dataset 'Backup4EmaStorage/Ema_Storage_Backup' destroying snapshots {'auto-2023-01-01_03-00', 'auto-2023-01-09_03-00', 'auto-2023-01-15_03-00', 'auto-2022-12-24_03-00', 'auto-2023-01-04_03-00', 'auto-2023-01-17_03-00', 'auto-2023-01-10_03-00', 'auto-2023-01-03_03-00', 'auto-2022-12-29_03-00', 'auto-2022-12-25_03-00', 'auto-2023-01-18_03-00', 'auto-2023-01-06_03-00', 'auto-2023-01-08_03-00', 'auto-2023-01-07_03-00', 'auto-2023-01-02_03-00', 'auto-2022-12-26_03-00', 'auto-2023-01-11_03-00', 'auto-2023-01-16_03-00', 'auto-2022-12-27_03-00', 'auto-2022-12-30_03-00', 'auto-2023-01-13_03-00', 'auto-2022-12-28_03-00', 'auto-2023-01-05_03-00', 'auto-2023-01-14_03-00', 'auto-2023-01-12_03-00', 'auto-2022-12-31_03-00'}
[2023/09/24 00:00:05] ERROR    [replication_task__task_1] [zettarepl.replication.run] For task 'task_1' non-recoverable replication error NoIncrementalBaseReplicationError("No incremental base on dataset 'FreeNasPool/EmaStorage' and replication from scratch is not allowed")


These are the snapshots on the main truenas (relevant to the dataset that I care about: EmaStorage):

Code:
FreeNasPool/EmaStorage@auto-2023-09-10_03-00                       0B      -     3.50T  -
FreeNasPool/EmaStorage@auto-2023-09-11_03-00                       0B      -     3.50T  -
FreeNasPool/EmaStorage@auto-2023-09-12_03-00                       0B      -     3.50T  -
FreeNasPool/EmaStorage@auto-2023-09-13_03-00                       0B      -     3.50T  -
FreeNasPool/EmaStorage@auto-2023-09-14_03-00                       0B      -     3.50T  -
FreeNasPool/EmaStorage@auto-2023-09-15_03-00                       0B      -     3.50T  -
FreeNasPool/EmaStorage@auto-2023-09-16_03-00                       0B      -     3.50T  -
FreeNasPool/EmaStorage@auto-2023-09-17_03-00                       0B      -     3.50T  -
FreeNasPool/EmaStorage@auto-2023-09-18_03-00                    10.8M      -     3.68T  -
FreeNasPool/EmaStorage@auto-2023-09-19_03-00                     591K      -     4.06T  -
FreeNasPool/EmaStorage@auto-2023-09-20_03-00                    95.9K      -     4.06T  -
FreeNasPool/EmaStorage@auto-2023-09-21_03-00                     224K      -     4.06T  -
FreeNasPool/EmaStorage@auto-2023-09-22_03-00                    2.65M      -     4.39T  -
FreeNasPool/EmaStorage@auto-2023-09-23_03-00                    2.65M      -     4.39T  -
FreeNasPool/EmaStorage@auto-2023-09-24_00-00                    1.37M      -     4.62T  -


On the Backup Truenas we have this:

Code:
Backup4EmaStorage/Ema_Storage_Backup@auto-2023-01-20_03-00                  1.43G      -     3.03T  -


* there's some other .system/samba on both (not sure if they are relevant?). Including some ex:

on main server:

Code:
FreeNasPool/.system/samba4@wbc-1674151214                        432K      -      743K  -
FreeNasPool/.system/samba4@wbc-1674881050                        464K      -      759K  -
FreeNasPool/.system/samba4@wbc-1675753167                        432K      -      759K  -
FreeNasPool/.system/samba4@wbc-1675754563                        432K      -      759K  -
FreeNasPool/.system/samba4@wbc-1677863074                        480K      -      743K  -
FreeNasPool/.system/samba4@wbc-1679892686                        416K      -      727K  -
FreeNasPool/.system/samba4@update--2023-03-27-04-55--13.0-U3.1   288K      -      727K  -
FreeNasPool/.system/samba4@wbc-1679893281                        264K      -      727K  -
FreeNasPool/.system/samba4@update--2023-06-13-08-44--13.0-U4     456K      -      727K  -
FreeNasPool/.system/samba4@update--2023-08-13-19-08--13.0-U5.1   440K      -      711K  -


on backup server:

Code:
Backup4EmaStorage/.system/samba4@wbc-1634020734                              519K      -      911K  -
Backup4EmaStorage/.system/samba4@wbc-1635125472                              488K      -      895K  -
Backup4EmaStorage/.system/samba4@wbc-1635292098                              504K      -      911K  -
Backup4EmaStorage/.system/samba4@wbc-1640251185                              599K      -      991K  -
Backup4EmaStorage/.system/samba4@update--2022-07-12-23-33--SCALE-22.02.2     703K      -     1.10M  -
Backup4EmaStorage/.system/samba4@update--2022-08-09-16-32--SCALE-22.02.2.1   288K      -     1.12M  -
Backup4EmaStorage/.system/samba4@wbc-1660063023                              288K      -     1.12M  -
Backup4EmaStorage/.system/samba4@update--2022-09-28-02-57--SCALE-22.02.3     575K      -     1.11M  -
Backup4EmaStorage/.system/samba4@update--2022-12-18-08-28--SCALE-22.02.4     695K      -     1.19M  -
Backup4EmaStorage/.system/samba4@wbc-1673849289                              695K      -     1.34M  -
Backup4EmaStorage/.system/samba4@update--2023-09-23-18-49--SCALE-22.12.0     488K      -     1.37M  -
 

Etorix

Wizard
Joined
Dec 30, 2020
Messages
2,134
It looks like the main only retains snapshots for two weeks, which is not much.
Anyway, your only option is to start fresh.

Oh, and never, never, ever trust the output of any generative AI.
 
Top