SOLVED Replication issue TrueNAS <--> FreeNAS

[Pitfrr]

Hello,

I try to configure replication between a TrueNAS and a FreeNAS server and it seems to be a bit tricky...
I looked in the documentation (TrueNAS 11.3) but this didn't help further.

On one side: FreeNAS (9.10) as main system, a dataset with snapshots configured.
On the other side: TrueNAS (12.0RC1) as backup system with a replication task configured (or not! ).

I thought first my problem was with the naming schema and that TrueNAS didn't see the snapshots on FreeNAS, but from what I can guess from the log file, that's not it. It's rather an invalid option that generate the replication error.

Here is the configuration of the replication task:

On the source server the snapshots names are:

Code:

Nas/Xchange@auto-20201011.2132-1w  Sun Oct 11 21:32 2020
Nas/Xchange@auto-20201011.2137-1w  Sun Oct 11 21:37 2020
Nas/Xchange@auto-20201011.2142-1w  Sun Oct 11 21:42 2020
Nas/Xchange@manual-20201011.2154   Sun Oct 11 21:54 2020

I tried several combinations for the Naming Schema with following results:

• auto-%Y%m%d.%H%M
  • No error and finishing with the message:
    INFO [replication_task__task_1] [zettarepl.replication.run] No snapshots to send for replication task 'task_1' on dataset 'Nas/Xchange'
  • So basically, no snapshot corresponding to the naming scheme has been found, if I understand it correctly.
• auto-%Y%m%d.%H%M-1w
  • Error:
    INFO [replication_task__task_1] [zettarepl.replication.run] For replication task 'task_1': doing pull from 'Nas/Xchange' to 'Nss/Xchange' of snapshot='auto-20201011.2132-1w' incremental_base=None receive_resume_token=None
ERROR [replication_task__task_1] [zettarepl.replication.run] For task 'task_1' unhandled replication error ExecException(2, "invalid option 'c'\nusage:\n\tsend [-DnPpRvLe] [-[iI] snapshot] <snapshot>\n\tsend [-Le] [-i snapshot|bookmark] <filesystem|volume|snapshot>\n\tsend [-nvPe] -t <receive_resume_token>\n\nFor the property list, run: zfs set|get\n\nFor the delegated permission list, run: zfs allow|unallow\ncannot receive: failed to read from stream\n")
• manual-%Y%m%d.%H%M
  • Same error as previously but for the snapshot snapshot='manual-20201011.2154'

I try to understand if I'm doing something wrong or missing anything... It's pretty straightforward so I'm not sure...
I don't understand the error in the replication task "invalid option". Is there a way to see the complete command, to see if anything is wrong there?
Because from the logs, it looks like the snapshots have been found but then somekind of invalid option is happening...
It might also be a bug, but I would first assume I'm not doing it right!

Attached the log file with the complete error message.

Thanks for your feedback.

 

[Pitfrr]

Well I continued to do some digging in the meantime and it turns out that by deselecting the option "Allow compressed WRITE records" which seems to be the "invalid option 'c' ... solves the issue!

The tooltip says "Use compressed WRITE records to make the stream more efficient. The destination system must also support compressed WRITE records. ".
Does that mean that the error happens because FreeNAS (9.10) on the other side cannot handle compressed write records?

From the log file though it is not obvious... :-O

 

[sretalla]

I looked in the documentation (TrueNAS 11.3) but this didn't help further.

This is the wrong documentation and refers to the Enterprise version of TrueNAS currently in release, not TrueNAS 12.0 Core (the Release candidate you're running).

On one side: FreeNAS (9.10) as main system, a dataset with snapshots configured.
On the other side: TrueNAS (12.0RC1) as backup system with a replication task configured

This is probably where most of your problem is... the versions are too far apart to have things run smoothly.

You might have better results setting the replication to run from the 9.10 to the 12RC, but I expect the best option would be to run 9.10 on both until you are ready to update your main system to something higher than 9.10.

 

[Pitfrr]

wrong documentation

Thanks for the insight... I didn't realize it was the enterprise edition... (and given the documentation state for 12RC I thought I could get some info from 11.3 ).

the versions are too far apart

I was afraid of something like that... I do love 9.10 as main server, it's been very stable so far but I know I'll have to upgrade at some point.
I choose the TrueNAS 12RC for the backup system because it has openVPN integrated as a service (I was about to give it a shot with 9.10 and openVPN in a jail but I wasn't really successful so far... and then TrueNAS 12RC came.)

You might have better results setting the replication to run from the 9.10 to the 12RC

That was also one solution I wanted to try, but first I wanted to get some feedback on this setup.
I also like the idea of the backup system pulling the replication because it might not be powered on all the time (and the idea is to have it remote as well).

 

[sretalla]

Thanks for the insight... I didn't realize it was the enterprise edition... (and given the documentation state for 12RC I thought I could get some info from 11.3 ).

FreeNAS 11.3 documentation would have been the more appropriate place to look, but as you point out, there's no complete documentation available yet for the Release Candidate (and not expected while in RC status).