End of Google Drive Cloud Sync fails with rclone exit code 1

[justanotheruser]

I've started syncing to my .edu Google Drive, as it gives me unlimited storage. I've been able to sync, and the files show up on Drive, but at the end of the tasks, the Web UI says failed, and gives this error:

Code:

Error: Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/middlewared/job.py", line 349, in run
    await self.future
  File "/usr/local/lib/python3.7/site-packages/middlewared/job.py", line 385, in __run_body
    rv = await self.method(*([self] + args))
  File "/usr/local/lib/python3.7/site-packages/middlewared/schema.py", line 961, in nf
    return await f(*args, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/middlewared/plugins/cloud_sync.py", line 1034, in sync
    await rclone(self.middleware, job, cloud_sync)
  File "/usr/local/lib/python3.7/site-packages/middlewared/plugins/cloud_sync.py", line 229, in rclone
    raise ValueError(message)
ValueError: rclone failed with exit code 1

I'm on 11.3-U5, running on a Dell Precision T3400, with a Core2Duo E7300, and 16GB of DDR2. I am syncing my entire backup pool, which is a single 1TB Seagate.
I don't have take snapshot enabled, but do have remote and filename encryption enabled, and follow symlinks enabled. This backup does include the iocage dataset, but I don't use any plugins.

The pool also says it has about 100GB of data, but Google reports 80GB, likely due to Google using compression.

 

[HendrixLives]

Hi there, I had the same issue with Google Drive in 11.3-U5 (but doing a PULL sync). The sync completed but I got the same error message.

In my case, reviewing the logs I detected that one of my files on Drive caused the error due to a too long filename.

I suggest that you check your logs (in the Cloud Sync Tasks, click on the "Error" button and there you should see the "Download Logs" button).
That will give you a better understanding of the error. If it is indeed one specific file(s) causing it, you should be able to detect it and fix it, allowing you to run the sync task again.


Regards!

 

[justanotheruser]

I went through the logs, and it turns out that the issue was with the symlinks as part of the iocage dataset. I don't have a need to back that up, so I simply excluded it.

Code:

2020/10/02 07:53:21 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/etc/rmt: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/etc/rmt: no such file or directory
2020/10/02 07:53:21 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/etc/unbound: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/etc/unbound: no such file or directory
2020/10/02 07:53:40 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/nls/POSIX: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/nls/POSIX: no such file or directory
2020/10/02 07:53:40 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/nls/en_US.US-ASCII: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/nls/en_US.US-ASCII: no such file or directory
2020/10/02 07:53:40 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-1/man5: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-1/man5: no such file or directory
2020/10/02 07:53:40 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-1/man2: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-1/man2: no such file or directory
2020/10/02 07:53:40 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-1/man8: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-1/man8: no such file or directory
2020/10/02 07:53:40 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-1/man6: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-1/man6: no such file or directory
2020/10/02 07:53:40 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-1/man1: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-1/man1: no such file or directory
2020/10/02 07:53:40 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-1/man9: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-1/man9: no such file or directory
2020/10/02 07:53:40 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-1/man3: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-1/man3: no such file or directory
2020/10/02 07:53:40 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-1/man4: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-1/man4: no such file or directory
2020/10/02 07:53:40 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-1/man7: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-1/man7: no such file or directory
2020/10/02 07:53:59 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-15/man5: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-15/man5: no such file or directory
2020/10/02 07:53:59 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-15/man2: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-15/man2: no such file or directory
2020/10/02 07:53:59 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-15/man8: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-15/man8: no such file or directory
2020/10/02 07:53:59 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-15/man6: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-15/man6: no such file or directory
2020/10/02 07:53:59 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-15/man1: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-15/man1: no such file or directory
2020/10/02 07:53:59 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-15/man9: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-15/man9: no such file or directory
2020/10/02 07:53:59 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-15/man3: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-15/man3: no such file or directory
2020/10/02 07:53:59 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-15/man4: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-15/man4: no such file or directory
2020/10/02 07:53:59 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-15/man7: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.ISO8859-15/man7: no such file or directory
2020/10/02 07:54:18 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.UTF-8/man7: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.UTF-8/man7: no such file or directory
2020/10/02 07:54:18 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.UTF-8/man9: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.UTF-8/man9: no such file or directory
2020/10/02 07:54:18 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.UTF-8/man3: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.UTF-8/man3: no such file or directory
2020/10/02 07:54:18 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.UTF-8/man4: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.UTF-8/man4: no such file or directory
2020/10/02 07:54:18 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.UTF-8/man6: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.UTF-8/man6: no such file or directory
2020/10/02 07:54:18 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.UTF-8/man1: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.UTF-8/man1: no such file or directory
2020/10/02 07:54:18 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.UTF-8/man5: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.UTF-8/man5: no such file or directory
2020/10/02 07:54:18 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.UTF-8/man2: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.UTF-8/man2: no such file or directory
2020/10/02 07:54:18 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.UTF-8/man8: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/man/en.UTF-8/man8: no such file or directory
2020/10/02 07:54:36 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/openssl/man/en.ISO8859-1/man3: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/openssl/man/en.ISO8859-1/man3: no such file or directory
2020/10/02 07:54:36 ERROR : Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/openssl/man/en.ISO8859-1/man1: Listing error: symlink: stat /mnt/Backups/Storage/iocage/releases/11.3-RELEASE/root/var/db/etcupdate/current/usr/share/openssl/man/en.ISO8859-1/man1: no such file or directory

Also, the reason that the size on Drive is smaller than the used space on the pool is because the snapshots are not synced, only the raw data. Google does use compression behind the scenes, but that is not noticeable to the user.

 

[Kirill_com]

Здравствуйте. Я использую TrueNAS-12.0-STABLE. Я выполнял синхронизацию с MS Onedrive. Я получаю сообщение об ошибке.
Ошибка rclone с кодом выхода 1
Ошибка: Traceback (последний вызов последний):
Файл "/usr/local/lib/python3.9/site-packages/middlewared/job.py", строка 367, выполняется
жду себя. будущее
Файл "/usr/local/lib/python3.9/site-packages/middlewared/job.py", строка 403, в __run_body
rv = ожидание self.method (* ([self] + args))
Файл "/usr/local/lib/python3.9/site-packages/middlewared/schema.py", строка 973, в формате nf
вернуть ожидание f (* args, ** kwargs)
Файл "/usr/local/lib/python3.9/site-packages/middlewared/plugins/cloud_sync.py", строка 1070, синхронно
ожидание self._sync (cloud_sync, параметры, задание)
Файл "/usr/local/lib/python3.9/site-packages/middlewared/plugins/cloud_sync.py", строка 1117, в _sync
await rclone (self.middleware, job, cloud_sync, параметры ["dry_run"])
Файл "/usr/local/lib/python3.9/site-packages/middlewared/plugins/cloud_sync.py", строка 236, в rclone
поднять ValueError (сообщение)
ValueError: сбой rclone с кодом выхода 1