OneDrive cloud sync task repeatedly copying unchanged files

[redm0nster]

I'm running TrueNAS Core version 13.0-U4 on a system with an Intel J5040 CPU, 16GB RAM, SSD boot drive and 2 x 10TB Seagate Ironwolf Pro disks in mirror mode.

I run cloud sync from my personal OneDrive account to the NAS, set to PULL and SYNC. Every time this sync job runs, 22 very old files out of a total of 5323 always get re-copied with messages like this in the log:

Code:

2023/04/14 15:42:53 INFO  : Nokia_6230_Oct_2005/Image005.jpg: Copied (replaced existing)
2023/04/14 15:42:53 INFO  : Nokia_6230_Oct_2005/Image008.jpg: Copied (replaced existing)
2023/04/14 15:42:53 INFO  : Nokia_6230_Oct_2005/Image006.jpg: Copied (replaced existing)
2023/04/14 15:42:53 INFO  : Nokia_6230_Oct_2005/Image009.jpg: Copied (replaced existing)
2023/04/14 15:42:53 INFO  : Nokia_6230_Oct_2005/Image007.jpg: Copied (replaced existing)
2023/04/14 15:42:53 INFO  : Nokia_6230_Oct_2005/Image010.jpg: Copied (replaced existing)

These files haven't changed and appear to have the same attributes on both OneDrive and the TrueNAS system, so I don't know why the cloud sync task is copying them every time it runs.

Here is an example using an SSH session to look at the logs and examine the files (some of the lines are quite long):

Code:

rsh@store:~$ grep "Nokia_6230_Apr_2006" /tmp/middlewared/jobs/77186.log
2023/04/14 15:42:53 INFO  : Nokia_6230_Apr_2006/Image009.jpg: Copied (replaced existing)
rsh@store:~$ stat /mnt/tank/pictures/roy/Nokia_6230_Apr_2006/Image009.jpg
17154662734296837646 4095 -rwxrwx--- 1 rsh rsh 18446744073709551615 29342 "Jul 17 20:23:33 2014" "Jul 17 20:23:33 2014"                  "Apr 14 15:42:53 2023" "Jul 17 20:23:33 2014" 29696 65 0x800 /mnt/tank/pictures/roy/Nokia_6230_Apr_2006/Image009.jpg
rsh@store:~$ sha256sum /mnt/tank/pictures/roy/Nokia_6230_Apr_2006/Image009.jpg
56ecd0c47ca866f20a1da638e4ff169e6930749cde602ed664863b8a5aa13f25  /mnt/tank/pictures/roy/Nokia_6230_Apr_2006/Image009.jpg
rsh@store:~$ # run the cloud sync task from the web gui
rsh@store:~$ grep "Nokia_6230_Apr_2006" /tmp/middlewared/jobs/77319.log
2023/04/14 16:46:38 INFO  : Nokia_6230_Apr_2006/Image009.jpg: Copied (replaced existing)
rsh@store:~$ stat /mnt/tank/pictures/roy/Nokia_6230_Apr_2006/Image009.jpg
17154662734296837646 4095 -rwxrwx--- 1 rsh rsh 18446744073709551615 29342 "Jul 17 20:23:33 2014" "Jul 17 20:23:33 2014"                  "Apr 14 16:46:38 2023" "Jul 17 20:23:33 2014" 29696 65 0x800 /mnt/tank/pictures/roy/Nokia_6230_Apr_2006/Image009.jpg
rsh@store:~$ sha256sum /mnt/tank/pictures/roy/Nokia_6230_Apr_2006/Image009.jpg
56ecd0c47ca866f20a1da638e4ff169e6930749cde602ed664863b8a5aa13f25  /mnt/tank/pictures/roy/Nokia_6230_Apr_2006/Image009.jpg

Does anyone know why a few files (and always the same few files) would get copied over every time like this?

 

[redm0nster]

Hi, hope it's OK to bumpt this as there have been no replies in a week and the issue is still present.
I suspect this may be an issue in the underlying rclone tool, so knowledge of the rclone command that is used may be usefuk in tracking this down.