SOLVED Cloud Sync Task getting error; too many open files

CheeryFlame

Contributor
Joined
Nov 21, 2022
Messages
184
Hello, I have a cloud sync task to Google Drive and I'm getting this error on many files.
<3>ERROR : /mnt/path/file.mp4: Failed to copy: failed to open source object: open /mnt/path/file.mp4: too many open files
It's then impossible to complete the cloud task.

What's the best way in Scale to remove or change the limit of opened files.

Thank you!

EDIT: Thanks to briancmoses on the Discord who helped me figuring out the issue. What happened is that my transfers to Google Drive were really slow and I found a topic on the forum of another member saying they fixed the speed by chaging the value of Transfers up to 1000 files at once in the Cloud Sync Task. This opens too many files at once before the transfers are able to complete and ZFS will eventually block the operation and return the error in this post. Reducing to 100 the number of transfers fixed it for me.

EDIT2: Seems like 100 is too much as well and got more transfers to fail. I'll try 10 files and have all my datasets to backup on different days depending their size instead of everyday at midnight.
 
Last edited:
Top