Rclone sync on OneDrive causes local leak of files

Help and Support
22

No, it would error out and do nothing. I think there is a mixing of logs there.

Test it out and just put a bad remote name in:

root@gemini:~# rclone copy -vv /root/test blah:tmp
2020/05/22 14:49:58 DEBUG : rclone: Version "v1.51.0" starting with parameters ["rclone" "copy" "-vv" "/root/test" "blah:tmp"]
2020/05/22 14:49:58 NOTICE: Config file "/root/.config/rclone/rclone.conf" not found - using defaults
2020/05/22 14:49:58 Failed to create file system for "blah:tmp": didn't find section in config file
root@gemini:~#
root@gemini:~#
23

i saw this in the log file.
i removed all those --exclude for readibility
as expected, rclone complains about "Failed to create file system"
but then rclones seems to start to copy files.

2020/05/21 14:33:11 DEBUG : rclone: Version "v1.51.0" starting with parameters ["rclone" "sync" "/home/mathieu" "onedrive:backup_home/" "--links" "--delete-during" "--progress" "-vv" "--log-file=/home/mathieu/Downloads/rclone.log"]
2020/05/21 14:33:11 NOTICE: Config file "/root/.config/rclone/rclone.conf" not found - using defaults
2020/05/21 14:33:11 Failed to create file system for "onedrive:backup_home/": didn't find section in config file
2020/05/21 14:33:11 DEBUG : .config/chromium/Default/File System/002/t/Paths/000003.log: Size and modification time the same (differ by -967.919624ms, within tolerance 1s)

24

What specifically did you run?

25

i did not run anything.
that was a snippet from the log file.
it seems to be copying local to local...

what a confusing log file

26

Right, what I am saying is that it doesn't do that as it exits if it doesn't find a remote and you can test it to validate.

What you are seeing is another process writing to the same log.

You can see the lines above when it started and after it started as well.

2020/05/21 23:34:44 DEBUG : Work/Admin/Faculty/FLREC Faculty meetings/2019/10/ADMINISTRATIVE-COUNCIL-L outside versus inside activities working draft.msg: Starting multipart upload
2020/05/21 23:34:44 DEBUG : Work/Admin/Faculty/FLREC Faculty meetings/2019/10/ADMINISTRATIVE-COUNCIL-L UF ENGAGED is coming Oct 1.msg: Starting multipart upload
2020/05/21 23:34:45 DEBUG : Work/Admin/Faculty/FLREC Faculty meetings/2019/10/ADMINISTRATIVE-COUNCIL-L outside versus inside activities working draft.msg: Uploading segment 0/57344 size 57344
2020/05/21 23:34:45 DEBUG : Work/Admin/Faculty/FLREC Faculty meetings/2019/10/ADMINISTRATIVE-COUNCIL-L UF ENGAGED is coming Oct 1.msg: Uploading segment 0/68608 size 68608
2020/05/21 23:35:07 DEBUG : rclone: Version "v1.51.0" starting with parameters ["rclone" "sync" "/home/mathieu" "onedrive:backup_home/" "--exclude" "/Music/**" "--exclude" "/Pictures/**" "--exclude" "/Public/*
*" "--exclude" "/Downloads/temp**" "--exclude" "/Downloads/tmp**" "--exclude" "/Downloads/torrents/**" "--exclude" "/Videos/**" "--exclude" "/.emacs.d/cache/**" "--exclude" "/.emacs.d/elpa/**" "--exclude" "/.R
-site/site-library/**" "--exclude" "/.cache/**" "--exclude" "/.gftp/cache/**" "--exclude" "/.googleearth/Cache/**" "--exclude" "/.config/chromium/Default/Service Worker/CacheStorage/**" "--exclude" "/.config/c
hromium/Default/Service Worker/ScriptCache/**" "--exclude" "/.config/google-chrome/Default/Service Worker/CacheStorage/**" "--exclude" "/.config/google-chrome/Default/Service Worker/ScriptCache/**" "--exclude"
 "/.config/Microsoft/Microsoft Teams/Application Cache/**" "--exclude" "/.config/Microsoft/Microsoft Teams/Cache/**" "--exclude" "/.config/Slack/Cache/**" "--exclude" "/.config/Slack/Service Worker/CacheStorag
e/**" "--exclude" "/.config/skypeforlinux/Cache/**" "--exclude" "/.thumbnails/**" "--exclude" "/.local/share/torbrowser/**" "--exclude" "/.local/share/Trash/**" "--exclude" "/.icedove/**" "--links" "--delete-d
uring" "--progress" "-vv" "--log-file=/home/mathieu/Downloads/rclone.log"]
2020/05/21 23:35:07 NOTICE: Config file "/root/.config/rclone/rclone.conf" not found - using defaults
2020/05/21 23:35:07 Failed to create file system for "onedrive:backup_home/": didn't find section in config file
2020/05/21 23:35:30 DEBUG : Work/Admin/Faculty/FLREC Faculty meetings/2019/10/2019-Separate-Campuses-AFSR-Final.pdf: QuickXorHash = 0f17e0cb02ba69d23acc3898379894a53cdbd1cf OK
2020/05/21 23:35:30 INFO  : Work/Admin/Faculty/FLREC Faculty meetings/2019/10/2019-Separate-Campuses-AFSR-Final.pdf: Copied (new)
2020/05/21 23:35:30 DEBUG : Work/Admin/Faculty/FLREC Faculty meetings/2019/10/Best Practices for Faculty Mentoring.pdf: Starting multipart upload
27

i agree

i copied a complete snippet from the log.
so could the OP have had multiple rclones running at the same time and all writing to the same log?

28

Yes, there are definitely multiples going on.

29

Dear @asdffdsa and @Animosity022, thanks a bunch for pointing me in the right direction! There was indeed two rclones running at once… When I started using rclone, I added to anacron, so it would run everyday when my computer is not too busy. And that's exactly what has been happening!

My apologies for the time you spent on it. I actually forgot I did this — It was my intent all along, but I did not remember I followed through and actually set it up. I have now removed the anacron entry, and resumed the sync. I can only assume this will be working well, and consider this issue closed (I will report if otherwise).

Now for anacron, this is a whole another problem, which I need to pursue now: How to run it as my user, so it can find the config file and copy as mathieu and not root. But that is for another day. Thanks again for your patience with my problem, and helping me find what was going on.

30

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.