What is the problem you are having with rclone?
I'm using onedrive mounted by rclone, for resilio sync download storage, but almost all downloaded files can't be move from resilio's temporary folder to onedrive.
Resilio sync uses "/.sync" folder for temporary folder when downloading. To avoid frequent uploads and downloads, I use local space for the temporary folder, and mount onedrive for downloaded files' storage.
Resilio creates folders in onedrive properly at the beginning when downloading, and I can find a txt file and a jpg file downloaded correctly. But most files (Almost all files I download are PDF files) are stucked in the temporary folder. They have not been correctly renamed and moved. I have tried to renamed a temporary file to a correct name extension, then it can be read.
I think I have given enough rights to the mounted folders, this is the command I use
rclone mount FebTh:/path/1of4 /home/Mounts/FebTh/path/1of4 --allow-non-empty --allow-other --allow-root --no-checksum --no-modtime --vfs-cache-mode full --dir-perms 0777 --file-perms 0777 --gid 998 --uid 997 --umask 0002 --default-permissions
--gid 998 --uid 997 is the id of rslsync --- resilio's username
I mount 4 folders for the downloading.
What‘s interesting is that I have also tried to mount one folder includeing all the folders (temporary folder and downloaded folders), in this case, I got many correctly downloaded files, but used too much uploads and downloads. And it still got stuck in the temporary folder after several hours, far from finishing the download.
I have searched for resilio information relevanted to this problem, and find this page " File Transfer Errors".
It mentioned "Find the limits of your target filesystem.", "The error indicates that this move cannot be done since the root of the directory and the file's designated subdirectory are different logical disks.".
But I have no idea if I can use rclone command to deal with the problem.
Run the command 'rclone version' and share the full output of the command.
root@febth:~# rclone version
rclone v1.58.1
- os/version: ubuntu 20.04 (64 bit)
- os/kernel: 5.4.0-122-generic (aarch64)
- os/type: linux
- os/arch: arm64
- go/version: go1.17.9
- go/linking: static
- go/tags: none
Which cloud storage system are you using? (eg Google Drive)
OneDrive (global)
The command you were trying to run (eg rclone copy /tmp remote:tmp
)
rclone mount FebTh:/path/1of4 /home/Mounts/FebTh/path/1of4 --allow-non-empty --allow-other --allow-root --no-checksum --no-modtime --vfs-cache-mode full --dir-perms 0777 --file-perms 0777 --gid 998 --uid 997 --umask 0002 --default-permissions
The rclone config contents with secrets removed.
[FebTh]
type = onedrive
client_id = "with secrets removed"
client_secret = "with secrets removed"
token = {"with secrets removed"}
drive_id = "with secrets removed"
drive_type = business
A log from the command with the -vv
flag
too many logs, this is just minuscule portion of them, but almost are like these
2022/07/15 04:55:48 DEBUG : /: Attr:
2022/07/15 04:55:48 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/07/15 04:55:48 DEBUG : /: Lookup: name="北京国家图书馆"
2022/07/15 04:55:48 DEBUG : /: >Lookup: node=北京国家图书馆/, err=<nil>
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/: Attr:
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/钦定古今图书集成/06.经济汇编/: Lookup: name="古今图书集成.32.经济汇编.考工典.二百五十二卷"
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/钦定古今图书集成/06.经济汇编/: >Lookup: node=北京国家图书馆/钦定古今图书集成/06.经济汇编/古今图书集成.32.经济汇编. 考工典.二百五十二卷/, err=<nil>
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/钦定古今图书集成/06.经济汇编/古今图书集成.32.经济汇编.考工典.二百五十二卷/: Attr:
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/钦定古今图书集成/06.经济汇编/古今图书集成.32.经济汇编.考工典.二百五十二卷/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/钦定古今图书集成/06.经济汇编/古今图书集成.32.经济汇编.考工典.二百五十二卷/: ReadDirAll:
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/钦定古今图书集成/06.经济汇编/古今图书集成.32.经济汇编.考工典.二百五十二卷: Re-reading directory (12m10.913346852s old)
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/钦定古今图书集成/06.经济汇编/古今图书集成.32.经济汇编.考工典.二百五十二卷/: >ReadDirAll: item=2, err=<nil>
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/钦定古今图书集成/04.博物汇编/: Lookup: name="古今图书集成.20.博物汇编.草木典.三百二十卷"
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/钦定古今图书集成/04.博物汇编/: >Lookup: node=北京国家图书馆/钦定古今图书集成/04.博物汇编/古今图书集成.20.博物汇编. 草木典.三百二十卷/, err=<nil>
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/钦定古今图书集成/04.博物汇编/古今图书集成.20.博物汇编.草木典.三百二十卷/: Attr:
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/钦定古今图书集成/04.博物汇编/古今图书集成.20.博物汇编.草木典.三百二十卷/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/钦定古今图书集成/04.博物汇编/古今图书集成.20.博物汇编.草木典.三百二十卷/: ReadDirAll:
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/钦定古今图书集成/04.博物汇编/古今图书集成.20.博物汇编.草木典.三百二十卷: Re-reading directory (12m10.920973752s old)
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/钦定古今图书集成/04.博物汇编/古今图书集成.20.博物汇编.草木典.三百二十卷/: >ReadDirAll: item=2, err=<nil>
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/: Lookup: name="钦定古今图书集成"
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/: >Lookup: node=北京国家图书馆/钦定古今图书集成/, err=<nil>
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/钦定古今图书集成/: Attr:
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/钦定古今图书集成/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/钦定古今图书集成/03.明伦汇编/: Lookup: name="古今图书集成.16.明伦汇编.闺媛典.三百七十六卷"
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/钦定古今图书集成/03.明伦汇编/: >Lookup: node=北京国家图书馆/钦定古今图书集成/03.明伦汇编/古今图书集成.16.明伦汇编. 闺媛典.三百七十六卷/, err=<nil>
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/钦定古今图书集成/03.明伦汇编/古今图书集成.16.明伦汇编.闺媛典.三百七十六卷/: Attr:
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/钦定古今图书集成/03.明伦汇编/古今图书集成.16.明伦汇编.闺媛典.三百七十六卷/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/钦定古今图书集成/03.明伦汇编/古今图书集成.16.明伦汇编.闺媛典.三百七十六卷/: ReadDirAll:
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/钦定古今图书集成/03.明伦汇编/古今图书集成.16.明伦汇编.闺媛典.三百七十六卷: Re-reading directory (12m10.908876994s old)
2022/07/15 04:55:48 DEBUG : 北京国家图书馆/钦定古今图书集成/03.明伦汇编/古今图书集成.16.明伦汇编.闺媛典.三百七十六卷/: >ReadDirAll: item=2, err=<nil>
2022/07/15 04:55:56 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2022/07/15 04:56:56 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2022/07/15 04:57:56 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2022/07/15 04:58:56 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2022/07/15 04:59:56 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2022/07/15 05:00:56 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2022/07/15 05:01:56 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2022/07/15 05:02:56 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2022/07/15 04:55:36 DEBUG : /: Attr:
2022/07/15 04:55:36 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/07/15 04:55:36 DEBUG : /: Lookup: name="魁星图.jpg"
2022/07/15 04:55:36 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2022/07/15 04:55:39 DEBUG : /: Attr:
2022/07/15 04:55:39 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/07/15 04:55:39 DEBUG : /: Lookup: name="重修台郡各建筑图说.插图一.清.蒋元枢撰.清彩绘本.jpg"
2022/07/15 04:55:39 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2022/07/15 04:55:47 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2022/07/15 04:56:47 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2022/07/15 04:57:01 DEBUG : /: Attr:
2022/07/15 04:57:01 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/07/15 04:57:01 DEBUG : /: Lookup: name="魁星图.jpg"
2022/07/15 04:57:01 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2022/07/15 04:57:01 DEBUG : /: Lookup: name="重修台郡各建筑图说.插图一.清.蒋元枢撰.清彩绘本.jpg"
2022/07/15 04:57:01 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2022/07/15 04:57:01 DEBUG : /: Lookup: name="天师鎮宅符.jpg"
2022/07/15 04:57:01 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2022/07/15 04:57:01 DEBUG : /: Lookup: name="罗盘.Boussole géomantique des Chinois.jpg"
2022/07/15 04:57:01 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2022/07/15 04:57:47 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)