ikmplx
April 10, 2023, 9:06pm
1
What is the problem you are having with rclone?
I am getting an error when trying to resume upload with rclone mount if there is a file with long name on B2
Steps to reproduce:
Create a B2 bucket
Create a rclone config for the bucket (i use the s3 interface, but the bug is also reproducible with the b2 interface)
Mount it using the following command:
winpty rclone mount -vv --log-file=rclone-log-1.log b2s3:test-rclone-bucket --bwlimit=1500k --vfs-cache-mode writes --network-mode T:
Copy a directory containing the following files (file size is ~64MB):
$ find test
test
test/5a9924d117d9d7923cb5ab289ffe2399b42d829e7f1926cd34abaa17c5205bec
Wait a few seconds, cancel rclone using Ctrl+C
Start it again:
winpty rclone mount -vv --log-file=rclone-log-2.log b2s3:test-rclone-bucket --bwlimit=1500k --vfs-cache-mode writes --network-mode T:
Expected result: no errors, the file appears in windows explorer (under drive T:)
Actual result: errors in the console, no file in windows explorer, but rclone is uploading the file (according to Task Manager). After a some time the file appears in network mount.
2023/04/10 22:52:05 ERROR : test/5a9924d117d9d7923cb5ab289ffe2399b42d829e7f1926cd34abaa17c5205bec: vfs cache: failed to reload item: reload: failed to add v
irtual dir entry: file does not exist
Run the command 'rclone version' and share the full output of the command.
rclone v1.62.2
os/version: Microsoft Windows 10 Home 21H2 (64 bit)
os/kernel: 10.0.19044.2728 Build 19044.2728.2728 (x86_64)
os/type: windows
os/arch: amd64
go/version: go1.20.2
go/linking: static
go/tags: cmount
Which cloud storage system are you using? (eg Google Drive)
Backblaze b2
The command you were trying to run (eg rclone copy /tmp remote:tmp
)
rclone mount b2s3:test-rclone-bucket --bwlimit=1500k --vfs-cache-mode writes --network-mode T:
The rclone config contents with secrets removed.
[b2s3]
type = s3
provider = Other
access_key_id =
secret_access_key =
endpoint = s3.eu-central-003.backblazeb2.com
A log from the command with the -vv
flag
rclone-log-1.log
2023/04/10 22:33:08 INFO : Starting bandwidth limiter at 1.465Mi Byte/s
2023/04/10 22:33:08 DEBUG : rclone: Version "v1.62.2" starting with parameters ["C:/apps/rclone/rclone.exe" "mount" "-vv" "--log-file=rclone-log-1.log" "b2s3:test-rclone-bucket" "--bwlimit=1500k" "--vfs-cache-mode" "writes" "--network-mode" "T:"]
2023/04/10 22:33:08 DEBUG : Creating backend with remote "b2s3:test-rclone-bucket"
2023/04/10 22:33:08 DEBUG : Using config file from "C:\\Users\\user\\AppData\\Roaming\\rclone\\rclone.conf"
2023/04/10 22:33:08 DEBUG : Resolving service "s3" region "us-east-1"
2023/04/10 22:33:08 INFO : S3 bucket test-rclone-bucket: poll-interval is not supported by this remote
2023/04/10 22:33:08 DEBUG : vfs cache: root is "C:\\Users\\user\\AppData\\Local\\rclone"
2023/04/10 22:33:08 DEBUG : vfs cache: data root is "\\\\?\\C:\\Users\\user\\AppData\\Local\\rclone\\vfs\\b2s3\\test-rclone-bucket"
2023/04/10 22:33:08 DEBUG : vfs cache: metadata root is "\\\\?\\C:\\Users\\user\\AppData\\Local\\rclone\\vfsMeta\\b2s3\\test-rclone-bucket"
2023/04/10 22:33:08 DEBUG : Creating backend with remote "C:/Users/user/AppData/Local/rclone/vfs/b2s3/test-rclone-bucket"
This file has been truncated. show original
rclone-log-2.log
2023/04/10 22:33:23 INFO : Starting bandwidth limiter at 1.465Mi Byte/s
2023/04/10 22:33:23 DEBUG : rclone: Version "v1.62.2" starting with parameters ["C:/apps/rclone/rclone.exe" "mount" "-vv" "--log-file=rclone-log-2.log" "b2s3:test-rclone-bucket" "--bwlimit=1500k" "--vfs-cache-mode" "writes" "--network-mode" "T:"]
2023/04/10 22:33:23 DEBUG : Creating backend with remote "b2s3:test-rclone-bucket"
2023/04/10 22:33:23 DEBUG : Using config file from "C:\\Users\\user\\AppData\\Roaming\\rclone\\rclone.conf"
2023/04/10 22:33:23 DEBUG : Resolving service "s3" region "us-east-1"
2023/04/10 22:33:23 INFO : S3 bucket test-rclone-bucket: poll-interval is not supported by this remote
2023/04/10 22:33:23 DEBUG : vfs cache: root is "C:\\Users\\user\\AppData\\Local\\rclone"
2023/04/10 22:33:23 DEBUG : vfs cache: data root is "\\\\?\\C:\\Users\\user\\AppData\\Local\\rclone\\vfs\\b2s3\\test-rclone-bucket"
2023/04/10 22:33:23 DEBUG : vfs cache: metadata root is "\\\\?\\C:\\Users\\user\\AppData\\Local\\rclone\\vfsMeta\\b2s3\\test-rclone-bucket"
2023/04/10 22:33:23 DEBUG : Creating backend with remote "C:/Users/user/AppData/Local/rclone/vfs/b2s3/test-rclone-bucket"
This file has been truncated. show original
ncw
(Nick Craig-Wood)
April 11, 2023, 9:59am
2
This is a bug I've fixed already but not merged the fix yet.
Can you give this a go please?
v1.63.0-beta.6942.e9758fc6f.fix-vfs-empty-dirs on branch fix-vfs-empty-dirs (uploaded in 15-30 mins)
ikmplx
April 11, 2023, 8:12pm
3
I have tried the new version, it looks like the bug is fixed. I've updated the gist with new logs, if you are interested in them.
Thanks you.
ncw
(Nick Craig-Wood)
April 12, 2023, 9:42am
4
Thank you for testing. I need to write some tests for the fix as it is fairly complicated and then merge it!
ncw
(Nick Craig-Wood)
April 14, 2023, 8:53am
5
I finished this fix off and I've merged this to master now which means it will be in the latest beta in 15-30 minutes and released in v1.63
It will be in this beta (and future ones) if you want to give it a test:
v1.63.0-beta.6958.9a9ef040e on branch master (uploaded in 15-30 mins)
system
(system)
Closed
May 14, 2023, 8:54am
6
This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.