Rclone 1.54 beta Lot of context canceled

What is the problem you are having with rclone?

I have a lot of these log:
2020/09/18 09:57:47 ERROR : temp/blob-107663964.partial: Failed to copy: context canceled
2020/09/18 11:28:21 ERROR : temp/blob-464447071.partial: Failed to copy: couldn't list directory: context canceled

What is your rclone version (output from rclone version)

rclone v1.54.0-beta.4754.c3884aafd

  • os/arch: linux/amd64
  • go version: go1.15

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Debian 10 x64

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

Mounted storage with these settings:
/usr/bin/rclone mount node:/storagenode /data/program/storj/storage
--config /data/program/rclone/config/storagenode.conf
--allow-other
--allow-non-empty
--umask=0
--cache-read-retries=1
--dir-cache-time=1m
--vfs-cache-mode=writes
--cache-dir=/data/program/rclone/cache
--vfs-cache-max-size=10G
--log-level=NOTICE
--log-file=/data/program/rclone/logs/rclone_storagenode.log
--no-checksum
--no-modtime
--ignore-checksum
--write-back-cache
--async-read=true

The rclone config contents with secrets removed.

[node]
type = drive
client_id = xxxxxxxxxxxxxxxxxxxxxxxxxxxx.apps.googleusercontent.com
client_secret = xxxxxxxxxxxxxxxxxxxxxxxxxxxx
scope = drive
token = {"access_token":"xxxxxxxxxxxxxxxxxxxxxx"}

I have try several settings but nothing change, i'm spammed with these error.
I have try to play with async on/off, write cache on/off, cache on/off, nothing change

Thanks for any help

That looks like rclone was uploading temp/blob-107663964.partial when I'd guess it was renamed so rclone cancelled the upload.

Does that sound about right? If so these errors are part of normal operation. Maybe rclone should log them at a lower level.

Can you post some more log please to confirm?

Hello Nick,

yes what you say look possible, the temp folder hosted on a rclone mount is hammered by another service, i have try to move it outside the mount with mergerfs trick but it does not work so i have to stay like that. If you say that's it's OK, i will let it scream like that :slight_smile:

one thing i have some trouble to understand is why rclone is not able to "see" file that it have renamed itself before uploading?

You could try increasing the VFS write back delay, that might help.

--vfs-write-back duration                Time to writeback files after last use when using cache. (default 5s)

Can you give an example?

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.