Rclone copy speed statistic not updating

Suspected Bug
1

What is the problem you are having with rclone?

I noticed after allowing the rclone copy to run for a few TB of data / over 24 hours or so - the transfer speeds at the top of the command appear to be frozen. The amount of data transferred does update - but the total speed does not reflect the truth as proven by the output below.

Transferred: 8.368 TiB / 14.518 TiB, 58%, 44.465 MiB/s, ETA 1d16h17m
Checks: 2336 / 2336, 100%
Transferred: 28770 / 38780, 74%
Elapsed time: 1d17h49m34.4s
Transferring:

  • Files/XXXXXXXXXXXXXXXX: 89% /3.943Gi, 10.422Mi/s, 40s
  • Files/XXXXXXXXXXXXXXXX: 20% /2.393Gi, 12.784Mi/s, 2m31s

More of an annoyance than anything and does not affect the usage of the command. I am running this in a tmux session.

Run the command 'rclone version' and share the full output of the command.

rclone v1.64.0

  • os/version: slackware 15.0+ (64 bit)
  • os/kernel: 6.1.49-Unraid (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.21.1
  • go/linking: static
  • go/tags: none

Running on top of unraid

Which cloud storage system are you using? (eg Google Drive)

Dropbox

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone copy -P --transfers 2 --tpslimit 8 dcrypt:drive /mnt/user/media

The rclone config contents with secrets removed.

[dropbox]
type = dropbox
chunk_size = 149Mi
token = XXXXXXXXXXXXXXXXXXXXXX

[dcrypt]
type = crypt
remote = dropbox:
filename_encryption = standard
directory_name_encryption = true
password = XXXXXXXXXXXXXXXXXXXXXX
password2 = XXXXXXXXXXXXXXXXXXXXXX

A log from the command with the -vv flag

No logging enabled
2

Similar behaviour has been mentioned multiple times but so far nobody provided reliable way to reproduce it and the root cause is unknown...

Could you run your transfer with -vv debug level option and see if there is anything suspicious in the log?

3

Restarted with debugging / log to file enabled. Will upload if it reoccurs.

4

Since I am a new user, I am not able to upload the file directly, so my apologies for the link below.

https://nextcloud.chcasano.com/index.php/s/porbpD7ZAYjiPnW

I did filter out a lot of the logs relating to the copying due to the length (750k lines). See the multiple grep -v's for the filter at the beginning of the file.

I noticed the output for 'rclone copy' had broken transfer speeds roughly 5 1/2 hours after start. I haven't looked at it in a few hours, probably since the first hour after starting.

5

Thank you. Some random throttle errors but nothing major in this log. I hoped that it will tell us what is causing it.

Given that other people report similar behaviour (speed stat frozen during long transfers) I think there is an issue.

But nothing pointing into its cause yet...

BTW - how often your stats are updated? Every minute? or more often?

6

The output normally updates every 1 second.

7

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.