What is the problem you are having with rclone?
I noticed after allowing the rclone copy to run for a few TB of data / over 24 hours or so - the transfer speeds at the top of the command appear to be frozen. The amount of data transferred does update - but the total speed does not reflect the truth as proven by the output below.
Transferred: 8.368 TiB / 14.518 TiB, 58%, 44.465 MiB/s, ETA 1d16h17m
Checks: 2336 / 2336, 100%
Transferred: 28770 / 38780, 74%
Elapsed time: 1d17h49m34.4s
- Files/XXXXXXXXXXXXXXXX: 89% /3.943Gi, 10.422Mi/s, 40s
- Files/XXXXXXXXXXXXXXXX: 20% /2.393Gi, 12.784Mi/s, 2m31s
More of an annoyance than anything and does not affect the usage of the command. I am running this in a tmux session.
Run the command 'rclone version' and share the full output of the command.
- os/version: slackware 15.0+ (64 bit)
- os/kernel: 6.1.49-Unraid (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.21.1
- go/linking: static
- go/tags: none
Running on top of unraid
Which cloud storage system are you using? (eg Google Drive)
The command you were trying to run (eg
rclone copy /tmp remote:tmp)
rclone copy -P --transfers 2 --tpslimit 8 dcrypt:drive /mnt/user/media
The rclone config contents with secrets removed.
type = dropbox
chunk_size = 149Mi
token = XXXXXXXXXXXXXXXXXXXXXX
type = crypt
remote = dropbox:
filename_encryption = standard
directory_name_encryption = true
password = XXXXXXXXXXXXXXXXXXXXXX
password2 = XXXXXXXXXXXXXXXXXXXXXX
A log from the command with the
No logging enabled
Similar behaviour has been mentioned multiple times but so far nobody provided reliable way to reproduce it and the root cause is unknown...
Could you run your transfer with
-vv debug level option and see if there is anything suspicious in the log?
Restarted with debugging / log to file enabled. Will upload if it reoccurs.
Since I am a new user, I am not able to upload the file directly, so my apologies for the link below.
I did filter out a lot of the logs relating to the copying due to the length (750k lines). See the multiple grep -v's for the filter at the beginning of the file.
I noticed the output for 'rclone copy' had broken transfer speeds roughly 5 1/2 hours after start. I haven't looked at it in a few hours, probably since the first hour after starting.
Thank you. Some random throttle errors but nothing major in this log. I hoped that it will tell us what is causing it.
Given that other people report similar behaviour (speed stat frozen during long transfers) I think there is an issue.
But nothing pointing into its cause yet...
BTW - how often your stats are updated? Every minute? or more often?
The output normally updates every 1 second.