What is the problem you are having with rclone?
rclone copy seems to have restarted on its own and doing something weird, a couple of min ago the stats looked like this:
Transferred: 346.464 GiB / 386.297 GiB, 90%, 6.825 MiB/s, ETA 1h39m36s
Then I came back to check and got these errors:
2024/06/06 16:00:12 ERROR : sftp://bucket-prod@storage.bunnycdn.com:22/videos/: Discarding closed SSH connection: read tcp 66.29.138.103:47296->109.61.89.53:22: i/o timeout
I didnt give it much thought as I got that error before, and it just resumed without any issues, however now the stats shows:
Transferred: 399.408 GiB / 773.759 GiB, 52%, 10.773 KiB/s, ETA 1y8w16h
Checks: 2396 / 2396, 100%
so it checked/uploaded all the files yet now it doubled the amount of GB to upload as you can see if you compare the first one with the second one even though the checks show it has uploaded all files, also there are 5 concurrent uploads that are like: 4k.mp4: 97% /3.003Gi, 1.578Mi/s, 52s all at constant at 1.5mb/s (showing the total as above), yet now it says combined its 10kb/s and the ETA is in 1 year !!
(this is all on a "screen" window)
Run the command 'rclone version' and share the full output of the command.
rclone version
rclone v1.66.0
- os/version: almalinux 8.9 (64 bit)
- os/kernel: 4.18.0-513.24.1.el8_9.x86_64 (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.22.1
- go/linking: static
- go/tags: none
Which cloud storage system are you using? (eg Google Drive)
bunny.net uploading through sftp
The command you were trying to run (eg rclone copy /tmp remote:tmp
)
rclone copy -P --disable PartialUploads /root/videos/ bunnycdn:videos/
Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.
[bunnycdn]
type = sftp
host = XXX
user = XXX
port = 22
pass = XXX
shell_type = unix
md5sum_command = none
sha1sum_command = none
Double check the config for sensitive info before posting publicly
A log from the command that you were trying to run with the -vv
flag
rclone copy -P --disable PartialUploads /root/videos/ bunnycdn:videos/ -vv
2024/06/06 16:31:36 DEBUG : rclone: Version "v1.66.0" starting with parameters ["rclone" "copy" "-P" "--disable" "PartialUploads" "/root/videos/" "bunnycdn:videos/" "-vv"]
2024/06/06 16:31:36 DEBUG : Creating backend with remote "/root/videos/"
2024/06/06 16:31:36 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2024/06/06 16:31:36 DEBUG : Reset feature "PartialUploads"
2024/06/06 16:31:36 DEBUG : fs cache: renaming cache item "/root/videos/" to be canonical "/root/videos"
2024/06/06 16:31:36 DEBUG : Creating backend with remote "bunnycdn:videos/"
2024/06/06 16:31:36 DEBUG : Reset feature "PartialUploads"
2024/06/06 16:31:37 DEBUG : sftp://bucket-prod@storage.bunnycdn.com:22/videos/: New connection 66.29.138.103:50512->109.61.89.55:22 to "SSH-2.0-RebexSSH_5.0.8348.0"
2024/06/06 16:31:38 DEBUG : sftp://bucket-prod@storage.bunnycdn.com:22/videos/: Shell type "unix" from config
2024/06/06 16:31:38 DEBUG : sftp://bucket-prod@storage.bunnycdn.com:22/videos/: Relative path resolved to "/videos"
2024/06/06 16:31:38 DEBUG : sftp://bucket-prod@storage.bunnycdn.com:22/videos/: Using root directory "/videos"
2024/06/06 16:31:41 INFO : 116: Set directory modification time (using DirSetModTime)
2024/06/06 16:31:41 DEBUG : Added delayed dir = "116", newDst=116
2024/06/06 16:31:41 INFO : 1160: Set directory modification time (using DirSetModTime)
2024/06/06 16:31:41 DEBUG : Added delayed dir = "1160", newDst=1160
2024/06/06 16:31:42 INFO : 1161: Set directory modification time (using DirSetModTime)
2024/06/06 16:31:42 DEBUG : Added delayed dir = "1161", newDst=1161
2024/06/06 16:31:42 INFO : 1162: Set directory modification time (using DirSetModTime)
2024/06/06 16:31:42 DEBUG : Added delayed dir = "1162", newDst=1162
2024/06/06 16:31:42 INFO : 1163: Set directory modification time (using DirSetModTime)
2024/06/06 16:31:42 DEBUG : Added delayed dir = "1163", newDst=1163
2024/06/06 16:31:43 INFO : 1164: Set directory modification time (using DirSetModTime)
2024/06/06 16:31:43 DEBUG : Added delayed dir = "1164", newDst=1164
2024/06/06 16:31:43 INFO : 1165: Set directory modification time (using DirSetModTime)
2024/06/06 16:31:43 DEBUG : Added delayed dir = "1165", newDst=1165