What is the problem you are having with rclone?
I encounter abnormal check speed on C14 / Scaleway backend with rclone v1.58.1. Same command used with version v1.57 runs just fine.
I've runed several times the same test :
- v1.57 : 11363 files checked ended in ~ 4 minutes and 15 secondes
- v1.58.1 : in ~ 4 minutes, 400 files checked
I've tried on Windows 10 and on my Debian NAS. I've same results : slow checks with v1.58.1 and normal speed with v1.57.
Changelog talks about changes in Version of ListObjects
. I tried to figure out if this could be related with my problem. The above command has been tried with --s3-list-version 1
and --s3-list-version 2
without any better improvement. That's strange
I don't know what other change has been made from 1.57 to 1.58.1 and that could be tested easily. Let me know if you have any idea ...
I don't need v1.58.1 for the moment and I went back to my beloved v1.57.
Run the command 'rclone version' and share the full output of the command.
rclone v1.58.1
- os/version: Microsoft Windows 10 Home 21H2 (64 bit)
- os/kernel: 10.0.19044.1706 (x86_64)
- os/type: windows
- os/arch: amd64
- go/version: go1.17.9
- go/linking: dynamic
- go/tags: cmount
Which cloud storage system are you using? (eg Google Drive)
C14 / Scaleway. It's an S3 compatible backend, similar to Amazon Glacier
The command you were trying to run (eg rclone copy /tmp remote:tmp
)
rclone sync "\\naspi4c\data\Mes photos\2021" c14:"cl-backup/Mes photos/2021" --dry-run -vv
The rclone config contents with secrets removed.
[c14]
type = s3
provider = Scaleway
env_auth = false
access_key_id = XXX
secret_access_key = XXX
region = fr-par
endpoint = s3.fr-par.scw.cloud
acl = private
storage_class = GLACIER
A log from the command with the -vv
flag
2022/06/05 09:24:40 DEBUG : rclone: Version "v1.58.1" starting with parameters ["rclone" "sync" "\\\\naspi4c\\data\\Mes photos\\2021" "c14:cl-backup/Mes photos/2021" "--dry-run" "-vv" "--log-file=D:\\Users\\JC\\Mes programmes\\Internet\\rclone\\rclone-v1.58.1-windows-amd64\\rclone-v1.58.1-windows-amd64\\output.txt"]
2022/06/05 09:24:40 DEBUG : Creating backend with remote "\\\\naspi4c\\data\\Mes photos\\2021"
2022/06/05 09:24:40 DEBUG : Using config file from "C:\\Users\\JC\\.config\\rclone\\rclone.conf"
2022/06/05 09:24:40 DEBUG : fs cache: renaming cache item "\\\\naspi4c\\data\\Mes photos\\2021" to be canonical "//?/UNC/naspi4c/data/Mes photos/2021"
2022/06/05 09:24:40 DEBUG : Creating backend with remote "c14:cl-backup/Mes photos/2021"
2022/06/05 09:24:54 DEBUG : 2021-01-10/IMG_1854.CR2: Size and modification time the same (differ by 0s, within tolerance 100ns)
2022/06/05 09:24:54 DEBUG : 2021-01-10/IMG_1854.CR2: Unchanged skipping
2022/06/05 09:24:54 DEBUG : 2021-01-10/IMG_1852.CR2: Size and modification time the same (differ by 0s, within tolerance 100ns)
2022/06/05 09:24:54 DEBUG : 2021-01-10/IMG_1852.CR2: Unchanged skipping
2022/06/05 09:24:54 DEBUG : 2021-01-10/IMG_1852.xmp: Size and modification time the same (differ by 0s, within tolerance 100ns)
2022/06/05 09:24:54 DEBUG : 2021-01-10/IMG_1852.xmp: Unchanged skipping
2022/06/05 09:24:54 DEBUG : 2021-01-10/IMG_1854.xmp: Size and modification time the same (differ by 0s, within tolerance 100ns)
2022/06/05 09:24:54 DEBUG : 2021-01-10/IMG_1854.xmp: Unchanged skipping
2022/06/05 09:24:54 DEBUG : 2021-01-10/IMG_1852.JPG: Size and modification time the same (differ by 0s, within tolerance 100ns)
2022/06/05 09:24:54 DEBUG : 2021-01-10/IMG_1852.JPG: Unchanged skipping
2022/06/05 09:24:54 DEBUG : 2021-01-10/IMG_1855.CR2: Size and modification time the same (differ by 0s, within tolerance 100ns)
2022/06/05 09:24:54 DEBUG : 2021-01-10/IMG_1855.CR2: Unchanged skipping
2022/06/05 09:24:54 DEBUG : 2021-01-10/IMG_1855.JPG: Size and modification time the same (differ by 0s, within tolerance 100ns)
2022/06/05 09:24:54 DEBUG : 2021-01-10/IMG_1855.JPG: Unchanged skipping
2022/06/05 09:24:54 DEBUG : 2021-01-10/IMG_1854.JPG: Size and modification time the same (differ by 0s, within tolerance 100ns)
2022/06/05 09:24:54 DEBUG : 2021-01-10/IMG_1854.JPG: Unchanged skipping
2022/06/05 09:24:59 DEBUG : 2021-01-10/IMG_1855.xmp: Size and modification time the same (differ by 0s, within tolerance 100ns)
2022/06/05 09:24:59 DEBUG : 2021-01-10/IMG_1855.xmp: Unchanged skipping
2022/06/05 09:24:59 DEBUG : 2021-01-10/IMG_1859.JPG: Size and modification time the same (differ by 0s, within tolerance 100ns)
2022/06/05 09:24:59 DEBUG : 2021-01-10/IMG_1859.JPG: Unchanged skipping
2022/06/05 09:24:59 DEBUG : 2021-01-10/IMG_1859.xmp: Size and modification time the same (differ by 0s, within tolerance 100ns)
2022/06/05 09:24:59 DEBUG : 2021-01-10/IMG_1859.xmp: Unchanged skipping
2022/06/05 09:24:59 DEBUG : 2021-01-10/IMG_1861.CR2: Size and modification time the same (differ by 0s, within tolerance 100ns)
2022/06/05 09:24:59 DEBUG : 2021-01-10/IMG_1861.CR2: Unchanged skipping
2022/06/05 09:24:59 DEBUG : 2021-01-10/IMG_1862.CR2: Size and modification time the same (differ by 0s, within tolerance 100ns)
and going on going on ...