Sync copies everything

klingt.net · July 10, 2021, 12:36pm

$ rclone lsl scaleway:klingtnet-rclone-test-bucket --include="RELEASE.md"
     3370 2021-07-10 11:25:42.529905208 RELEASE.md
$ rclone copy ./rclone scaleway:klingtnet-rclone-test-bucket --include="RELEASE.md"  --log-level=INFO
<6>INFO  : There was nothing to transfer
<6>INFO  :
Transferred:             0 / 0 Bytes, -, 0 Bytes/s, ETA -
Checks:                 1 / 1, 100%
Elapsed time:         0.7s

$ rclone lsl scaleway:klingtnet-rclone-test-bucket --include="RELEASE.md"
     3370 2021-07-10 11:25:42.529905208 RELEASE.md

Ole · July 10, 2021, 12:41pm

rclone lsl scaleway:klingtnet-rclone-test-bucket 
rclone lsl scaleway:klingtnet-rclone-test-bucket --s3-storage-class=GLACIER

klingt.net · July 10, 2021, 12:42pm

At least we are able to narrow down the problem :

$ rclone lsl scaleway:klingtnet-rclone-test-bucket
     3370 2021-07-10 11:25:42.529905208 RELEASE.md
        0 2021-07-10 11:29:40.040607324 testfileglacier
$ rclone lsl scaleway:klingtnet-rclone-test-bucket --s3-storage-class=GLACIER
     3370 2021-07-10 11:25:42.529905208 RELEASE.md
        0 2021-07-10 11:29:40.040607324 testfileglacier

Ole · July 10, 2021, 12:46pm

Yep, hopefully more then halfway:

rclone lsl ./rclone --include="MANUAL.md"
rclone lsl scaleway:klingtnet-rclone-test-bucket --include="MANUAL.md" --s3-storage-class=GLACIER

klingt.net · July 10, 2021, 12:47pm

$ rclone lsl ./rclone --include="MANUAL.md"
  1202754 2021-07-10 11:25:42.529905208 MANUAL.md
$ rclone lsl scaleway:klingtnet-rclone-test-bucket --include="MANUAL.md" --s3-storage-class=GLACIER

Ole · July 10, 2021, 12:50pm

rclone copy ./rclone scaleway:klingtnet-rclone-test-bucket --include="MANUAL.md"  --s3-storage-class=GLACIER --log-level=INFO
rclone lsl scaleway:klingtnet-rclone-test-bucket --include="MANUAL.md" --s3-storage-class=GLACIER

klingt.net · July 10, 2021, 12:50pm

$ rclone copy ./rclone scaleway:klingtnet-rclone-test-bucket --include="MANUAL.md"  --s3-storage-class=GLACIER --log-level=INFO
<6>INFO  : MANUAL.md: Copied (new)
<6>INFO  :
Transferred:        1.147M / 1.147 MBytes, 100%, 828.231 kBytes/s, ETA 0s
Transferred:            1 / 1, 100%
Elapsed time:         1.9s

$ rclone lsl scaleway:klingtnet-rclone-test-bucket --include="MANUAL.md" --s3-storage-class=GLACIER
  1202754 2021-07-10 11:25:42.529905208 MANUAL.md

Ole · July 10, 2021, 12:52pm

Looks good, I have been looking forward to this:

rclone copy ./rclone scaleway:klingtnet-rclone-test-bucket --include="MANUAL.md"  --s3-storage-class=GLACIER --log-level=INFO
rclone lsl scaleway:klingtnet-rclone-test-bucket --include="MANUAL.md" --s3-storage-class=GLACIER

klingt.net · July 10, 2021, 12:54pm

$ rclone copy ./rclone scaleway:klingtnet-rclone-test-bucket --include="MANUAL.md"  --s3-storage-class=GLACIER --log-level=INFO
<6>INFO  : There was nothing to transfer
<6>INFO  :
Transferred:             0 / 0 Bytes, -, 0 Bytes/s, ETA -
Checks:                 1 / 1, 100%
Elapsed time:         0.6s

$ rclone lsl scaleway:klingtnet-rclone-test-bucket --include="MANUAL.md" --s3-storage-class=GLACIER
  1202754 2021-07-10 11:25:42.529905208 MANUAL.md

Ole · July 10, 2021, 12:58pm

rclone lsl ./rclone --include="MANUAL.md"
rclone lsl scaleway-encrypted-bucket: --include="MANUAL.md" --s3-storage-class=GLACIER
rclone copy ./rclone scaleway-encrypted-bucket: --include="MANUAL.md"  --s3-storage-class=GLACIER --log-level=INFO
rclone lsl scaleway-encrypted-bucket: --include="MANUAL.md" --s3-storage-class=GLACIER
rclone lsl scaleway:klingtnet-rclone-test-bucket

klingt.net · July 10, 2021, 1:00pm

$ rclone lsl ./rclone --include="MANUAL.md"
  1202754 2021-07-10 11:25:42.529905208 MANUAL.md
$ rclone lsl scaleway-encrypted-bucket: --include="MANUAL.md" --s3-storage-class=GLACIER
$ rclone copy ./rclone scaleway-encrypted-bucket: --include="MANUAL.md"  --s3-storage-class=GLACIER --log-level=INFO
<6>INFO  : MANUAL.md: Copied (new)
<6>INFO  :
Transferred:        1.147M / 1.147 MBytes, 100%, 1.247 MBytes/s, ETA 0s
Transferred:            1 / 1, 100%
Elapsed time:         1.4s

$ rclone lsl scaleway-encrypted-bucket: --include="MANUAL.md" --s3-storage-class=GLACIER
  1202754 2021-07-10 11:25:42.529905208 MANUAL.md
$ rclone lsl scaleway:klingtnet-rclone-test-bucket
  1202754 2021-07-10 11:25:42.529905208 MANUAL.md
     3370 2021-07-10 11:25:42.529905208 RELEASE.md
  1203090 2021-07-10 11:25:42.529905208 em6muotacmc4patgjrfmms57c4
        0 2021-07-10 11:29:40.040607324 testfileglacier

klingt.net · July 10, 2021, 1:01pm

@Ole Thank you for your dedication on solving the problem, I already start to feel bad stealing so much of your time.

Ole · July 10, 2021, 1:02pm

No problem, lets see if this succeeds too:

rclone copy ./rclone scaleway-encrypted-bucket: --include="MANUAL.md"  --s3-storage-class=GLACIER --log-level=INFO
rclone lsl scaleway-encrypted-bucket: --include="MANUAL.md" --s3-storage-class=GLACIER

klingt.net · July 10, 2021, 1:04pm

$ rclone copy ./rclone scaleway-encrypted-bucket: --include="MANUAL.md"  --s3-storage-class=GLACIER --log-level=INFO
<6>INFO  : There was nothing to transfer
<6>INFO  :
Transferred:             0 / 0 Bytes, -, 0 Bytes/s, ETA -
Checks:                 1 / 1, 100%
Elapsed time:         0.7s

$ rclone lsl scaleway-encrypted-bucket: --include="MANUAL.md" --s3-storage-class=GLACIER
  1202754 2021-07-10 11:25:42.529905208 MANUAL.md

klingt.net · July 10, 2021, 1:04pm

Looks good I guess.

Ole · July 10, 2021, 1:06pm

Correct, let's try sync too - just to be sure:

rclone sync ./rclone scaleway-encrypted-bucket: --include="MANUAL.md"  --s3-storage-class=GLACIER --log-level=INFO
rclone lsl scaleway-encrypted-bucket: --include="MANUAL.md" --s3-storage-class=GLACIER

klingt.net · July 10, 2021, 1:06pm

$ rclone sync ./rclone scaleway-encrypted-bucket: --include="MANUAL.md" --s3-storage-class=GLACIER --log-level=INFO
<6>INFO  : There was nothing to transfer
<6>INFO  :
Transferred:             0 / 0 Bytes, -, 0 Bytes/s, ETA -
Checks:                 1 / 1, 100%
Elapsed time:         0.6s

$ rclone lsl scaleway-encrypted-bucket: --include="MANUAL.md" --s3-storage-class=GLACIER
  1202754 2021-07-10 11:25:42.529905208 MANUAL.md

Ole · July 10, 2021, 1:09pm

All seems good with respect to rclone/Scaleway/GLACIER, something else is causing your initial issue.

Do you feel equipped to troubleshoot it (for now)?

klingt.net · July 10, 2021, 1:18pm

I think so. Thanks again, I will let you know if could not figure out what the initial problem was.

system · September 9, 2021, 9:19am

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.