Server side copy between two crypted remotes

What is the problem you are having with rclone?

I'm trying to copy crypted data between one Google Drive remote to another Google Drive remote. Both Google Drive remotes are encrypted with the same password. I expected them to do a server side copy, but it does not. I know that because the copying progress is slow, whereas when I do a copy using their encoded names directly, the transfers finish in seconds.

What is your rclone version (output from rclone version)

rclone v1.56.0

Which OS you are using and how many bits (eg Windows 7, 64 bit)

  • os/version: darwin 11.5 (64 bit)
  • os/kernel: 20.6.0 (x86_64)
  • os/type: darwin
  • os/arch: amd64

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

$ rclone copy a:FolderA b:FolderB/SubfolderC

Versus:

$ rclone backend encode a: 'FolderA'
b383u38cepmdni7hfpacr2hkj4
$ rclone backend encode b: 'FolderB/SubfolderC'
8lrgq0kj16e2pha2sdmp784nj4/87pjuphfhp710502vjrq8avh3g
$ rclone copy crypted-a:b383u38cepmdni7hfpacr2hkj4 crypted-b:8lrgq0kj16e2pha2sdmp784nj4/87pjuphfhp710502vjrq8avh3g

The rclone config contents with secrets removed.

[crypted-a]
type = drive
scope = drive
team_drive = xxxxxxxxxxxxxxxxxxx
root_folder_id =
server_side_across_configs = true
stop_on_upload_limit = true

[a]
type = crypt
remote = crypted-a:
filename_encryption = standard
directory_name_encryption = true
password = xxx
password2 = xxxx

[crypted-b]
type = drive
scope = drive
team_drive = xxxxxxxxxxxxxxxxxxx
root_folder_id =
server_side_across_configs = true
stop_on_upload_limit = true

[b]
type = crypt
remote = crypted-b:
filename_encryption = standard
directory_name_encryption = true
password = xxx
password2 = xxxx

A log from the command with the -vv flag

2021/08/04 13:07:27 DEBUG : Setting default for drive-service-account-file="accounts/xxxxxxxxxxxxxxxxxxxxxxxxxxxxx.json" from environment variable RCLONE_DRIVE_SERVICE_ACCOUNT_FILE
2021/08/04 13:07:27 DEBUG : rclone: Version "v1.56.0" starting with parameters ["./rclone" "copy" "a:FolderA" "b:FolderB/SubfolderC" "-vv"]
2021/08/04 13:07:27 DEBUG : Creating backend with remote "a:FolderA"
2021/08/04 13:07:27 DEBUG : Using config file from "~/.config/rclone/rclone.conf"
2021/08/04 13:07:27 DEBUG : Creating backend with remote "crypted-a:b383u38cepmdni7hfpacr2hkj4"
2021/08/04 13:07:27 DEBUG : Setting drive_service_account_file="accounts/xxxxxxxxxxxxxxxxxxxxxxxxxxxxx.json" from environment variable RCLONE_DRIVE_SERVICE_ACCOUNT_FILE
2021/08/04 13:07:27 DEBUG : crypted-a: detected overridden config - adding "{TI-pE}" suffix to name
2021/08/04 13:07:27 DEBUG : Setting drive_service_account_file="accounts/xxxxxxxxxxxxxxxxxxxxxxxxxxxxx.json" from environment variable RCLONE_DRIVE_SERVICE_ACCOUNT_FILE
2021/08/04 13:07:28 DEBUG : fs cache: renaming cache item "crypted-a:b383u38cepmdni7hfpacr2hkj4" to be canonical "crypted-a{TI-pE}:b383u38cepmdni7hfpacr2hkj4"
2021/08/04 13:07:28 DEBUG : fs cache: switching user supplied name "crypted-a:b383u38cepmdni7hfpacr2hkj4" for canonical name "crypted-a{TI-pE}:b383u38cepmdni7hfpacr2hkj4"
2021/08/04 13:07:28 DEBUG : Creating backend with remote "b:FolderB/SubfolderC"
2021/08/04 13:07:28 DEBUG : Creating backend with remote "crypted-b:8lrgq0kj16e2pha2sdmp784nj4/87pjuphfhp710502vjrq8avh3g"
2021/08/04 13:07:28 DEBUG : Setting drive_service_account_file="accounts/xxxxxxxxxxxxxxxxxxxxxxxxxxxxx.json" from environment variable RCLONE_DRIVE_SERVICE_ACCOUNT_FILE
2021/08/04 13:07:28 DEBUG : crypted-b: detected overridden config - adding "{TI-pE}" suffix to name
2021/08/04 13:07:28 DEBUG : Setting drive_service_account_file="accounts/xxxxxxxxxxxxxxxxxxxxxxxxxxxxx.json" from environment variable RCLONE_DRIVE_SERVICE_ACCOUNT_FILE
2021/08/04 13:07:29 DEBUG : fs cache: renaming cache item "crypted-b:8lrgq0kj16e2pha2sdmp784nj4/87pjuphfhp710502vjrq8avh3g" to be canonical "crypted-b{TI-pE}:8lrgq0kj16e2pha2sdmp784nj4/87pjuphfhp710502vjrq8avh3g"
2021/08/04 13:07:29 DEBUG : fs cache: switching user supplied name "crypted-b:8lrgq0kj16e2pha2sdmp784nj4/87pjuphfhp710502vjrq8avh3g" for canonical name "crypted-b{TI-pE}:8lrgq0kj16e2pha2sdmp784nj4/87pjuphfhp710502vjrq8avh3g"
2021/08/04 13:07:30 DEBUG : Encrypted drive 'b:FolderB/SubfolderC': Waiting for checks to finish
2021/08/04 13:07:30 DEBUG : Encrypted drive 'b:FolderB/SubfolderC': Waiting for transfers to finish
2021/08/04 13:07:33 DEBUG : c1fdkcb0q2e90ta37ji171jmufup0uc57ibrujo8ev6vm4h8jlre7luo8aetteu638nbn0lpuhku2jmep5qo5nau9r54jcr922bdg5golokjnd44rdbqlrku36lm2kti: Sending chunk 0 length 8388608
2021/08/04 13:07:33 DEBUG : 964undfi9r2hvkpdgpb9hld4bd4gcefu4n1lj6vh83hmttr0oi5g2l1ah0jm82132g6j5baopegj1s7cmb9q52l032av9thstgsuhh8ajj3ndhlnnf47vmmhupvs5cid: Sending chunk 0 length 8388608
2021/08/04 13:07:33 DEBUG : fuiskh6q8retu38331ceshp0nn0j13p5i9qoeikvmkm1rp5i6h8tnd6eup4r9jk05ltkosop7td91avjl1eir2drbne18f0hsm7slo2idilu87ignrch1da15ovpoi5q: Sending chunk 0 length 8388608
2021/08/04 13:07:33 DEBUG : fudq598dg0ch6qjqlnaonkcjv8h7jdrh36l015gs28id7igmadgvr4hui60udbeog3uqgld8v3rtaf3o6d5qone96qqeqocac28hm39v1c1vp83uo165rk96437ra2qa: Sending chunk 0 length 8388608
2021/08/04 13:07:34 DEBUG : c1fdkcb0q2e90ta37ji171jmufup0uc57ibrujo8ev6vm4h8jlre7luo8aetteu638nbn0lpuhku2jmep5qo5nau9r54jcr922bdg5golokjnd44rdbqlrku36lm2kti: Sending chunk 8388608 length 8388608
2021/08/04 13:07:34 DEBUG : 964undfi9r2hvkpdgpb9hld4bd4gcefu4n1lj6vh83hmttr0oi5g2l1ah0jm82132g6j5baopegj1s7cmb9q52l032av9thstgsuhh8ajj3ndhlnnf47vmmhupvs5cid: Sending chunk 8388608 length 8388608

by default, server side copy is not enabled.
try adding https://rclone.org/crypt/#crypt-server-side-across-configs

1 Like

Thanks, but I have that config in both of my remotes.

sorry, i edited the post why you you were replying.
try adding https://rclone.org/crypt/#crypt-server-side-across-configs

1 Like

AH! Yes, that works perfectly! Thank you! Learned something new everyday!

my motto has always been,
learn and return....

1 Like

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.