Revert filename encryption method

luckyluke · June 26, 2020, 4:50am

Same question as Revert standard filename encryption to simple obfuscated. But I did not find a solution so far.

od:--onedrive
ods: --encrypted onedrive(standard)

I found I cannot upload some of my files to ods:.
I tested serveral times and found the encrypted filename under standard method is too long for onedrive. So I decide to use the obfuscate method.
To keep the consistency, I need the files on drive with the same filename encryption method.

I setup a new remote with the same encryption password.
ods2:--encryted onedrive(obfuscate)
I tested the command

rclone move ods: ods2 -vv --dry-run
And the output tells all files are RENAMED.


2020/06/26 06:52:34 INFO  : There was nothing to transfer
2020/06/26 06:52:34 INFO  :
Transferred:             0 / 0 Bytes, -, 0 Bytes/s, ETA -
Checks:             13093 / 13093, 100%
Renamed:            13093
Elapsed time:         1.5s

2020/06/26 06:52:34 DEBUG : 5 go routines active

But when I run the command directly, the output shows rclone is downloading to local and then uploading.

Is there a way just to rename the files on drive without downloading?

I have enabled server side across configs

ncw · June 26, 2020, 10:28am

Can you paste your config without secrets/tokens so we can check it looks OK?

I think what you are doing sounds correct, I can't think why it doesn't work.

Can you do a small transfer with -vv and paste the log?

luckyluke · June 26, 2020, 3:16pm

It's gdrive. Sorry for the mistake. The problem still occurs.

Config file as followed:
[gd]
type = drive
client_id = [HIDDEN]
client_secret = [HIDDEN]
scope = drive
service_account_file =
token = [HIDDEN]
server_side_across_configs = true
shared_with_me = false
acknowledge_abuse = true
root_folder_id = 0AP44J_[HIDDEN]

[gds]
type = crypt
remote = gd:crypt
filename_encryption = standard
directory_name_encryption = false
password = 3B36AvCLLUZ [HIDDEN]

[gds2]
type = crypt
remote = gd:crypt2
filename_encryption = obfuscate
directory_name_encryption = false
password = HuBKAjs6mbH [HIDDEN]

This is the output with --dry-run:
This time I used another VPS with Ubuntu (Archlinux as former). The output seems a litte different.

2020/06/26 08:07:34 INFO  :
Transferred:             0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors:                 0
Checks:             15349 / 15349, 100%
Transferred:            0 / 0, -
Elapsed time:        2.1s

2020/06/26 08:07:34 DEBUG : 5 go routines active
2020/06/26 08:07:34 DEBUG : rclone: Version "v1.50.2" finishing with parameters ["rclone" "move" "gds:folder_A" "gds2:folder_A" "-vv" "--dry-run"]

This is output without --dry-run:

2020/06/26 08:10:25 DEBUG : [***FILENAME1***]: Sending chunk 0 length 8388608
2020/06/26 08:10:25 DEBUG : [***FILENAME2***]: Sending chunk 0 length 8388608
.
.
.

luckyluke · June 26, 2020, 3:45pm

More test result as below:

Initial upload:

 rclone copy testdir gds:testdir -vv
2020/06/26 08:43:28 DEBUG : rclone: Version "v1.50.2" starting with parameters ["rclone" "copy" "testdir" "gds:testdir" "-vv"]
2020/06/26 08:43:28 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2020/06/26 08:43:32 INFO  : Encrypted drive 'gds:testdir': Waiting for checks to finish
2020/06/26 08:43:32 INFO  : Encrypted drive 'gds:testdir': Waiting for transfers to finish
2020/06/26 08:43:34 DEBUG : gpab3sfh8frq9l0tf3r8kutha7548iatopemoa46n9qhgd6b232g: Sending chunk 0 length 8388608
2020/06/26 08:43:34 DEBUG : qj4bmjjhougp3f0ah7e4ljlofpp7664nhpt3l2921kl3fj8gq0o0: Sending chunk 0 length 8388608
2020/06/26 08:43:35 DEBUG : gpab3sfh8frq9l0tf3r8kutha7548iatopemoa46n9qhgd6b232g: Sending chunk 8388608 length 5278325
2020/06/26 08:43:35 DEBUG : jbmk4m5m8ptf78rpngub70evlscg60itlqg7b9abhbttqmp02jvg: Sending chunk 0 length 8388608
2020/06/26 08:43:35 DEBUG : qj4bmjjhougp3f0ah7e4ljlofpp7664nhpt3l2921kl3fj8gq0o0: Sending chunk 8388608 length 4454842
2020/06/26 08:43:35 DEBUG : jbmk4m5m8ptf78rpngub70evlscg60itlqg7b9abhbttqmp02jvg: Sending chunk 8388608 length 4084464
2020/06/26 08:43:36 DEBUG : 7ng6kidsdohnvukb1gn5nc9mn40m48ttp1v6dlfpc3bclvtaj1e9idq7is5l1frvais071e1nbhmc: Sending chunk 0 length 8388608
2020/06/26 08:43:36 DEBUG : 7ng6kidsdohnvukb1gn5nc9mn40m48ttp1v6dlfpc3bclvtaj1e9idq7is5l1frvais071e1nbhmc: Sending chunk 8388608 length 4903856
2020/06/26 08:43:38 INFO  : rclone-v1.52.2-windows-386.zip: Copied (new)
2020/06/26 08:43:39 INFO  : rclone-v1.52.2-linux-amd64.zip: Copied (new)
2020/06/26 08:43:39 INFO  : rclone-v1.52.2-linux-386.zip: Copied (new)
2020/06/26 08:43:40 INFO  : rclone-v1.52.2-windows-amd64.zip: Copied (new)
2020/06/26 08:43:40 INFO  :
Transferred:       49.854M / 49.854 MBytes, 100%, 6.195 MBytes/s, ETA 0s
Errors:                 0
Checks:                 0 / 0, -
Transferred:            4 / 4, 100%
Elapsed time:          8s

2020/06/26 08:43:40 DEBUG : 13 go routines active
2020/06/26 08:43:40 DEBUG : rclone: Version "v1.50.2" finishing with parameters ["rclone" "copy" "testdir" "gds:testdir" "-vv"]

Test with dry-run

rclone move gds:testdir gds2:testdir -vv --dry-run
2020/06/26 08:43:47 DEBUG : rclone: Version "v1.50.2" starting with parameters ["rclone" "move" "gds:testdir" "gds2:testdir" "-vv" "--dry-run"]
2020/06/26 08:43:47 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2020/06/26 08:43:54 NOTICE: rclone-v1.52.2-linux-amd64.zip: Not moving as --dry-run
2020/06/26 08:43:54 NOTICE: rclone-v1.52.2-windows-386.zip: Not moving as --dry-run
2020/06/26 08:43:54 NOTICE: rclone-v1.52.2-windows-amd64.zip: Not moving as --dry-run
2020/06/26 08:43:54 INFO  : Encrypted drive 'gds2:testdir': Waiting for checks to finish
2020/06/26 08:43:54 INFO  : Encrypted drive 'gds2:testdir': Waiting for transfers to finish
2020/06/26 08:43:54 NOTICE: rclone-v1.52.2-linux-386.zip: Not moving as --dry-run
2020/06/26 08:43:54 INFO  :
Transferred:             0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors:                 0
Checks:                 4 / 4, 100%
Transferred:            0 / 0, -
Elapsed time:          0s

2020/06/26 08:43:54 DEBUG : 11 go routines active
2020/06/26 08:43:54 DEBUG : rclone: Version "v1.50.2" finishing with parameters ["rclone" "move" "gds:testdir" "gds2:testdir" "-vv" "--dry-run"]

Then move between configs:

rclone move gds:testdir gds2:testdir -vv
2020/06/26 08:44:13 DEBUG : rclone: Version "v1.50.2" starting with parameters ["rclone" "move" "gds:testdir" "gds2:testdir" "-vv"]
2020/06/26 08:44:13 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2020/06/26 08:44:19 INFO  : Encrypted drive 'gds2:testdir': Waiting for checks to finish
2020/06/26 08:44:19 INFO  : Encrypted drive 'gds2:testdir': Waiting for transfers to finish
2020/06/26 08:44:23 DEBUG : 248.JuDGFw-N8.29.9-DAFMP-053.RAH: Sending chunk 0 length 8388608
2020/06/26 08:44:23 DEBUG : 243.EpyBAr-I3.74.4-yvAHK-nzq86.MvC: Sending chunk 0 length 8388608
2020/06/26 08:44:23 DEBUG : 206.sdmpof-w2.63.3-xjoepxt-bne75.Ajq: Sending chunk 0 length 8388608
2020/06/26 08:44:23 DEBUG : 211.xirutk-B7.18.8-CotjuCy-942.Fov: Sending chunk 0 length 8388608
2020/06/26 08:44:23 DEBUG : 248.JuDGFw-N8.29.9-DAFMP-053.RAH: Sending chunk 8388608 length 4454842
2020/06/26 08:44:23 DEBUG : 243.EpyBAr-I3.74.4-yvAHK-nzq86.MvC: Sending chunk 8388608 length 5278325
2020/06/26 08:44:24 DEBUG : 211.xirutk-B7.18.8-CotjuCy-942.Fov: Sending chunk 8388608 length 4084464
2020/06/26 08:44:24 DEBUG : 206.sdmpof-w2.63.3-xjoepxt-bne75.Ajq: Sending chunk 8388608 length 4903856
2020/06/26 08:44:25 INFO  : rclone-v1.52.2-linux-386.zip: Copied (new)
2020/06/26 08:44:25 INFO  : rclone-v1.52.2-linux-amd64.zip: Copied (new)
2020/06/26 08:44:26 INFO  : rclone-v1.52.2-windows-386.zip: Copied (new)
2020/06/26 08:44:26 INFO  : rclone-v1.52.2-linux-386.zip: Deleted
2020/06/26 08:44:26 INFO  : rclone-v1.52.2-windows-amd64.zip: Copied (new)
2020/06/26 08:44:26 INFO  : rclone-v1.52.2-windows-386.zip: Deleted
2020/06/26 08:44:27 INFO  : rclone-v1.52.2-linux-amd64.zip: Deleted
2020/06/26 08:44:27 INFO  : rclone-v1.52.2-windows-amd64.zip: Deleted
2020/06/26 08:44:27 INFO  :
Transferred:       49.854M / 49.854 MBytes, 100%, 6.052 MBytes/s, ETA 0s
Errors:                 0
Checks:                 8 / 8, 100%
Transferred:            4 / 4, 100%
Elapsed time:        8.2s

2020/06/26 08:44:27 DEBUG : 23 go routines active
2020/06/26 08:44:27 DEBUG : rclone: Version "v1.50.2" finishing with parameters ["rclone" "move" "gds:testdir" "gds2:testdir" "-vv"]

luckyluke · June 26, 2020, 3:53pm

@ncw test log posted.

ncw · June 27, 2020, 10:43am

Ahh, I see what is going on.

This adds a new flag --crypt-server-side-across-configs - I think if you use that then it should work properly.

https://beta.rclone.org/branch/v1.52.2-136-g61ff7306-fix-crypt-server-side-beta/ (uploaded in 15-30 mins)

luckyluke · June 27, 2020, 2:26pm

Works well till now.

ncw · June 28, 2020, 4:38pm

Thanks for testing. I've merged this to master now which means it will be in the latest beta in 15-30 mins and released in v1.53

system · July 1, 2020, 4:38pm

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.