Possible to copy crypt to crypt diffrent td's

What is the problem you are having with rclone?

I would like to have 2 TD's one for tv and one for movies, atm they are located on my main TD as crypted content. Is it possible to copy/move that to each their own TD ? I have rclone webgui in and I can browse the content of the crypted drive fine and see the content without it's crypted. So can I move it from the WEBgui?

Run the command 'rclone version' and share the full output of the command.

rclone v1.58.1
- os/version: ubuntu 21.10 (64 bit)
- os/kernel: 5.13.0-52-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.17.9
- go/linking: static
- go/tags: none

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The rclone config contents with secrets removed.

FROM:
This TD contains different folders like : TV-NORDIC/TV-DANISH/TV-CARTOONS/TV-NON-SUBS
rclone_lsd

[tdrive]
client_id = xxxx
client_secret = xxxx
type = drive
token = xxxx
team_drive = xxxx

[tcrypt]
type = crypt
remote = tdrive:/encrypt
filename_encryption = standard
directory_name_encryption = true
password = xxxx
password2 = xxxx

TO:

[tv]
type = drive
client_id = xxxx
client_secret = xxxx
scope = drive
token = xxxx
team_drive = xxxx
root_folder_id = 

tv_crypt]
type = crypt
remote = tv:/
password = xxxx
password2 = xxxx

You can figure out all that out and use the WebGUI or you can just move it via and use:

Hi,

Let me get this right. So I have the [tv] created. and made it show up in the rclone browser. then I can just right click on lets say : TV-NORDIC and press move. and then tell it to move it to [tv] ?

Sorry I as I don't use any browser or the rclone GUI so I couldn't comment on how to do it via any of the GUIs.

rclone move crypt1:somefile.txt crypt2: --crypt-server-side-across-configs -vv 

Test with one file, validate it does a server side move and do more.

Hi,

Yes I will give it a go I just need to understand this part:

rclone move crypt1:somefile.txt crypt2: --crypt-server-side-across-configs -vv 

somefile.txt should that be in my case :

rclone move tcrypt:/TV-NORDIC/9-1-1.xx.xx-group tv-crypt: --crypt-server-side-across-configs -vv

I am not a huge risk taker so I'd pick one file.

I'd copy one test file to tcrypt:

rclone copy somefile.txt tcrypt:

and then test the move

rclone copy tcrypt:somefile.txt tv_crypt: -vv --crypt-server-side-across-configs -vv

If it says server side, you'd be good. If not, just post the debug output and I recall perhaps some other combinations might be needed, but can tackle that if it is still the case.

So somefile.txt is something rclone randomly makes to test the command, if I understand you correct? or do I need to make the file :confused:

klapvogn@skyvault:~$ rclone copy testfile.txt tcrypt:
klapvogn@skyvault:~$ rclone copy tcrypt:testfile.txt tv_crypt: -vv --crypt-server-side-across-configs -vv
2023/01/29 14:06:46 DEBUG : rclone: Version "v1.58.1" starting with parameters ["rclone" "copy" "tcrypt:testfile.txt" "tv_crypt:" "-vv" "--crypt-server-side-across-configs" "-vv"]
2023/01/29 14:06:46 DEBUG : Creating backend with remote "tcrypt:testfile.txt"
2023/01/29 14:06:46 DEBUG : Using config file from "/home/klapvogn/.config/rclone/rclone.conf"
2023/01/29 14:06:46 DEBUG : tcrypt: detected overridden config - adding "{Db_Y9}" suffix to name
2023/01/29 14:06:46 DEBUG : Creating backend with remote "tdrive:/encrypt/h2qhq4djcomqm5387q0thov4kk"
2023/01/29 14:06:48 DEBUG : fs cache: adding new entry for parent of "tdrive:/encrypt/h2qhq4djcomqm5387q0thov4kk", "tdrive:encrypt"
2023/01/29 14:06:48 DEBUG : fs cache: adding new entry for parent of "tcrypt:testfile.txt", "tcrypt{Db_Y9}:testfile.txt"
2023/01/29 14:06:48 DEBUG : Creating backend with remote "tv_crypt:"
2023/01/29 14:06:48 DEBUG : tv_crypt: detected overridden config - adding "{Db_Y9}" suffix to name
2023/01/29 14:06:48 DEBUG : Creating backend with remote "tv:/"
2023/01/29 14:06:48 DEBUG : fs cache: renaming cache item "tv:/" to be canonical "tv:"
2023/01/29 14:06:48 DEBUG : fs cache: renaming cache item "tv_crypt:" to be canonical "tv_crypt{Db_Y9}:"
2023/01/29 14:06:48 DEBUG : testfile.txt: Need to transfer - File not found at Destination
2023/01/29 14:06:51 DEBUG : testfile.txt: md5 = b619633b63643ae7326b0bc6b035b0de OK
2023/01/29 14:06:51 INFO  : testfile.txt: Copied (new)
2023/01/29 14:06:51 INFO  :
Transferred:             32 B / 32 B, 100%, 15 B/s, ETA 0s
Transferred:            1 / 1, 100%
Elapsed time:         4.9s
klapvogn@skyvault:~$ rclone ls tv_crypt:/
        0 testfile.txt

looks like that did not do a server-side copy, as it should look like
Copied (server-side copy)

try adding --server-side-across-configs or --drive-server-side-across-configs

rclone copy tcrypt:testfile.txt tv_crypt: -vv  --server-side-across-configs -vv
Fatal error: unknown flag: --server-side-across-configs
klapvogn@skyvault:~$ rclone copy tcrypt:testfile.txt tv_crypt: -vv  --drive-server-side-across-configs -vv
2023/01/30 17:07:27 DEBUG : rclone: Version "v1.58.1" starting with parameters ["rclone" "copy" "tcrypt:testfile.txt" "tv_crypt:" "-vv" "--drive-server-side-across-configs" "-vv"]
2023/01/30 17:07:27 DEBUG : Creating backend with remote "tcrypt:testfile.txt"
2023/01/30 17:07:27 DEBUG : Using config file from "/home/klapvogn/.config/rclone/rclone.conf"
2023/01/30 17:07:27 DEBUG : Creating backend with remote "tdrive:/encrypt/h2qhq4djcomqm5387q0thov4kk"
2023/01/30 17:07:27 DEBUG : tdrive: detected overridden config - adding "{Db_Y9}" suffix to name
2023/01/30 17:07:29 DEBUG : fs cache: adding new entry for parent of "tdrive:/encrypt/h2qhq4djcomqm5387q0thov4kk", "tdrive{Db_Y9}:encrypt"
2023/01/30 17:07:29 DEBUG : Creating backend with remote "tv_crypt:"
2023/01/30 17:07:29 DEBUG : Creating backend with remote "tv:/"
2023/01/30 17:07:29 DEBUG : tv: detected overridden config - adding "{Db_Y9}" suffix to name
2023/01/30 17:07:29 DEBUG : fs cache: renaming cache item "tv:/" to be canonical "tv{Db_Y9}:"
2023/01/30 17:07:30 DEBUG : tv{Db_Y9}: Loaded invalid token from config file - ignoring
2023/01/30 17:07:30 DEBUG : Saving config "token" in section "tv" of the config file
2023/01/30 17:07:30 DEBUG : Keeping previous permissions for config file: -rwxrwxr-x
2023/01/30 17:07:30 DEBUG : tv{Db_Y9}: Saved new token in config file
2023/01/30 17:07:30 DEBUG : testfile.txt: Need to transfer - File not found at Destination
2023/01/30 17:07:33 DEBUG : testfile.txt: md5 = d93c80116dad4db72764222a3e473401 OK
2023/01/30 17:07:33 INFO  : testfile.txt: Copied (new)
2023/01/30 17:07:33 INFO  :
Transferred:             32 B / 32 B, 100%, 15 B/s, ETA 0s
Transferred:            1 / 1, 100%
Elapsed time:         5.2s

Update your version.

rclone copy tcrypt:testfile.txt tv_crypt: -vv --server-side-across-configs -vv
2023/01/30 17:20:38 DEBUG : rclone: Version "v1.61.1" starting with parameters ["rclone" "copy" "tcrypt:testfile.txt" "tv_crypt:" "-vv" "--server-side-across-configs" "-vv"]
2023/01/30 17:20:38 DEBUG : Creating backend with remote "tcrypt:testfile.txt"
2023/01/30 17:20:38 DEBUG : Using config file from "/home/klapvogn/.config/rclone/rclone.conf"
2023/01/30 17:20:38 DEBUG : Creating backend with remote "tdrive:/encrypt/h2qhq4djcomqm5387q0thov4kk"
2023/01/30 17:20:40 DEBUG : fs cache: adding new entry for parent of "tdrive:/encrypt/h2qhq4djcomqm5387q0thov4kk", "tdrive:encrypt"
2023/01/30 17:20:40 DEBUG : Creating backend with remote "tv_crypt:"
2023/01/30 17:20:40 DEBUG : Creating backend with remote "tv:/"
2023/01/30 17:20:40 DEBUG : fs cache: renaming cache item "tv:/" to be canonical "tv:"
2023/01/30 17:20:40 DEBUG : testfile.txt: Need to transfer - File not found at Destination
2023/01/30 17:20:42 INFO  : testfile.txt: Copied (server-side copy)
2023/01/30 17:20:42 INFO  :
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Transferred:            1 / 1, 100%
Elapsed time:         3.9s

good, by using --server-side-across-configs, server-side is now working.

It does yes :slight_smile:

I don't know if your up to speed in this thread, would I now could do : rclone move tcrypt:/TV-NORDIC tv_crypt:/ -vv --server-side-across-configs -vv

well, i would say no, not yet.

your command moves the files of tcrypt:/TV-NORDIC to the root of tv_crypt:
rclone will not automaticlly create tv_crypt:TV-NORDIC
which one of these do you want as the dest?
tv_crypt:
or
tv_crypt:TV-NORDIC

and need to be very careful with rclone move, it is destructive, deletes files in the source.
test with --dry-run and confirm the output.

or try using a dummy test folder.

  1. create a test folder and file - touch tcrypt:testfolder/file.ext
  2. rclone copy tcrypt:testfolder tv_crypt:testfolder -vv --server-side-across-configs -vv --dry-run
    if that looks ok
    rclone move tcrypt:testfolder tv_crypt:testfolder -vv --server-side-across-configs -vv --dry-run
  3. if that works, then remove --dry-run and run command again.
  • It should go from tcrypt:/ to tv_crypt:/ and the TV-NORDIC is hmm see pic:
    tv_crypt

Did the test:

klapvogn@skyvault:~$ rclone copy tcrypt:testfolder tv_crypt:testfolder -vv --server-side-across-configs -vv --dry-run
2023/01/30 17:51:00 DEBUG : rclone: Version "v1.61.1" starting with parameters ["rclone" "copy" "tcrypt:testfolder" "tv_crypt:testfolder" "-vv" "--server-side-across-configs" "-vv" "--dry-run"]
2023/01/30 17:51:00 DEBUG : Creating backend with remote "tcrypt:testfolder"
2023/01/30 17:51:00 DEBUG : Using config file from "/home/klapvogn/.config/rclone/rclone.conf"
2023/01/30 17:51:00 DEBUG : Creating backend with remote "tdrive:/encrypt/9ugv85dhibsvt5ga1qa2dr0vcc"
2023/01/30 17:51:01 DEBUG : fs cache: renaming cache item "tdrive:/encrypt/9ugv85dhibsvt5ga1qa2dr0vcc" to be canonical "tdrive:encrypt/9ugv85dhibsvt5ga1qa2dr0vcc"
2023/01/30 17:51:01 DEBUG : fs cache: switching user supplied name "tdrive:/encrypt/9ugv85dhibsvt5ga1qa2dr0vcc" for canonical name "tdrive:encrypt/9ugv85dhibsvt5ga1qa2dr0vcc"
2023/01/30 17:51:01 DEBUG : Creating backend with remote "tv_crypt:testfolder"
2023/01/30 17:51:01 DEBUG : Creating backend with remote "tv:/7go619mtpbi0a0a1qf7htjhpk0"
2023/01/30 17:51:02 DEBUG : fs cache: renaming cache item "tv:/7go619mtpbi0a0a1qf7htjhpk0" to be canonical "tv:7go619mtpbi0a0a1qf7htjhpk0"
2023/01/30 17:51:02 DEBUG : fs cache: switching user supplied name "tv:/7go619mtpbi0a0a1qf7htjhpk0" for canonical name "tv:7go619mtpbi0a0a1qf7htjhpk0"
2023/01/30 17:51:02 DEBUG : Encrypted drive 'tv_crypt:testfolder': Waiting for checks to finish
2023/01/30 17:51:02 DEBUG : Encrypted drive 'tv_crypt:testfolder': Waiting for transfers to finish
2023/01/30 17:51:02 NOTICE: file.ext: Skipped copy as --dry-run is set (size 0)
2023/01/30 17:51:02 NOTICE:
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Transferred:            1 / 1, 100%
Elapsed time:         1.8s

klapvogn@skyvault:~$ rclone move tcrypt:testfolder tv_crypt:testfolder -vv --server-side-across-configs -vv --dry-run
2023/01/30 17:55:30 DEBUG : rclone: Version "v1.61.1" starting with parameters ["rclone" "move" "tcrypt:testfolder" "tv_crypt:testfolder" "-vv" "--server-side-across-configs" "-vv" "--dry-run"]
2023/01/30 17:55:30 DEBUG : Creating backend with remote "tcrypt:testfolder"
2023/01/30 17:55:30 DEBUG : Using config file from "/home/klapvogn/.config/rclone/rclone.conf"
2023/01/30 17:55:30 DEBUG : Creating backend with remote "tdrive:/encrypt/9ugv85dhibsvt5ga1qa2dr0vcc"
2023/01/30 17:55:30 DEBUG : fs cache: renaming cache item "tdrive:/encrypt/9ugv85dhibsvt5ga1qa2dr0vcc" to be canonical "tdrive:encrypt/9ugv85dhibsvt5ga1qa2dr0vcc"
2023/01/30 17:55:30 DEBUG : fs cache: switching user supplied name "tdrive:/encrypt/9ugv85dhibsvt5ga1qa2dr0vcc" for canonical name "tdrive:encrypt/9ugv85dhibsvt5ga1qa2dr0vcc"
2023/01/30 17:55:30 DEBUG : Creating backend with remote "tv_crypt:testfolder"
2023/01/30 17:55:30 DEBUG : Creating backend with remote "tv:/7go619mtpbi0a0a1qf7htjhpk0"
2023/01/30 17:55:31 DEBUG : fs cache: renaming cache item "tv:/7go619mtpbi0a0a1qf7htjhpk0" to be canonical "tv:7go619mtpbi0a0a1qf7htjhpk0"
2023/01/30 17:55:31 DEBUG : fs cache: switching user supplied name "tv:/7go619mtpbi0a0a1qf7htjhpk0" for canonical name "tv:7go619mtpbi0a0a1qf7htjhpk0"
2023/01/30 17:55:32 DEBUG : Encrypted drive 'tv_crypt:testfolder': Waiting for checks to finish
2023/01/30 17:55:32 DEBUG : Encrypted drive 'tv_crypt:testfolder': Waiting for transfers to finish
2023/01/30 17:55:32 NOTICE: file.ext: Skipped move as --dry-run is set (size 0)
2023/01/30 17:55:32 INFO  : There was nothing to transfer
2023/01/30 17:55:32 NOTICE:
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Checks:                 1 / 1, 100%
Renamed:                1
Elapsed time:         2.0s

klapvogn@skyvault:~$ rclone move tcrypt:testfolder tv_crypt:testfolder -vv --server-side-across-configs -vv
2023/01/30 17:55:57 DEBUG : rclone: Version "v1.61.1" starting with parameters ["rclone" "move" "tcrypt:testfolder" "tv_crypt:testfolder" "-vv" "--server-side-across-configs" "-vv"]
2023/01/30 17:55:57 DEBUG : Creating backend with remote "tcrypt:testfolder"
2023/01/30 17:55:57 DEBUG : Using config file from "/home/klapvogn/.config/rclone/rclone.conf"
2023/01/30 17:55:57 DEBUG : Creating backend with remote "tdrive:/encrypt/9ugv85dhibsvt5ga1qa2dr0vcc"
2023/01/30 17:55:58 DEBUG : fs cache: renaming cache item "tdrive:/encrypt/9ugv85dhibsvt5ga1qa2dr0vcc" to be canonical "tdrive:encrypt/9ugv85dhibsvt5ga1qa2dr0vcc"
2023/01/30 17:55:58 DEBUG : fs cache: switching user supplied name "tdrive:/encrypt/9ugv85dhibsvt5ga1qa2dr0vcc" for canonical name "tdrive:encrypt/9ugv85dhibsvt5ga1qa2dr0vcc"
2023/01/30 17:55:58 DEBUG : Creating backend with remote "tv_crypt:testfolder"
2023/01/30 17:55:58 DEBUG : Creating backend with remote "tv:/7go619mtpbi0a0a1qf7htjhpk0"
2023/01/30 17:55:58 DEBUG : fs cache: renaming cache item "tv:/7go619mtpbi0a0a1qf7htjhpk0" to be canonical "tv:7go619mtpbi0a0a1qf7htjhpk0"
2023/01/30 17:55:58 DEBUG : fs cache: switching user supplied name "tv:/7go619mtpbi0a0a1qf7htjhpk0" for canonical name "tv:7go619mtpbi0a0a1qf7htjhpk0"
2023/01/30 17:55:59 DEBUG : Encrypted drive 'tv_crypt:testfolder': Waiting for checks to finish
2023/01/30 17:55:59 DEBUG : Encrypted drive 'tv_crypt:testfolder': Waiting for transfers to finish
2023/01/30 17:56:01 INFO  : file.ext: Moved (server-side)
2023/01/30 17:56:01 INFO  : There was nothing to transfer
2023/01/30 17:56:01 INFO  :
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Checks:                 1 / 1, 100%
Renamed:                1
Elapsed time:         4.5s

klapvogn@skyvault:~$ rclone ls tv_crypt:
        0 testfolder/file.ext

the output looks good.

I Think so to, but im kinda scared to do this, what if something goes wrong, how about playing it safe and just do rclone copy ?

yes, that is what i always do. i did not make that clear enough in my posts.

Cool thanks, and if everything goes good I can delete the old folder afterwards