Sync cached remote to a different remote

What is the problem you are having with rclone?

Sync cached remote to a different remote

Run the command 'rclone version' and share the full output of the command.

rclone v1.57.0

  • os/version: arch 21.2.3 (64 bit)
  • os/kernel: 5.15.19-1-MANJARO (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.17.5
  • go/linking: dynamic
  • go/tags: none

yes

Which cloud storage system are you using? (eg Google Drive)

google drive and wasabi

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone sync --fast-list -P /home/gdrive wasabi_drive:

I want to move my content from gdrive to wasabi
Used following command
rclone sync -P gdrive: wasabi_drive:
note: they have different passwords.

After around 30 percent, I remembered that gdrive is fully cached locally, and I tried following:
rclone sync --fast-list -P /home/gdrive wasabi_drive:
it works but ignores the first copied data and shows that I have whole amount of data to copy again.

Am I doing something wrong?

if you want to copy files from the cache remote, then that should be the source
can you post the redacted config file?

[gdrive_init]
type = drive
client_id = REDACTED.apps.googleusercontent.com
client_secret = REDACTED
scope = drive
token = REDACTED
team_drive = 

[gdrive]
type = crypt
remote = gdrive_init:main
password = REDACTED

[wasabi]
type = s3
provider = Wasabi
access_key_id = REDACTED
secret_access_key = REDACTED
region = REDACTED
endpoint = REDACTED

[wasabi_drive]
type = crypt
remote = wasabi:main
password = REDACTED
password2 = REDACTED

are you using a rclone mount, is that where the cached files are?
if true, then post the command.

[Unit]
Description=rclone gdrive mount
After=network-online.target

[Service]
Type=notify
User=REDACTED
ExecStart=/usr/bin/rclone mount \
        --config=/home/REDACTED/.config/rclone/rclone.conf \
        --cache-dir=/.cache_storage/gdrive \
        --vfs-cache-mode full \
        --vfs-cache-max-size 500G \
        --vfs-cache-max-age 5000h \
        --no-modtime \
#        -vv --log-file /home/alveri/logs/rclone.log \
        gdrive: /home/gdrive
ExecStop=/bin/fusermount -uz /home/gdrive
Restart=on-failure
KillMode=none
RestartSec=1600

[Install]
WantedBy=default.target

unless there is a reason not to, imho, i would
--- use the same passwords for two crypts.
--- copy the files in their crypted state, not trying to decrypt then recrypt them and upload them.
rclone copy gdrive_init:main wasabi:main --checksum

but cache in decrypted form is already downloaded that's why I want to sync with mounted drive to use the cache and don't download even encrypted data

not sure exactly why, would need to see a debug log

if this is a one time transfer and 30% is already done, might just let it finish.

1 Like

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.