What is the problem you are having with rclone?
Rclone moveto command keeps giving me an error that hashes don't match and it can't open the file it just moved. Retrying does not help either.
Seems as if the moveto command is simply removing the files before checks can take place.
Transferring:
* c3b1b1cf-6cda-45ca-a34…80--color--topView.zip: 11% /3.415G, 778.899k/s, 1h7m51s
* c7188c34-3e04-4322-aa8…5--color--farRight.zip:100% /386.602M, 170.081k/s, 0s
2021/03/19 15:29:13 ERROR : c7188c34-3e04-4322-aa84-d41731e85ce5--color--farRight.zip: Failed to calculate src hash: hash: failed to open: open /env/app/output/sessions/c7188c34-3e04-4322-aa84-d41731e85ce5--color--farRight.zip: no such file or directory
2021/03/19 15:29:13 ERROR : c7188c34-3e04-4322-aa84-d41731e85ce5--color--farRight.zip: corrupted on transfer: MD5 hash differ "" vs "93eecb802477cbe0de7fb38a5c6d00b2"
2021/03/19 15:29:13 INFO : c7188c34-3e04-4322-aa84-d41731e85ce5--color--farRight.zip: Removing failed copy
2021/03/19 15:29:14 ERROR : c7188c34-3e04-4322-aa84-d41731e85ce5--color--farRight.zip: Not deleting source as copy failed: corrupted on transfer: MD5 hash differ "" vs "93eecb802477cbe0de7fb38a5c6d00b2"
2021/03/19 15:30:07 INFO :
Transferred: 834.602M / 86.339 GBytes, 1%, 678.409 kBytes/s, ETA 1d12h43m9s
Errors: 2 (retrying may help)
Checks: 1 / 3, 33%
Transferred: 0 / 284, 0%
Elapsed time: 21m0.7s
Checking:
What is your rclone version (output from rclone version)
rclone v1.54.0
Which OS you are using and how many bits (eg Windows 7, 64 bit)
- os/arch: linux/arm64
- go version: go1.15.7
Which cloud storage system are you using? (eg Google Drive)
Google Cloud storage
The command you were trying to run (eg rclone copy /tmp remote:tmp)
rclone --gcs-service-account-file <GCP_STORAGE_KEY>.json \
--transfers=2 --checkers=4 \
--include /*.zip \
moveto /env/app/output/sessions/ :gcs:my_backups_bucket/sessions/ms -vv
The rclone config contents with secrets removed.
using dynamically created remote
A log from the command with the -vv flag
pasted above