What is the problem you are having with rclone?
The rclone cli copy and sync command are not returning when completing/successful from a local directory copy to a dropbox crypted secret store.
The copy is successful and, in fact, has copied and crypted over 125GB+ of data to Dropbox, but for some reason, the command will not finish and return control back to the terminal (I want to set up systemd to automate this copy every 6 hours so need to solve.).
I use fish for my shell so also tried running it in bash and additionally kicking out of tmux to a naked shell to also run it from fish and bash, but I still have the same problem. Using alacritty as my terminal. Gnome desktop in POPOS 20.04.
What is your rclone version (output from rclone version)
I was originally using the v1.50.2/go1.13.6 which is the stock install on POPOS 20.04 (based on Ubuntu 20.04) and seeing the same behaviour. I manually upgraded it to the latest 1.53.1, however and the behaviour remains, rclone does not come back:
Ī» ~ rclone --version
rclone v1.53.1
- os/arch: linux/amd64
- go version: go1.15
Which OS you are using and how many bits (eg Windows 7, 64 bit)
POPOS 20.04 (Ubuntu 20.04 underneath).
It is currently completely up to date.
Which cloud storage system are you using? (eg Google Drive)
Dropbox
(And am copying to a crypted secret store which overlays that remote.).
The command you were trying to run (eg rclone copy /tmp remote:tmp)
rclone copy /home/daryl/ secret:/ --copy-links --filter-from /home/daryl/.config/rclone/exclusions.txt
I've been following it with a --log-file=/home/daryl/rclone_log.txt to attempt to diagnose the issue.
The command has successfully copied everything over the last 48 hours, encrypted over to the store (as verified via rclone-browser checking and manual checking on Dropbox). It, however, from that original task and on updates to set up incremental backups will not come back to the terminal after CLI execution.
Note: The command runs successfully, it simply never returns control to the command line.
The rclone config contents with secrets removed.
[elcano_backups]
type = dropbox
token = {"access_token":"redacted","token_type":"bearer","expiry":"0001-01-01T00:00:00Z"}
[secret]
type = crypt
remote = elcano_backups:/Apps/RClone_Elcano
filename_encryption = standard
directory_name_encryption = true
password = <redacted>
A log from the command with the -vv flag
Since this is a full backup of my home directory, the -vv being pasted here is not feasible. Here's the -v though before it just stops returning anything. The entire command both syncs and copies without incident however. The Photo lib error (holdover from OSX) doesn't seem like it should be causing the issue and when I run the command often get a diff file that it errors on so expect it has to do with num files in that directory (I think at last count I had 45k photos).
Ī» ~ tail -f rclone_log.txt
2020/09/14 11:52:27 INFO : rclone_log.txt: Copied (new)
2020/09/14 11:53:19 ERROR : Pictures/Photos Library.photoslibrary/originals/6: error reading destination directory: list continue: http2: server sent GOAWAY and closed the connection; LastStreamID=1999, ErrCode=NO_ERROR, debug=""
2020/09/14 11:53:25 INFO :
Transferred: 32 / 32 Bytes, 100%, 24 Bytes/s, ETA 0s
Errors: 1 (retrying may help)
Checks: 27773 / 27773, 100%
Transferred: 1 / 1, 100%
Elapsed time: 1m0.8s
2020/09/14 11:53:44 INFO : .local/share/gnome-shell/application_state: Copied (replaced existing)
2020/09/14 11:53:55 INFO : .local/share/gvfs-metadata/root: Copied (replaced existing)
2020/09/14 11:53:55 INFO : .local/share/gvfs-metadata/root-04245e47.log: Copied (new)
2020/09/14 11:54:25 INFO :
Transferred: 35.298k / 35.298 kBytes, 100%, 6.298 kBytes/s, ETA 0s
Errors: 1 (retrying may help)
Checks: 51458 / 51458, 100%
Transferred: 4 / 4, 100%
Elapsed time: 2m0.8s
2020/09/14 11:55:25 INFO :
Transferred: 35.298k / 35.298 kBytes, 100%, 6.298 kBytes/s, ETA 0s
Errors: 1 (retrying may help)
Checks: 51458 / 51458, 100%
Transferred: 4 / 4, 100%
Elapsed time: 3m0.8s
... (etc... keep on getting repeat of the last block every minute and 0.8s ad infinitum)
...