Sync continues endlessly when I try to sync file to ProtonDrive

Help and Support
1

What is the problem you are having with rclone?

I am trying to sync a specific file of mine named "Games I want.md" which is 480 bytes, and it does sync correctly. Any changes I make locally do get sent to my remote with the command.

The problem is that it doesn't return successfully, it doesn't stop trying to sync, but rather just keeps sending 0 bytes between the remote and local machine.

Run the command 'rclone version' and share the full output of the command.

rclone v1.68.1
- os/version: ubuntu 24.04 (64 bit)
- os/kernel: 6.8.0-48-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.23.1
- go/linking: static
- go/tags: none

Which cloud storage system are you using? (eg Google Drive)

I am using Proton Drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone sync /home/kr9sis/PDrive/ PDrive: --include "Games I Want" -v --protondrive-replace-existing-draft=true --log-file=./sync_err.log

The rclone config contents with secrets removed.

Paste config here
[PDrive]
type = protondrive
username =  ************
password = ************
2fa =  ************
client_uid = zto6vquxrz6xqtn6osf3ax7bcms3mysr
client_access_token = iqij6xijpfvulziju4x5jz6u7zaz6kne
client_refresh_token = bplmho5lc47jnqygwopjvkf5rlnjveli
client_salted_key_pass = LlJ5cFdZeDNWMlgwdjU3Y2F2Ly5pRkxZRjlqVUdDSw==

A log from the command with the -vv flag

Paste  log here
2024/11/08 17:56:33 DEBUG : rclone: Version "v1.67.0" starting with parameters ["rclone" "sync" "/home/kr9sis/PDrive/" "PDrive:" "--include" "Games I Want" "-vv" "--protondrive-replace-existing-draft=true" "--log-file=./sync_err.log" "--timeout=10m"]
2024/11/08 17:56:33 DEBUG : Creating backend with remote "/home/kr9sis/PDrive/"
2024/11/08 17:56:33 DEBUG : Using config file from "/home/kr9sis/.config/rclone/rclone.conf"
2024/11/08 17:56:33 DEBUG : fs cache: renaming cache item "/home/kr9sis/PDrive/" to be canonical "/home/kr9sis/PDrive"
2024/11/08 17:56:33 DEBUG : Creating backend with remote "PDrive:"
2024/11/08 17:56:33 DEBUG : PDrive: detected overridden config - adding "{kpshc}" suffix to name
2024/11/08 17:56:33 DEBUG : proton drive root link ID '': Has cached credentials
2024/11/08 17:56:33.368692 WARN RESTY 401 GET https://mail.proton.me/api/core/v4/users: Invalid access token (Code=401, Status=401), Attempt 1
2024/11/08 17:56:33.368876 ERROR RESTY 401 GET https://mail.proton.me/api/core/v4/users: Invalid access token (Code=401, Status=401)
2024/11/08 17:56:33 DEBUG : Saving config "client_uid" in section "PDrive" of the config file
2024/11/08 17:56:33 DEBUG : Saving config "client_access_token" in section "PDrive" of the config file
2024/11/08 17:56:33 DEBUG : Saving config "client_refresh_token" in section "PDrive" of the config file
2024/11/08 17:56:33 DEBUG : Saving config "client_salted_key_pass" in section "PDrive" of the config file
2024/11/08 17:56:35 DEBUG : proton drive root link ID '': Used cached credential to initialize the ProtonDrive API
2024/11/08 17:56:35 DEBUG : fs cache: renaming cache item "PDrive:" to be canonical "PDrive{kpshc}:"

2024/11/08 17:57:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Elapsed time:       1m2.6s

2024/11/08 17:58:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Elapsed time:       2m2.6s

2024/11/08 17:59:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Elapsed time:       3m2.6s

2024/11/08 18:00:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Elapsed time:       4m2.6s

2024/11/08 18:02:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Elapsed time:       6m2.6s

2024/11/08 18:03:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Elapsed time:       7m2.6s

2024/11/08 18:04:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Elapsed time:       8m2.6s

2024/11/08 18:05:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Elapsed time:       9m2.6s

2024/11/08 18:06:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Elapsed time:      10m2.6s

2024/11/08 18:08:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Elapsed time:      12m2.6s

2024/11/08 18:09:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Elapsed time:      13m2.6s

2024/11/08 18:10:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Elapsed time:      14m2.6s

2024/11/08 18:11:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Elapsed time:      15m2.6s

2024/11/08 18:12:12.198992 WARN RESTY 504 GET https://mail.proton.me/api/drive/shares/bF8CdwEnVk59DAnOuRlYoXjaaaSJiuzuPUoBEJNYm-JNQGuEoBfVUHhKhbYmdXDbAggEfmQKuf1Aj-rHdiwEsg==/links/btnbQ2v0YMpGpVGAfxLvqRZWSiAHFlWnjmY855R9XUqkHErR5t8eDGTol95jxnF_TJanyhVknYAwStTcaRS5lw==: 504 Gateway Timeout (Code=0, Status=504), Attempt 1
2024/11/08 18:12:12.199144 ERROR RESTY 504 GET https://mail.proton.me/api/drive/shares/bF8CdwEnVk59DAnOuRlYoXjaaaSJiuzuPUoBEJNYm-JNQGuEoBfVUHhKhbYmdXDbAggEfmQKuf1Aj-rHdiwEsg==/links/btnbQ2v0YMpGpVGAfxLvqRZWSiAHFlWnjmY855R9XUqkHErR5t8eDGTol95jxnF_TJanyhVknYAwStTcaRS5lw==: 504 Gateway Timeout (Code=0, Status=504)
2024/11/08 18:12:12 ERROR : School/MK/2019/Vor 2019/FÉLA2BA05/Tímaverkefni 1. 2. 3. 4/Verkefni 3: error reading destination directory: 504 GET https://mail.proton.me/api/drive/shares/bF8CdwEnVk59DAnOuRlYoXjaaaSJiuzuPUoBEJNYm-JNQGuEoBfVUHhKhbYmdXDbAggEfmQKuf1Aj-rHdiwEsg==/links/btnbQ2v0YMpGpVGAfxLvqRZWSiAHFlWnjmY855R9XUqkHErR5t8eDGTol95jxnF_TJanyhVknYAwStTcaRS5lw==: 504 Gateway Timeout (Code=0, Status=504)

2024/11/08 18:12:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:      16m2.6s

2024/11/08 18:13:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:      17m2.6s

2024/11/08 18:14:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:      18m2.6s

2024/11/08 18:15:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:      19m2.6s

2024/11/08 18:16:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:      20m2.6s

2024/11/08 18:17:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:      21m2.6s

2024/11/08 18:18:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:      22m2.6s

2024/11/08 18:19:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:      23m2.6s

2024/11/08 18:20:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:      24m2.6s

2024/11/08 18:21:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:      25m2.6s

2024/11/08 18:22:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:      26m2.6s

2024/11/08 18:23:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:      27m2.6s

2024/11/08 18:24:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:      28m2.6s

2024/11/08 18:25:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:      29m2.6s

2024/11/08 18:26:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:      30m2.6s

2024/11/08 18:27:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:      31m2.6s

2024/11/08 18:28:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:      32m2.6s

2024/11/08 18:29:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:      33m2.6s

2024/11/08 18:30:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:      34m2.6s

2024/11/08 18:31:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:      35m2.6s

2024/11/08 18:32:35 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:      36m2.6s

2024/11/08 18:33:36 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:      37m2.6s

2024/11/08 18:34:36 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:      38m2.6s

2024/11/08 18:35:36 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:      39m2.6s

2024/11/08 18:36:36 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:      40m2.6s

2024/11/08 18:37:36 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:      41m2.6s

I removed all personal filenames where rclone said it was excluding said file. I did notice one weird thing though, it also excluded the file I wanted to include.

2024/11/08 23:16:53 DEBUG : Games I want.md: Excluded (Path Filter)
2024/11/08 23:16:53 DEBUG : Games I want.md: Excluded

I also tried writing the command with --include Games\ I\ Want but got the same weird exclusion.

2

welcome to the forum,

not sure we can call this a bug just yet.

you are using an old version of rclone, rclone: Version "v1.67.0" ??
so make sure to test on the latest version and then create a new remote from scratch, do not re-use the current remote.

and can you do a simpler test, does that work?
rclone copy a single file without extra flags, without --include

3

Where are you seeing that I am using an old version of rclone?

Because I was, but then I earlier tonight updated to what I believe is the latest version (v1.68.1), deleted my remote and made a new one. The anomaly, still persists.

Also, how should I copy a single file without using include?
And just so it's explicit because I think I forgot to write it, but the command I'm using works on any other file I throw at it, it's just this specific file and one .txt file I had months ago where I've noticed this weird behavior.

Also if it helps, I'm using rclone to automatically sync my files within this project I made:

And again, every other file works, it's just "Games I want.md" which is being difficult.

4

from the command you posted, DEBUG : rclone: Version "v1.67.0" starting with parameters

the filter you used is --include "Games I Want", not --include "Games I Want.md"
so maybe, makes sense for rclone to exclude Games I want.md

rclone ls . --include="Games I want.md" --dump=filters
--- start filters ---
--- File filter rules ---
+ (^|/)Games I want\.md$
- ^.*$
--- Directory filter rules ---
+ ^.*$
- ^.*$
--- end filters ---
DEBUG : rclone: Version "v1.68.1" starting with parameters ["rclone" "ls" "." "--include=Games I want.md" "--dump=filters" "-vv"]
      480 Games I want.md

tho, what i wrote above, does not seem to address that specific issue.
https://forum.rclone.org/t/sync-to-proton-drive-never-finishes/44538

imho, protondrive is really alpha, not beta, has a lot of bugs not getting fixed and could be a dead project.
the author of the proton backend has not visited in a long time, "Seen Apr 24"
in addition, proton drive is documented as blocking rclone users and will not provide any tech support.

We have noticed that your login attempt to your account was blocked, due to your "Rclone" usage, and we have done this because it disrupts our network; we would advise you to stop using "Rclone" for cloud management, to avoid further interruptions

5

Is there then anything I can do about this?
Because I agree that Proton Drive isn't ideal, which is why I am using rclone to backup my files. But I nonetheless made the mistake of paying for the storage and I want to make this work until that runs out.

6

i doubt that.

imho, best to move away from proton
how much did you pay proton, how much storage did you get, how much storage do you need?

7

I paid about 85 euro for 200 GB, I probably only need around 100 GB atm, maybe that'll change but I just need some way for all of my files to be backed up to a cloud. And I am using linux. So I am considering IceDrive the next time I change cloud providers because I have heard good things.

8

$92 for 200 GB... It is probably the most expensive storage available. In my world I consider Amazon S3 Standard very expensive (but super reliable) and it would be half price compared to Proton... With other reputable providers for this money you can have close to 2TB (10 times more). And API which works with tools of your choice including rclone.

9

I did forget to say that this was for a 2 year plan. The reason I changed was because it was half the price of OneDrive which is what I was using before Proton.

But if you know any good cloud providers do let me know, because I will be shopping around for a replacement in a bit. And Amazon S3 Standard has been noted.

10

For general backup I would consider:

iDrive-e2 S3 - $50 TB/year, S3 API with object lock support, generous egress, multiple global locations, no hidden charges

Office 365 Family subscription... for $100 per year (or even cheaper sometimes - black Friday sales etc.) you get 6x 1TB OneDrive (6TB storage in total). Solid support by rclone. Not the fastest but I've been using it for years and it is perfect for backup. It is also directly supported by Arq (my main backup software) and works flawlessly in China (probably not important for most people but whoever visits this part of the world might care)

For archive:

Amazon Deep Glacier - perfect place to save and forget for reasonable fee.

1 Like
11

I recommend Google drive which is definitely a good brand, and my main storage. I have about 7tb stored here, but 100gb and 200gb storage plans exist. About IceDrive it technically works, but there was frequent errors on their side on their Webdav protocol when I tried it (the errors always got fixed by itself, but reappeared later). Google drive may be a bit more expensive, but I have decided that it's worth it for me.

1 Like
12

hard to beat hetzner storagebox = $49/year for 1TiB.
plus, includes automatic zfs snapshots.

so, would have 800GiB left over.
fwiw, i rent a cheap cloud vm from hetzner, and mount the storagebox as smb using samba, not rclone.
then, use that left over space, as a cheap backup repository for veeam backup and replication.
so i get dual use from the storagebox.

1 Like
13

But since you already paid for proton and this is the only file you are having problem you can try to change the file extension and/or content. For content any character difference should be enough. Please post here if you got what is causing the problem with the file, so others can learn from it.

14

I'll do my best to remember that, since this is a personal project I just removed the file manually and kept the information in another place. If it happens again though, then maybe I'll learn something new.

15

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.