Dropbox Mount - Network is Unreachable

Help and Support
1

What is the problem you are having with rclone?

After running for a number of hours, the Dropbox (crypt) mount starts to spit out constant errors into the log. Interestingly, restarting the Plex Docker container (which relies on this mount via bind) resolves the issue. This only seems to happen with Dropbox.

What is your rclone version (output from rclone version)

rclone v1.56.0-beta.5413.31a8211af

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Debian 10 64-Bit

Which cloud storage system are you using? (eg Google Drive)

Dropbox, through a Crypt remote

The command you were trying to run (eg rclone copy /tmp remote:tmp)

/usr/bin/rclone mount media: /mnt/remote/media \
--allow-other \
--dir-cache-time 1000h \
--log-level INFO \
--log-file /mnt/remote/media.log \
--poll-interval 15s \
--umask 002 \
--uid 1001 \
--gid 1001 \
--dir-perms=0777 \
--file-perms=0777 \
--user-agent RahdomString \
--rc \
--rc-addr :5572 \
--rc-no-auth \
--cache-dir=/mnt/remote/cache/media \
--vfs-cache-mode full \
--vfs-cache-max-size 16G \
--vfs-cache-max-age 336h \
--bwlimit-file 16M

The rclone config contents with secrets removed.

[dropbox]
type = dropbox
token = {"access_token":"REDACTED","token_type":"bearer","refresh_token":"REDACTED","expiry":"2021-04-18T22:43:07.295335765-04:00"}
client_id = REDACTED
client_secret = REDACTED

[media]
type = crypt
remote = dropbox:/User Name/
filename_encryption = standard
directory_name_encryption = true
password = REDACTED
password2 = REDACTED

A log from the command with the -vv flag

2021/04/20 22:19:15 ERROR : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: download write: failed to kick waiters: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 ERROR : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: failed to _ensure cache vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 INFO  : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: downloader: error count now 34: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 ERROR : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: failed to download: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 ERROR : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: too many errors 34/10: last error: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 ERROR : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: failed to kick waiters: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 ERROR : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: failed to _ensure cache vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file:
 vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 INFO  : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: downloader: error count now 35: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 ERROR : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: failed to download: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 ERROR : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: too many errors 35/10: last error: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 ERROR : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: failed to kick waiters: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 ERROR : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: failed to _ensure cache vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 INFO  : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: downloader: error count now 36: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 ERROR : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: failed to download: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 ERROR : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: too many errors 36/10: last error: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 ERROR : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: failed to kick waiters: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 ERROR : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: failed to _ensure cache vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 ERROR : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: failed to _ensure cache vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 INFO  : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: downloader: error count now 37: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 ERROR : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: failed to download: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 ERROR : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: too many errors 37/10: last error: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 ERROR : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: failed to kick waiters: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 ERROR : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: failed to _ensure cache vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 INFO  : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: downloader: error count now 38: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 ERROR : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: failed to download: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 ERROR : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: too many errors 38/10: last error: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 ERROR : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: failed to kick waiters: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 ERROR : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: failed to _ensure cache vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 INFO  : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: downloader: error count now 39: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 ERROR : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: failed to download: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:15 INFO  : Media/Dir1/SubDir1/Folder 02/SubDir1 - File1.mkv: vfs cache: downloader: resetting error count to 0
2021/04/20 22:19:16 INFO  : Media/Dir2/SubDir2/Folder 03/SubDir2 - File2.mkv: vfs cache: removed cache file as item.open failed on _createFile, remove cache data/metadata files
2021/04/20 22:19:16 ERROR : Media/Dir2/SubDir2/Folder 03/SubDir2 - File2.mkv: vfs cache: failed to open item: vfs cache item: create cache file failed: vfs cache item: _save failed: vfs cache item: failed to write metadata: open /mnt/remote/cache/media/vfsMeta/media/Media/Dir2/SubDir2/Folder 03/SubDir2 - File2.mkv: too many open files
2021/04/20 22:19:16 ERROR : Media/Dir2/SubDir2/Folder 03/SubDir2 - File2.mkv: Non-out-of-space error encountered during open
2021/04/20 22:19:16 INFO  : Media/Dir2/SubDir2/Folder 03/SubDir2 - File2.mkv: vfs cache: removed cache file as item.open failed on _createFile, remove cache data/metadata files
2021/04/20 22:19:16 ERROR : Media/Dir2/SubDir2/Folder 03/SubDir2 - File2.mkv: vfs cache: failed to open item: vfs cache item: create cache file failed: vfs cache item: _save failed: vfs cache item: failed to write metadata: open /mnt/remote/cache/media/vfsMeta/media/Media/Dir2/SubDir2/Folder 03/SubDir2 - File2.mkv: too many open files
2021/04/20 22:19:16 ERROR : Media/Dir2/SubDir2/Folder 03/SubDir2 - File2.mkv: Non-out-of-space error encountered during open
2021/04/20 22:19:44 INFO  : vfs cache: cleaned: objects 3311 (was 3311) in use 3098, to upload 0, uploading 0, total size 13.240G (was 13.240G)
2021/04/20 22:19:45 INFO  : Media/Dir3/SubDir3/SubDir3.mkv: vfs cache: downloader: error count now 1: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable
2021/04/20 22:19:45 ERROR : Media/Dir3/SubDir3/SubDir3.mkv: vfs cache: failed to download: vfs reader: failed to write to cache file: Post "https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable

Edit: Just realised that the template suggests -vv. If the log provided doesn't provide enough information, I can run it again and wait for the error to occur with -vv specified.

2

hi,

"https://content.dropboxapi.com/2/files/download": dial tcp [2620:100:601b:14::a27d:80e]:443: connect: network is unreachable

as you pointed out, those are network errors.
when the problem happens - from the docker, can you ping content.dropboxapi.com?

and unless there is a reason to use the beta, better off using latest stable.

3

Waiting for it to happen again to test. I'm just confused as to why restarting the Plex container resolves the issue within seconds. In addition to this, the errors at the top of the log are interesting, given how recursive they are.

I'm using the beta due to fixes to the Dropbox mount in recent commits.

4

i did notice that and just assumed it was a copy and paste issue, not from rclone itself.

were you using an older beta and did not have problem, then update to latest beta and started to have problems?

could a rclone bug or something about the beta.

5

Nope, it is not a copy & paste error. This is a fresh install for a friend, though he has a particularly large collection of content on his Dropbox account.

I'm going to drop to stable and see whether that makes a difference, though I don't think it will.

1 Like
6

The recursive error message are extremely odd! I had a look at the source and I'm having trouble working out how that could ever happen!

A log with -vv - might help if you can get one.

This looks like IPv6 dropping out for some reason. Perhaps try disabling IPv6 with --bind 0.0.0.0 I think that should work.

1 Like
7

Likewise, I couldn't figure out why that would ever happen.

Interestingly, increasing the server's ulimit (from 1024 to 1024000) removed the issue entirely, though it's curious that this is seemingly an issue strictly with the Dropbox remote as this didn't happen with Google Drive. Perhaps there's a leak?

As the issue is now resolved, the owner may be apprehensive to undoing it for research, but I could probably stand up an identical environment with his config without any issues.

I hadn't considered the fact (until the server owner mentioned it) that the server currently has no IPv6 connectivity; my guess is that Dropbox falls back to IPv6 if the requests exceed a threshold within a specific timeframe? Purely a guess though.

8

Not impossible that there is a leak!

If you want to investigate a leak there are some hints on where to start here: Remote Control / API

The usual thing is leaking go routines which are holding memory.

The ulimit thing probably means the go routine is holding a file handle.

The go standard library networking will use IPv6 if it is available. If the server is misconfigured so it looks like IPv6 is available but it isn't that might be the problem.

1 Like
9

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.