Dropbox polling interval stuck to 5mins

Rikuddo · November 19, 2022, 6:35pm

What is the problem you are having with rclone?

The dropbox mount will only check for changes every 5 mins, no matter how small the poll-interval flag is set. I've tried with Latest Beta as well as the official release version and both are getting same result. Tried on Debian and Windows, and both are behaving same. It was working fine 2-3 days ago.

Run the command 'rclone version' and share the full output of the command.

rclone v1.60.1

os/version: debian 10.13 (64 bit)
os/kernel: 4.19.0-22-amd64 (x86_64)
os/type: linux
os/arch: amd64
go/version: go1.19.3
go/linking: static
go/tags: none

Are you on the latest version of rclone? You can validate by checking the version listed here: Rclone downloads
-->

Yes

Which cloud storage system are you using? (eg Google Drive)

Dropbox Business

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

rclone mount dropboxfull8: /home/rikuddo/Stuff/MountTest3 -vvv --poll-interval=35s

The rclone config contents with secrets removed.

[dropboxfull8]
type = dropbox
token = {"access_token":"REMOVED","token_type":"bearer","refresh_token":"REMOVED","expiry":"2022-11-19T23:33:13.566828394+01:00"}

A log from the command with the `-vv` flag

rikuddo@theia:~$ rclone mount dropboxfull8: /home/rikuddo/Stuff/MountTest3 -vvv --poll-interval=35s
2022/11/19 19:19:25 DEBUG : rclone: Version "v1.60.1" starting with parameters ["rclone" "mount" "dropboxfull8:" "/home/rikuddo/Stuff/MountTest3" "-vvv" "--poll-interval=35s"]
2022/11/19 19:19:25 DEBUG : Creating backend with remote "dropboxfull8:"
2022/11/19 19:19:25 DEBUG : Using config file from "/home/rikuddo/.config/rclone/rclone.conf"
2022/11/19 19:19:25 DEBUG : Dropbox root '': Mounting on "/home/rikuddo/Stuff/MountTest3"
2022/11/19 19:19:25 DEBUG : : Root:
2022/11/19 19:19:25 DEBUG : : >Root: node=/, err=<nil>
2022/11/19 19:19:42 DEBUG : /: Attr:
2022/11/19 19:19:42 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2022/11/19 19:20:00 DEBUG : Dropbox root '': Checking for changes on remote
2022/11/19 19:25:01 DEBUG : Dropbox root '': Checking for changes on remote
2022/11/19 19:30:21 DEBUG : Dropbox root '': Checking for changes on remote

Animosity022 · November 19, 2022, 6:49pm

Known issue:

github.com/rclone/rclone

Dropbox --poll-interval not respected

opened 08:50AM - 31 May 22 UTC

Joost1991

Remote: Dropbox

#### The associated forum post URL from `https://forum.rclone.org` https://foru…m.rclone.org/t/rclone-not-respecting-poll-interval/31018/4 #### What is the problem you are having with rclone? When using dropbox, `--poll-interval` is not respected and updated at another rate than specified. #### What is your rclone version (output from `rclone version`) rclone v1.58.1 #### Which OS you are using and how many bits (e.g. Windows 7, 64 bit) macOS 12.4 #### Which cloud storage system are you using? (e.g. Google Drive) Dropbox Business #### The command you were trying to run (e.g. `rclone copy /tmp remote:tmp`) `rclone cmount crypt: /Users/user/Media --vfs-cache-mode full --vfs-read-chunk-size 32M --vfs-cache-max-size 100G --dir-cache-time 5000h --poll-interval 1m --allow-other` #### A log from the command with the `-vv` flag (e.g. output from `rclone -vv copy /tmp remote:tmp`) ```2022/05/29 21:47:51 DEBUG : rclone: Version "v1.58.1" starting with parameters ["rclone" "cmount" "crypt:" "/Users/joost/Media" "--vfs-cache-mode" "full" "--vfs-read-chunk-size" "32M" "--vfs-cache-max-size" "100G" "--dir-cache-time" "5000h" "--poll-interval" "1m" "--allow-other" "-vvv" "--log-file=rclone.log"] 2022/05/29 21:47:51 DEBUG : Creating backend with remote "crypt:" 2022/05/29 21:47:51 DEBUG : Using config file from "/Users/joost/.config/rclone/rclone.conf" 2022/05/29 21:47:51 DEBUG : Creating backend with remote "dropbox:encrypted" 2022/05/29 21:47:52 DEBUG : vfs cache: root is "/Users/joost/Library/Caches/rclone" 2022/05/29 21:47:52 DEBUG : vfs cache: data root is "/Users/joost/Library/Caches/rclone/vfs/crypt" 2022/05/29 21:47:52 DEBUG : vfs cache: metadata root is "/Users/joost/Library/Caches/rclone/vfsMeta/crypt" 2022/05/29 21:47:52 DEBUG : Creating backend with remote "/Users/joost/Library/Caches/rclone/vfs/crypt/" 2022/05/29 21:47:52 DEBUG : Creating backend with remote "/Users/joost/Library/Caches/rclone/vfsMeta/crypt/" 2022/05/29 21:47:52 DEBUG : Mounting on "/Users/joost/Media" ("crypt") 2022/05/29 21:47:52 DEBUG : Adding "-o modules=iconv,from_code=UTF-8,to_code=UTF-8-MAC" for macOS 2022/05/29 21:47:52 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item TV Shows/show/Season 1/show.WEBDL-1080p.mkv not removed, freed 0 bytes 2022/05/29 21:47:52 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item TV Shows/show/Season 1/show - S01E01 - Flowers for Your Grave - WEBDL-1080p.mkv not removed, freed 0 bytes 2022/05/29 21:47:52 DEBUG : Encrypted drive 'crypt:': Mounting with options: ["-o" "attr_timeout=1" "-o" "fsname=crypt:" "-o" "subtype=rclone" "-o" "max_readahead=131072" "-o" "atomic_o_trunc" "-o" "daemon_timeout=600" "-o" "allow_other" "-o" "volname=crypt" "-o" "noappledouble" "-o" "modules=iconv,from_code=UTF-8,to_code=UTF-8-MAC"] 2022/05/29 21:47:52 INFO : vfs cache: cleaned: objects 2 (was 2) in use 0, to upload 0, uploading 0, total size 644.282Mi (was 644.282Mi) 2022/05/29 21:47:52 DEBUG : Encrypted drive 'crypt:': Init: 2022/05/29 21:47:52 DEBUG : Encrypted drive 'crypt:': >Init: 2022/05/29 21:48:41 DEBUG : /: >Access: errc=0 2022/05/29 21:48:52 DEBUG : Dropbox root 'encrypted': Checking for changes on remote 2022/05/29 21:48:52 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item TV Shows/show/Season 1/show - S01E01 - Flowers for Your Grave - WEBDL-1080p.mkv not removed, freed 0 bytes 2022/05/29 21:48:52 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item TV Shows/show/Season 1/show - S01E02 - Nanny McDead - WEBDL-1080p.mkv not removed, freed 0 bytes 2022/05/29 21:48:52 INFO : vfs cache: cleaned: objects 2 (was 2) in use 0, to upload 0, uploading 0, total size 644.282Mi (was 644.282Mi) 2022/05/29 21:49:44 DEBUG : /: Access: mask=00 2022/05/29 21:49:44 DEBUG : /: >Access: errc=0 2022/05/29 21:49:44 DEBUG : /: Access: mask=00 2022/05/29 21:49:44 DEBUG : /: >Access: errc=0 2022/05/29 21:49:44 DEBUG : /: Access: mask=00 2022/05/29 21:49:44 DEBUG : /: >Access: errc=0 2022/05/29 21:49:44 DEBUG : /: Access: mask=00 2022/05/29 21:49:44 DEBUG : /: >Access: errc=0 2022/05/29 21:49:44 DEBUG : /: Access: mask=00 2022/05/29 21:49:44 DEBUG : /: >Access: errc=0 2022/05/29 21:49:44 DEBUG : /: Access: mask=00 2022/05/29 21:54:02 DEBUG : Dropbox root 'encrypted': Checking for changes on remote 2022/05/29 21:54:52 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item TV Shows/show/Season 1/show - S01E01 - Flowers for Your Grave - WEBDL-1080p.mkv not removed, freed 0 bytes 2022/05/29 21:54:52 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item TV Shows/show/Season 1/show - S01E02 - Nanny McDead - WEBDL-1080p.mkv not removed, freed 0 bytes 2022/05/29 21:54:52 INFO : vfs cache: cleaned: objects 2 (was 2) in use 0, to upload 0, uploading 0, total size 644.282Mi (was 644.282Mi) 2022/05/29 21:54:55 DEBUG : /: Access: mask=00 2022/05/29 21:54:55 DEBUG : /: >Access: errc=0 2022/05/29 21:54:55 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF 2022/05/29 21:54:55 DEBUG : /: >Getattr: errc=0 ``` #### How to use GitHub * Please use the 👍 [reaction](https://blog.github.com/2016-03-10-add-reactions-to-pull-requests-issues-and-comments/) to show that you are affected by the same issue. * Please don't comment if you have no relevant information to add. It's just extra noise for everyone subscribed to this issue. * Subscribe to receive notifications on status change and new comments.

Rikuddo · November 19, 2022, 7:24pm

Sorry, is there any way to manually trigger it after a set interval?

I have mounted my dropbox with MergerFS, and point my Plex to MergerFS for scanning. If that helps in any way.

Rikuddo · November 19, 2022, 7:46pm

I've also noticed another issue. I was using these flags for streaming,

rclone mount dropboxfull8: %h/Stuff/Mount \
  --config %h/.config/rclone/rclone.conf \
  --use-mmap \
  --poll-interval=40s \
  --dir-cache-time 1000h \
  --vfs-cache-mode full \
  --vfs-read-chunk-size=64M \
  --vfs-read-chunk-size-limit=256M \
  --vfs-cache-max-age=1h \
  --vfs-cache-max-size=15G \
  --buffer-size=256M \
  --fast-list \
  --tpslimit 10

They were working fine, but now even though the -vvv says that 'Checking for changes on remote' it doesn't update anything on the mount. Even if I manually upload the files to the dropbox.

But if I just use,

rclone mount dropboxfull8: /home/rikuddo/Stuff/MountTest3 -vvv --poll-interval=35s

It updates the mount after 5 mins.

Animosity022 · November 19, 2022, 8:00pm

Nope as it's a bug as noted by the issue.

You'd have to wait for it to get fixed.

Rikuddo · November 19, 2022, 8:34pm

Thank you, I'll wait. Just one last question, do you have any idea what's stopping rclone from updating cache when I run this one

rclone mount dropboxfull8: %h/Stuff/Mount \
  --config %h/.config/rclone/rclone.conf \
  --use-mmap \
  --poll-interval=40s \
  --dir-cache-time 1000h \
  --vfs-cache-mode full \
  --vfs-read-chunk-size=64M \
  --vfs-read-chunk-size-limit=256M \
  --vfs-cache-max-age=1h \
  --vfs-cache-max-size=15G \
  --buffer-size=256M \
  --fast-list \
  --tpslimit 10

But when I just use this, it updates the cache after 5 mins without any issue.

rclone mount dropboxfull8: /home/rikuddo/Stuff/MountTest3 -vvv --poll-interval=35s

Animosity022 · November 19, 2022, 8:37pm

Regardless of what you set, it will poll for updates every 5 minutes.

Does nothing on a mount so you can remove it.

Rikuddo · November 19, 2022, 8:42pm

I'm saying it is polling, but the mount isn't being updated with changes when I use the first mount commands.

The second (more simpler one) seems to work fine and the changes are updated accordingly.

Animosity022 · November 19, 2022, 8:52pm

Sorry, have no idea what you are asking at this point then.

If you can share a log, that might explain something.

Rikuddo · November 19, 2022, 9:29pm

Sorry, I'll try to be more elaborate.

I mount dropbox with,
rclone mount dropbox14: J: -vvv --poll-interval=1m
Then I go to dropbox and upload a file (via browser) '314191131_421634036804319_3412788638428369420_n.mp4'.
After 5 mins, it checks for changes on remote. And then the file appear in the mount.
Here's the log of that, Rclone_Mount- WORKING
I mount the same dropbox, but this time with additional args (which I use for plex streaming),

rclone mount dropbox14: J: -vvv --poll-interval=1mt \
  --config %h/.config/rclone/rclone.conf \
  --use-mmap \
  --poll-interval=40s \
  --dir-cache-time 1000h \
  --vfs-cache-mode full \
  --vfs-read-chunk-size=64M \
  --vfs-read-chunk-size-limit=256M \
  --vfs-cache-max-age=1h \
  --vfs-cache-max-size=15G \
  --buffer-size=256M \
  --tpslimit 10

Again same scenario, upload the same file and wait for 5 mins. The message appear about 'checking for changes'. But even after 2-3 mins, the video doesn't appear in the mounted drive.
Here's the log of that, Rclone_Mount- NOT WORKING

I hope that explain my issue.

Animosity022 · November 19, 2022, 9:34pm

So that’s back to the open issue I linked.

ncw · November 20, 2022, 12:46pm

I think it is working properly.

From the issue

However I think the dropbox poller works a little differently to the drive poller and will only return when there are changes, or at the time limit. So you should find that when files are changing on the dropbox remote you get more frequent updates.

That is what I see anyway, about 2 seconds after I change a file on dropbox, I see:
2022/05/31 12:02:19 DEBUG : Dropbox root '': Checking for changes on remote

Rikuddo · November 20, 2022, 11:08pm

Alright, here's a weird thing that's actually working.

When I had my folders in structure ---> videos(18)/Movies/.... it wasn't reading the changes.
But as soon as I added a folder and put the 'Movies' folder inside that one, i-e videos(18)/Multimedia/Movies/

it (the polling) started to work perfectly fine again. I don't why or how, but that seems to work for me now. So I'm sticking to this solution.

system · December 20, 2022, 11:08pm

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.