Dropbox remote sometimes slow

Help and Support
1

What is the problem you are having with rclone?

I use rclone + dropbox remote for serving movies and series for multiple people watch, the files are usually around 1 to 2 GB each, and i realize sometimes it takes 7 seconds to open the video, and sometimes takes 17 seconds to open the video, the time varies a lot, even with only me testing or multiple people.
I'd like to know if there is anything i can do to make it open as fast as possible (without it cached), and also to not have much iowait.
my server is on netherland, i'm not sure but i think dropbox api is also on netherland, so i think everything should be faster.

Run the command 'rclone version' and share the full output of the command.

rclone v1.57.0

  • os/version: ubuntu 18.04 (64 bit)
  • os/kernel: 4.15.0-166-generic (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.17.2
  • go/linking: static
  • go/tags: none

Which cloud storage system are you using? (eg Google Drive)

Dropbox

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone mount --daemon dropbox:/ --allow-other /var/www/html/

The rclone config contents with secrets removed.

[dropbox]
type = dropbox
client_id = *REDACTED*
client_secret = *REDACTED*
token = {"access_token":"sl.*REDACTED*$

A log from the command with the -vv flag

2022/01/19 04:29:29 DEBUG : rclone: Version "v1.57.0" starting with parameters ["rclone" "mount" "-vvv" "--daemon" "dropbox:/" "--allow-other" "/var/www/html/" "--log-file" "/root/rclone.log"]
2022/01/19 04:29:29 DEBUG : Creating backend with remote "dropbox:/"
2022/01/19 04:29:29 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2022/01/19 04:29:30 DEBUG : Dropbox root '': Using root namespace "10092923232"
2022/01/19 04:29:30 DEBUG : fs cache: renaming cache item "dropbox:/" to be canonical "dropbox:"
2022/01/19 04:29:30 DEBUG : rclone: Version "v1.57.0" starting with parameters ["/usr/bin/rclone" "mount" "-vvv" "--daemon" "dropbox:/" "--allow-other" "/var/www/html/" "--log-file" "/root/rclone.log"]
2022/01/19 04:29:30 DEBUG : Creating backend with remote "dropbox:/"
2022/01/19 04:29:30 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2022/01/19 04:29:30 DEBUG : Dropbox root '': Using root namespace "10092923232"
2022/01/19 04:29:30 DEBUG : fs cache: renaming cache item "dropbox:/" to be canonical "dropbox:"
2022/01/19 04:29:30 DEBUG : Dropbox root '': Mounting on "/var/www/html/"
2022/01/19 04:29:30 DEBUG : : Root: 
2022/01/19 04:29:30 DEBUG : : >Root: node=/, err=<nil>
2022/01/19 04:29:30 DEBUG : rclone: Version "v1.57.0" finishing with parameters ["/usr/bin/rclone" "mount" "-vvv" "--daemon" "dropbox:/" "--allow-other" "/var/www/html/" "--log-file" "/root/rclone.log"]
2022/01/19 04:29:30 INFO  : Dropbox root '': Commiting uploads - please wait...
2022/01/19 04:29:36 DEBUG : /: Lookup: name="movies"
2022/01/19 04:29:36 DEBUG : /: >Lookup: node=movies/, err=<nil>
2022/01/19 04:29:36 DEBUG : movies/: Attr: 
2022/01/19 04:29:36 DEBUG : movies/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2022/01/19 04:29:36 DEBUG : movies/: Lookup: name="lancamentos2022"
2022/01/19 04:29:37 DEBUG : movies/: >Lookup: node=movies/lancamentos2022/, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Attr: 
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="index.html"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=<nil>, err=no such file or directory
2022/01/19 04:29:37 DEBUG : /: Attr: 
2022/01/19 04:29:37 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="index.html"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=<nil>, err=no such file or directory
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="index.cgi"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=<nil>, err=no such file or directory
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="index.cgi"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=<nil>, err=no such file or directory
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="index.pl"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=<nil>, err=no such file or directory
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="index.pl"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=<nil>, err=no such file or directory
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="index.php"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=<nil>, err=no such file or directory
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="index.php"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=<nil>, err=no such file or directory
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="index.xhtml"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=<nil>, err=no such file or directory
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="index.xhtml"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=<nil>, err=no such file or directory
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="index.htm"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=<nil>, err=no such file or directory
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="index.htm"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=<nil>, err=no such file or directory
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="HEADER.html"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=<nil>, err=no such file or directory
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="HEADER.html"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=<nil>, err=no such file or directory
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: ReadDirAll: 
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >ReadDirAll: item=16, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Attr: 
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="196772.mp4"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=movies/lancamentos2022/196772.mp4, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/196772.mp4: Attr: 
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/196772.mp4: >Attr: a=valid=1s ino=0 size=1264144122 mode=-rw-r--r--, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="197309.mp4"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=movies/lancamentos2022/197309.mp4, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/197309.mp4: Attr: 
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/197309.mp4: >Attr: a=valid=1s ino=0 size=1070913655 mode=-rw-r--r--, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="197886.mp4"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=movies/lancamentos2022/197886.mp4, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/197886.mp4: Attr: 
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/197886.mp4: >Attr: a=valid=1s ino=0 size=1821438416 mode=-rw-r--r--, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="197889.mp4"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=movies/lancamentos2022/197889.mp4, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/197889.mp4: Attr: 
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/197889.mp4: >Attr: a=valid=1s ino=0 size=2164697972 mode=-rw-r--r--, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="197890.mp4"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=movies/lancamentos2022/197890.mp4, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/197890.mp4: Attr: 
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/197890.mp4: >Attr: a=valid=1s ino=0 size=2164697972 mode=-rw-r--r--, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="198074.mp4"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=movies/lancamentos2022/198074.mp4, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/198074.mp4: Attr: 
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/198074.mp4: >Attr: a=valid=1s ino=0 size=1842584679 mode=-rw-r--r--, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="198075.mp4"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=movies/lancamentos2022/198075.mp4, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/198075.mp4: Attr: 
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/198075.mp4: >Attr: a=valid=1s ino=0 size=1520770717 mode=-rw-r--r--, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="198077.mp4"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=movies/lancamentos2022/198077.mp4, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/198077.mp4: Attr: 
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/198077.mp4: >Attr: a=valid=1s ino=0 size=1360213500 mode=-rw-r--r--, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="198078.mp4"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=movies/lancamentos2022/198078.mp4, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/198078.mp4: Attr: 
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/198078.mp4: >Attr: a=valid=1s ino=0 size=1366728240 mode=-rw-r--r--, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="198079.mp4"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=movies/lancamentos2022/198079.mp4, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/198079.mp4: Attr: 
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/198079.mp4: >Attr: a=valid=1s ino=0 size=1333918731 mode=-rw-r--r--, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="198083.mp4"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=movies/lancamentos2022/198083.mp4, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/198083.mp4: Attr: 
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/198083.mp4: >Attr: a=valid=1s ino=0 size=1236564811 mode=-rw-r--r--, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="198162.mp4"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=movies/lancamentos2022/198162.mp4, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/198162.mp4: Attr: 
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/198162.mp4: >Attr: a=valid=1s ino=0 size=1362551602 mode=-rw-r--r--, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="198163.mp4"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=movies/lancamentos2022/198163.mp4, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/198163.mp4: Attr: 
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/198163.mp4: >Attr: a=valid=1s ino=0 size=1697110724 mode=-rw-r--r--, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="198164.mp4"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=movies/lancamentos2022/198164.mp4, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/198164.mp4: Attr: 
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/198164.mp4: >Attr: a=valid=1s ino=0 size=1373911745 mode=-rw-r--r--, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="README.html"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=<nil>, err=no such file or directory
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Attr: 
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: Lookup: name="README.html"
2022/01/19 04:29:37 DEBUG : movies/lancamentos2022/: >Lookup: node=<nil>, err=no such file or directory
2022/01/19 04:29:39 DEBUG : /: Lookup: name="movies"
2022/01/19 04:29:39 DEBUG : /: >Lookup: node=movies/, err=<nil>
2022/01/19 04:29:39 DEBUG : movies/: Attr: 
2022/01/19 04:29:39 DEBUG : movies/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2022/01/19 04:29:39 DEBUG : movies/: Lookup: name="lancamentos2022"
2022/01/19 04:29:39 DEBUG : movies/: >Lookup: node=movies/lancamentos2022/, err=<nil>
2022/01/19 04:29:39 DEBUG : movies/lancamentos2022/: Attr: 
2022/01/19 04:29:39 DEBUG : movies/lancamentos2022/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2022/01/19 04:29:39 DEBUG : movies/lancamentos2022/: Lookup: name="197886.mp4"
2022/01/19 04:29:39 DEBUG : movies/lancamentos2022/: >Lookup: node=movies/lancamentos2022/197886.mp4, err=<nil>
2022/01/19 04:29:39 DEBUG : movies/lancamentos2022/197886.mp4: Attr: 
2022/01/19 04:29:39 DEBUG : movies/lancamentos2022/197886.mp4: >Attr: a=valid=1s ino=0 size=1821438416 mode=-rw-r--r--, err=<nil>
2022/01/19 04:29:39 DEBUG : movies/lancamentos2022/197886.mp4: Open: flags=OpenReadOnly
2022/01/19 04:29:39 DEBUG : movies/lancamentos2022/197886.mp4: Open: flags=O_RDONLY
2022/01/19 04:29:39 DEBUG : movies/lancamentos2022/197886.mp4: >Open: fd=movies/lancamentos2022/197886.mp4 (r), err=<nil>
2022/01/19 04:29:39 DEBUG : movies/lancamentos2022/197886.mp4: >Open: fh=&{movies/lancamentos2022/197886.mp4 (r)}, err=<nil>
2022/01/19 04:29:39 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=0
2022/01/19 04:29:39 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.openRange at 0 length 134217728
2022/01/19 04:29:40 DEBUG : : Statfs: 
2022/01/19 04:29:40 DEBUG : : >Statfs: stat={Blocks:5389680640 Bfree:1451671267 Bavail:1451671267 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=<nil>
2022/01/19 04:29:40 DEBUG : : Statfs: 
2022/01/19 04:29:40 DEBUG : : >Statfs: stat={Blocks:5389680640 Bfree:1451671267 Bavail:1451671267 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=<nil>
2022/01/19 04:29:41 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 0 length 4096 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:41 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 4096 length 8192 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:41 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 12288 length 16384 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:41 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 28672 length 32768 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:41 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 61440 length 65536 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:41 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 126976 length 131072 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:41 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 258048 length 262144 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:41 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:41 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=131072
2022/01/19 04:29:41 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=262144
2022/01/19 04:29:41 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 520192 length 524288 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:41 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:41 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:41 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=393216
2022/01/19 04:29:41 DEBUG : : Statfs: 
2022/01/19 04:29:41 DEBUG : : >Statfs: stat={Blocks:5389680640 Bfree:1451671267 Bavail:1451671267 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=<nil>
2022/01/19 04:29:41 DEBUG : : Statfs: 
2022/01/19 04:29:41 DEBUG : : >Statfs: stat={Blocks:5389680640 Bfree:1451671267 Bavail:1451671267 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=<nil>
2022/01/19 04:29:41 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 1044480 length 1048576 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:41 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:41 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=524288
2022/01/19 04:29:41 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:41 DEBUG : /: Lookup: name="movies"
2022/01/19 04:29:41 DEBUG : /: >Lookup: node=movies/, err=<nil>
2022/01/19 04:29:41 DEBUG : movies/: Attr: 
2022/01/19 04:29:41 DEBUG : movies/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2022/01/19 04:29:41 DEBUG : movies/: Lookup: name="lancamentos2022"
2022/01/19 04:29:41 DEBUG : movies/: >Lookup: node=movies/lancamentos2022/, err=<nil>
2022/01/19 04:29:41 DEBUG : movies/lancamentos2022/: Attr: 
2022/01/19 04:29:41 DEBUG : movies/lancamentos2022/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2022/01/19 04:29:41 DEBUG : movies/lancamentos2022/: Lookup: name="197886.mp4"
2022/01/19 04:29:41 DEBUG : movies/lancamentos2022/: >Lookup: node=movies/lancamentos2022/197886.mp4, err=<nil>
2022/01/19 04:29:41 DEBUG : movies/lancamentos2022/197886.mp4: Attr: 
2022/01/19 04:29:41 DEBUG : movies/lancamentos2022/197886.mp4: >Attr: a=valid=1s ino=0 size=1821438416 mode=-rw-r--r--, err=<nil>
2022/01/19 04:29:41 DEBUG : movies/lancamentos2022/197886.mp4: Open: flags=OpenReadOnly
2022/01/19 04:29:41 DEBUG : movies/lancamentos2022/197886.mp4: Open: flags=O_RDONLY
2022/01/19 04:29:41 DEBUG : movies/lancamentos2022/197886.mp4: >Open: fd=movies/lancamentos2022/197886.mp4 (r), err=<nil>
2022/01/19 04:29:41 DEBUG : movies/lancamentos2022/197886.mp4: >Open: fh=&{movies/lancamentos2022/197886.mp4 (r)}, err=<nil>
2022/01/19 04:29:41 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=0
2022/01/19 04:29:41 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.openRange at 0 length 134217728
2022/01/19 04:29:41 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Flush: 
2022/01/19 04:29:41 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Flush: err=<nil>
2022/01/19 04:29:41 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Release: 
2022/01/19 04:29:41 DEBUG : movies/lancamentos2022/197886.mp4: ReadFileHandle.Release closing
2022/01/19 04:29:41 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 2093056 length 1048576 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:42 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 3141632 length 1048576 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:42 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 4190208 length 1048576 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:42 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 5238784 length 1048576 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:42 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Release: err=<nil>
2022/01/19 04:29:42 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 0 length 4096 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:42 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 4096 length 8192 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:42 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 12288 length 16384 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:42 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 28672 length 32768 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:42 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 61440 length 65536 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:42 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 126976 length 131072 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:42 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 258048 length 262144 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:42 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:42 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=131072
2022/01/19 04:29:42 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=262144
2022/01/19 04:29:42 DEBUG : : Statfs: 
2022/01/19 04:29:42 DEBUG : : >Statfs: stat={Blocks:5389680640 Bfree:1451671267 Bavail:1451671267 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=<nil>
2022/01/19 04:29:42 DEBUG : : Statfs: 
2022/01/19 04:29:42 DEBUG : : >Statfs: stat={Blocks:5389680640 Bfree:1451671267 Bavail:1451671267 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=<nil>
2022/01/19 04:29:42 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 520192 length 524288 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:42 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:42 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:42 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=393216
2022/01/19 04:29:42 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 1044480 length 1048576 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:42 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:42 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=524288
2022/01/19 04:29:42 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:42 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 2093056 length 1048576 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:43 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 3141632 length 1048576 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:43 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 4190208 length 1048576 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:43 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 5238784 length 1048576 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:43 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 6287360 length 1048576 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:43 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 7335936 length 1048576 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:43 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 8384512 length 1048576 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:43 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 9433088 length 1048576 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:43 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 10481664 length 1048576 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:43 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 11530240 length 1048576 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:43 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 12578816 length 1048576 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:43 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 13627392 length 1048576 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:43 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 14675968 length 1048576 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:43 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 15724544 length 1048576 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:43 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=655360
2022/01/19 04:29:43 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:43 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=786432
2022/01/19 04:29:43 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:43 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=917504
2022/01/19 04:29:43 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 16773120 length 1048576 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:43 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:43 DEBUG : : Statfs: 
2022/01/19 04:29:43 DEBUG : : >Statfs: stat={Blocks:5389680640 Bfree:1451671267 Bavail:1451671267 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=<nil>
2022/01/19 04:29:43 DEBUG : : Statfs: 
2022/01/19 04:29:43 DEBUG : : >Statfs: stat={Blocks:5389680640 Bfree:1451671267 Bavail:1451671267 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=<nil>
2022/01/19 04:29:43 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=1048576
2022/01/19 04:29:43 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:43 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=1179648
2022/01/19 04:29:43 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:43 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=1310720
2022/01/19 04:29:43 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:44 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=1572864
2022/01/19 04:29:44 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=1441792
2022/01/19 04:29:44 DEBUG : movies/lancamentos2022/197886.mp4: waiting for in-sequence read to 1572864 for 20ms
2022/01/19 04:29:44 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:44 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:44 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=1703936
2022/01/19 04:29:44 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:44 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=1835008
2022/01/19 04:29:44 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:44 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=1966080
2022/01/19 04:29:44 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 17821696 length 1048576 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:44 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:44 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=2097152
2022/01/19 04:29:44 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:44 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=2228224
2022/01/19 04:29:44 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:44 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=2359296
2022/01/19 04:29:44 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:44 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=2490368
2022/01/19 04:29:44 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:44 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=2621440
2022/01/19 04:29:44 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:44 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=2752512
2022/01/19 04:29:44 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:44 DEBUG : : Statfs: 
2022/01/19 04:29:44 DEBUG : : >Statfs: stat={Blocks:5389680640 Bfree:1451671267 Bavail:1451671267 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=<nil>
2022/01/19 04:29:44 DEBUG : : Statfs: 
2022/01/19 04:29:44 DEBUG : : >Statfs: stat={Blocks:5389680640 Bfree:1451671267 Bavail:1451671267 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=<nil>
2022/01/19 04:29:45 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=2883584
2022/01/19 04:29:45 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:45 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=3014656
2022/01/19 04:29:45 DEBUG : movies/lancamentos2022/197886.mp4: ChunkedReader.Read at 18870272 length 1048576 chunkOffset 0 chunkSize 134217728
2022/01/19 04:29:45 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:45 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=3145728
2022/01/19 04:29:45 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:45 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=3276800
2022/01/19 04:29:45 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:45 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=3407872
2022/01/19 04:29:45 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:45 DEBUG : : Statfs: 
2022/01/19 04:29:45 DEBUG : : >Statfs: stat={Blocks:5389680640 Bfree:1451671267 Bavail:1451671267 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=<nil>
2022/01/19 04:29:45 DEBUG : : Statfs: 
2022/01/19 04:29:45 DEBUG : : >Statfs: stat={Blocks:5389680640 Bfree:1451671267 Bavail:1451671267 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=<nil>
2022/01/19 04:29:46 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=3538944
2022/01/19 04:29:46 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:46 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=3670016
2022/01/19 04:29:46 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:46 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=3801088
2022/01/19 04:29:46 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:46 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=3932160
2022/01/19 04:29:46 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: >Read: read=131072, err=<nil>
2022/01/19 04:29:46 DEBUG : : Statfs: 
2022/01/19 04:29:46 DEBUG : : >Statfs: stat={Blocks:5389680640 Bfree:1451671267 Bavail:1451671267 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=<nil>
2022/01/19 04:29:46 DEBUG : : Statfs: 
2022/01/19 04:29:46 DEBUG : : >Statfs: stat={Blocks:5389680640 Bfree:1451671267 Bavail:1451671267 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=<nil>
2022/01/19 04:29:47 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=4063232
2022/01/19 04:29:47 DEBUG : &{movies/lancamentos2022/197886.mp4 (r)}: Read: len=131072, offset=4194304
2

There's nothing in your rclone log that looks odd as that's normal.

You have some scenarios in there and are those in your log that you shared?

What are you using to play videos?
Is it transcoding?
Is the player and server in the same location? If not, where are they located?
Are you direct playing / transcoding?

Majority of the time, it's rarely rclone in this scenario unless they are common problems in the logs which I don't see any.

3

I'm not transcoding, i'm playing it directly from apache2 directory listing (without any player).
i put this link (example): http://www.example.com/movies/lancamentos2022/215653.mp4
I know it's not rclone, but is there anything i can do to make it faster, and low iowait? any flags or anything that could help?

4

How are you playing it? A browser? A player?

If you know it's not rclone, how could a rclone flag solve it then?

You seem to be skipping things I'm asking as well so not sure how to help without understanding the problem.

5

I'm using a browser to watch it.
like this, then i click on the movie that i want to watch:

Capture
Capture512×601 28.2 KB

6

What usually takes the time when starting movies is all the seeking backwards and forth the players do.

However your log doesn't show any seeking.

Looking at the log it seems to take about 3 seconds before rclone has delivered the first 200k of data which I would have thought would be enough for the player to start.

If you want to investigate further, the DEBUG log from the moment you click on the movie will tell you exactly what rclone is doing.

You can also try --vfs-cache-mode full which will locally cache stuff which may well be quicker in the uncached case and will definitely be quicker in the cached case.

You could also try rclone serve http to serve the files from rclone which cuts out a few layers - that may work better too.

7

Wow thank you so much, using rclone serve http it's so much faster now.

the only thing that i'm trying to figure out, is that when i close the terminal, the rclone web server also stops, do you know how can i keep it active, even when the terminal is closed?

8

You can make a .service file for it or use --daemon on whatever command line you are running and that'll put it in the background.

9

I thought daemon didn't work with rclone serve http because everywhere that i try to put this command, i get this error: Fatal error: unknown flag: --daemon, so how?

what i've tried:

rclone --daemon serve http dropbox:/ --addr 0.0.0.0:80
rclone serve --daemon http dropbox:/ --addr 0.0.0.0:80
rclone serve http --daemon dropbox:/ --addr 0.0.0.0:80
rclone serve http dropbox:/ --daemon --addr 0.0.0.0:80
rclone serve http dropbox:/ --addr 0.0.0.0:80 --daemon

but using service worked, thanks.

10

Oh right, my mistake.

--daemon is only for mount.

11

@ncw @Animosity022 Thank you so much for help!
the problem was solved using rclone serve http, it improved a lot, now i don't have iowaits anymore, and every file and directories are opening so much fast comparing to rclone + apache2. :smiley:

2 Likes
12

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.