Rclone and dropbox mount low level error

Help and Support
1

What is the problem you are having with rclone?

mounted dropbox low level error if I try to open a ~100GB file with nano or access it

What is your rclone version (output from rclone version)

rclone v1.56.1

Which cloud storage system are you using? (eg Google Drive)

DropBox

The command you were trying to run (eg rclone copy /tmp remote:tmp)

nano file.xx

The rclone config contents with secrets removed.

type = dropbox
client_id = yxxxxxxx
client_secret = xxxxxx
token = {"access_token":"xxxxxxxxxxxxx

rclone mount drop1: /drop1 --daemon

A log from the command with the -vv flag

2021/09/22 18:47:00 DEBUG : &{pl1/plot-k32-2021-09-22-04-48-ee0272c7a80c2adf4f494e73a48af52d4f781e580caae8d57c8f4f2cb5d7b73f.plot (r)}: >Read: read=0, err=
2021/09/22 18:47:00 DEBUG : &{pl1/plot-k32-2021-09-22-04-48-ee0272c7a80c2adf4f494e73a48af52d4f781e580caae8d57c8f4f2cb5d7b73f.plot (r)}: Read: len=4096, offset=0
2021/09/22 18:47:00 DEBUG : pl1/plot-k32-2021-09-22-04-48-ee0272c7a80c2adf4f494e73a48af52d4f781e580caae8d57c8f4f2cb5d7b73f.tmp: ChunkedReader.openRange at 0 length 134217728
2021/09/22 18:47:02 DEBUG : pacer: low level retry 1/10 (error )
2021/09/22 18:47:04 DEBUG : pacer: low level retry 2/10 (error )
2021/09/22 18:47:06 DEBUG : pacer: low level retry 3/10 (error )
2021/09/22 18:47:08 DEBUG : pacer: low level retry 4/10 (error )
2021/09/22 18:47:10 DEBUG : pacer: low level retry 5/10 (error )
2

Seems to be a small snippet of a log.
Can you share the whole thing?
Can you share the output of rclone version?

3

I did also try to limit tps with
--tpslimit=2 with mount command

Btw I upload big files without issue just random read is producing error at once, rate limit at once

Also it could be some change in dropbox policy or API limit also, I seen here few topic ppl complained, just strange i was told dropbox has less limit then google drive with API

4

Do you have a full log though as that's a snippet?

5

I tried first to seek the file then to open with nano the big file 100GB one both produce rate limit almost at once, nano are opening for some 5-10s then produce r/w error and stop

6

That's strange...

It is supposed to be printing the error in here (error ) so it is impossible to tell what has gone wrong.

Can you try a run with -vv --dump headers - this will produce a lot of output - I'm only interested in the HTTP transaction (the REQUEST and RESPONSE) which causes the low level retry errors.

If you can't figure out which one that is then post the log from a bit before the first low level retry

Thanks

7

here it is

2021/09/24 16:59:47 DEBUG : pl1/plot-k32-2021-09-22-03-43-207643f6dfc204e32803bec4a000a704fdf00d4fe98e0c03074e3987e56063d0.plot: ChunkedReader.openRange at 0 length 134217728
2021/09/24 16:59:49 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/09/24 16:59:49 DEBUG : HTTP REQUEST (req 0xc000ca8f00)
2021/09/24 16:59:49 DEBUG : POST /2/files/download HTTP/1.1
Host: content.dropboxapi.com
User-Agent: rclone/v1.56.1
Content-Length: 0
Authorization: XXXX
Dropbox-Api-Arg: {"path":"id:CPdHihodKG0AAAAAAAAAGA"}
Range: bytes=0-134217727

2021/09/24 16:59:49 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/09/24 16:59:49 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/09/24 16:59:49 DEBUG : HTTP RESPONSE (req 0xc000ca8f00)
2021/09/24 16:59:49 DEBUG : HTTP/1.1 400 Bad Request
Transfer-Encoding: chunked
Cache-Control: no-cache
Content-Security-Policy: sandbox allow-forms allow-scripts
Content-Type: text/plain; charset=utf-8
Date: Fri, 24 Sep 2021 14:59:49 GMT
Server: envoy
Strict-Transport-Security: max-age=31536000; includeSubDomains; preload
Vary: Accept-Encoding
X-Content-Type-Options: nosniff
X-Dropbox-Request-Id: d9b726b0702642d1a4f05a5b3174a344
X-Dropbox-Response-Origin: remote
X-Robots-Tag: noindex, nofollow, noimageindex
X-Robots-Tag: noindex, nofollow, noimageindex

2021/09/24 16:59:49 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/09/24 16:59:49 DEBUG : pacer: low level retry 1/10 (error )
2021/09/24 16:59:51 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/09/24 16:59:51 DEBUG : HTTP REQUEST (req 0xc000d34900)
2021/09/24 16:59:51 DEBUG : POST /2/files/download HTTP/1.1
8

Could the file size be problem its over 50GB?

9

Great log - thanks. We'd have needed --dump responses to see the error message (if any) but if you do that you'll also get any file data in the file which will be extremely messy.

It would be interesting to try that if you are feeling brave. The response gave Content-Type: text/plain; charset=utf-8 so we might get some text explanation rather than the JSON response that is usually returned from API calls.

The fact it didn't supply a JSON error probably means this is a bug in Dropbox as all API calls are supposed to return a JSON response.

I see from the docs:

Note: Files uploaded through the API must be 350GB or smaller.

If you have dropbox support it might be worth sending them the HTTP request and response and see what they say.

10

Now I have error

Error in call to API function "files/download": Your app is not permitted to access this endpoint because it does not have the required scope 'files.content.read'. The owner of the app can enable the scope for the app using the Permissions tab on the App Console.

But as far I know I enabled all in API app, will check

Ok sorted had to recreate API app and enable files.content.read, I miss that check box last time :frowning:

11

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.