What is the problem you are having with rclone?
Right after renewing the subscription, I encountered problems. It seems like something changed in the API, or some permissions were reset out of previously absent restrictions.
I use this configuration every day and haven't observed anything like this until this week.
When normal/default accessing the cloud disk (server), in response to a simple command "rclone ls remote: -vv --dump bodies" server HTML responses began to appear in the log with the following message:
You have large requests!
To be precise, there are too many requests from your browser, and the VK server has raised an alarm.
You need to enable JavaScript to fix the problem.
This page was loaded over HTTP instead of secure HTTPS, so there will be no teleportation back.
Please contact support. You have disabled Cookies, but they are needed to solve the problem.
For some reason, the page did not receive all the data, and without it, it does not work.
Please contact support. You will return to the previous page in 5 seconds.
Go back.
I think it's not worth mentioning that contacting support won't lead to anything. From support, we get the standard response for such situations:
We are not responsible for the operation of third-party software.
According to the detailed logs, an error 429 Too Many Requests is occurring.
Situation Analysis:
- HTTP 302 Redirects: The server issues 302 Found responses, redirecting your requests to a verification page (/challenge.html or /challenge-start).
- Verification Page: The content of the page includes JavaScript intended for browsers to solve a CAPTCHA or similar task to confirm that the request is coming from a human and not an automated script.
- HTML Instead of JSON: rClone expects to receive JSON responses from the API but is getting HTML content (the verification page) instead. This mismatch causes a parsing error: invalid character '<' looking for beginning of value.
- Error Message: The HTML content includes
<title data-lang-key="title">Error 429</title>
, which confirms the rate limiting issue.
rClone itself cannot process such server responses, and reports an error in the log:
2024/10/17 16:58:43 ERROR : /: Dir.Stat error: invalid character '<' looking for beginning of value
While trying to resolve the situation, I found a temporary solution using parameters that limit rClone's operation:
--tpslimit 1 --tpslimit-burst 1 --checkers 1 --transfers 1
up to
--tpslimit 2 --tpslimit-burst 4 --checkers 2 --transfers 2
Run the command 'rclone version' and share the full output of the command.
rclone v1.68.1
- os/version: Microsoft Windows 10 Pro 22H2 (64 bit)
- os/kernel: 10.0.19045.5011 (x86_64)
- os/type: windows
- os/arch: amd64
- go/version: go1.23.1
- go/linking: static
- go/tags: cmount
Which cloud storage system are you using? (eg Google Drive)
mailru
The command you were trying to run (eg rclone copy /tmp remote:tmp
)
ls
any frequent operations
Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.
[_Mail]
type = mailru
user = XXX
pass = XXX
token = XXX
A log from the command that you were trying to run with the -vv
flag
C:\rclone>rclone ls _Mail: -vv
2024/10/18 02:18:21 DEBUG : rclone: Version "v1.68.1" starting with parameters ["rclone" "ls" "_Mail:" "-vv"]
2024/10/18 02:18:21 DEBUG : Creating backend with remote "_Mail:"
2024/10/18 02:18:21 DEBUG : Using config file from "C:\\rclone\\rclone.conf"
16369 DriverVer.png
182563 AsusTools/838541A8-51CD-4aa5-B238-19BA61282115.ico
132728 _English_/Screenshot_2021-07-22-10-55-18-52.jpg
271722 _English_/Screenshot_2021-07-24-01-46-40-06.jpg
221714 _English_/Screenshot_2021-07-24-01-49-42-46.jpg
448207 _English_/Screenshot_2021-07-24-15-28-02-52.jpg
538596 _English_/Screenshot_2021-07-25-02-09-39-31.jpg
620998 _English_/Screenshot_2021-07-25-02-18-09-83.jpg
2024/10/18 02:18:23 ERROR : _Footage_: error listing: invalid character '<' looking for beginning of value
2024/10/18 02:18:23 ERROR : _INFO_: error listing: invalid character '<' looking for beginning of value
2024/10/18 02:18:23 ERROR : _MUSIC_: error listing: invalid character '<' looking for beginning of value
2024/10/18 02:18:23 ERROR : _PROJECT_: error listing: invalid character '<' looking for beginning of value
2024/10/18 02:18:23 ERROR : _Photos_: error listing: invalid character '<' looking for beginning of value
2024/10/18 02:18:27 DEBUG : 3 go routines active
2024/10/18 02:18:27 NOTICE: Failed to ls with 48 errors: last error was: invalid character '<' looking for beginning of value