What is the problem you are having with rclone?
When using an HTTP source, files that have + in their names are requested with it instead of %2B (URLencode symbol, like %20 for space), which means the server returns a 404 error.
Run the command 'rclone version' and share the full output of the command.
rclone v1.68.0-beta.8116.31fabb340
- os/version: Microsoft Windows 11 Pro 23H2 (64 bit)
- os/kernel: 10.0.22631.3880 (x86_64)
- os/type: windows
- os/arch: amd64
- go/version: go1.23rc2
- go/linking: static
- go/tags: cmount
Which cloud storage system are you using? (eg Google Drive)
HTTP
The command you were trying to run (eg rclone copy /tmp remote:tmp
)
rclone sync http_server:"No-Intro/Nintendo - Nintendo Entertainment System (Headered)/" "Nintendo - Nintendo Entertainment System (Headered)"/ -vv --no-check-certificate --transfers 8 --checkers 16 --size-only --http-no-head
The rclone config contents with secrets removed.
[http_server]
type = http
url = https://secret_host/files/
A log from the command with the -vv
flag
LOG created with --dump header to see the requests, so the log is big, unwieldy and has multiple different requests of different files, all similar. For this message, I isolated all the entries of a specific file. A more complete log can be provided, if requested.
<tr><td class="link"><a href="D%2BPad%20Hero%20%28USA%29%20%28v1.0%29%20%28Aftermarket%29%20%28Unl%29.zip" title="D+Pad Hero (USA) (v1.0) (Aftermarket) (Unl).zip">D+Pad Hero (USA) (v1.0) (Aftermarket) (Unl).zip</a></td><td class="size">37.9 KiB</td><td class="date">03-Apr-2024 22:10</td></tr>```
2024/07/22 02:31:40 DEBUG : D+Pad Hero (USA) (v1.0) (Aftermarket) (Unl).zip: Need to transfer - File not found at Destination
2024/07/22 02:31:42 DEBUG : GET /files/No-Intro/Nintendo%20-%20Nintendo%20Entertainment%20System%20%28Headered%29/D+Pad%20Hero%20%28USA%29%20%28v1.0%29%20%28Aftermarket%29%20%28Unl%29.zip HTTP/1.1
Host: secret_host
User-Agent: rclone/v1.68.0-beta.8116.31fabb340
Accept-Encoding: gzip
2024/07/22 02:31:42 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/07/22 02:31:42 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/07/22 02:31:42 DEBUG : HTTP RESPONSE (req 0xc00252e280)
2024/07/22 02:31:42 DEBUG : HTTP/1.1 303 See Other
Content-Length: 146
Cache-Control: public, max-age=31536000
Connection: keep-alive
Content-Type: text/html
Date: Mon, 22 Jul 2024 05:31:05 GMT
Location: https://secret_host/files/No-Intro/Nintendo%20-%20Nintendo%20Entertainment%20System%20%28Headered%29/D+Pad%20Hero%20%28USA%29%20%28v1.0%29%20%28Aftermarket%29%20%28Unl%29.zip
Server: nginx
<html>
<head><title>303 See Other</title></head>
<body>
<center><h1>303 See Other</h1></center>
<hr><center>nginx</center>
</body>
</html>
2024/07/22 02:31:42 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/07/22 02:31:42 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/07/22 02:31:42 DEBUG : HTTP REQUEST (req 0xc0025d6500)
2024/07/22 02:31:42 DEBUG : GET /files/No-Intro/Nintendo%20-%20Nintendo%20Entertainment%20System%20%28Headered%29/D+Pad%20Hero%20%28USA%29%20%28v1.0%29%20%28Aftermarket%29%20%28Unl%29.zip HTTP/1.1
Host: secret_host
User-Agent: rclone/v1.68.0-beta.8116.31fabb340
Referer: https://secret_host/files/No-Intro/Nintendo%20-%20Nintendo%20Entertainment%20System%20%28Headered%29/D+Pad%20Hero%20%28USA%29%20%28v1.0%29%20%28Aftermarket%29%20%28Unl%29.zip
Accept-Encoding: gzip
2024/07/22 02:31:42 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/07/22 02:31:42 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/07/22 02:31:42 DEBUG : HTTP RESPONSE (req 0xc002400b40)
2024/07/22 02:31:42 DEBUG : HTTP/1.1 404 Not Found
Content-Length: 2293
Connection: keep-alive
Content-Type: text/html
Date: Mon, 22 Jul 2024 05:31:05 GMT
Etag: "664a39c2-8f5"
Server: nginx
If I simply copy/paste the HTTP GET request url and paste it on my browser, I also get a 404.
If I replace the + signal on the filename with the URLencode symbol (%2B) and paste it on my browser, the file will download.
This seems similar to rclone copy with http remote fails with HTTP Error: 404 Not Found when URL contains question mark · Issue #7637 · rclone/rclone · GitHub, but that related to question marks. Changing the "no_escape" option in the config file or rsync config doesn't change the behavior.