Hello Experts,
I am using Rclone in remote api mode and using '/sync/copy' to transfer files in async mode.
When I remove internet connection from machine and run "rclone copy" command in command line the retry looks to be fine -
Command : rclone copy awso9dl:o9datalake/targetaws/test1.txt awso9dl:o9datalake/targetaws/test1_copy6.txt --log-level DEBUG --log-file=D:\logs\log4.txt --retries 3 --retries-sleep 10s
I can see 3 retry attempts in logs as it cant reach remote -
But when I test same thing with remote mode with asycn request submitted, whatever the retry count I pass it just takes 120 to 150 seconds and job fails.
I dont see any retry logic related debug logs in log file.
Below is the command with I run remote mode rclone -
rclone.exe rcd --rc-no-auth --rc-job-expire-duration=60m --rc-addr=localhost:5574 --log-level DEBUG --log-file=D:\logs\remotelog10
.txt --retries 10
And below the request sent to rclone for copy -
http://localhost:5574/sync/copy
{
"srcFs": "awso9dl:o9datalake/targetaws",
"dstFs": "awso9dl:o9datalake/targetaws_mh01/a5",
"_filter" : {
"IncludeRule" :
},
"_async" : true
}
Job status gives completed failed response after 120+ seconds
C:\Users\mahendra.hegde>curl -X POST -d '{}' http://localhost:5574/job/status?jobid=1
{
"duration": 128.0721921,
"endTime": "2024-12-05T11:42:56.8807359+05:30",
"error": "RequestError: send request failed\ncaused by: Get "https://o9datalake.s3.us-east-1.amazonaws.com/?delimiter=%2F\u0026encoding-type=url\u0026list-type=2\u0026max-keys=1000\u0026prefix=targetaws%2F\": dial tcp: lookup o9datalake.s3.us-east-1.amazonaws.com: no such host",
"finished": true,
"group": "job/1",
"id": 1,
"output": {},
"startTime": "2024-12-05T11:40:48.8085438+05:30",
"success": false
}
But I dont see anything related to retry in logs.
Logs:
Just want to understand if retry is not happening for remote api mode and just happening for command line mode or am I missing something here?
Rclone version:
rclone v1.63.1
- os/version: Microsoft Windows 11 Pro 24H2 (64 bit)
- os/kernel: 10.0.26100.2314 (x86_64)
- os/type: windows
- os/arch: amd64
- go/version: go1.20.6
- go/linking: static
- go/tags: cmount