Hello Experts,
I am using Rclone in RCD mode to transfer files from SFTP to AWS S3 bucket.
It is working fine but once in while I am getting "connection lost" error (unable to re-produce when needed)
Url : http://rclone:5572/operations/copyfile
Request body : {"srcFs": "melco5_5207_SFTP_a6997e29_1b32_430e_902d_e5053c506a01:/", "dstFs": "melco5_5207_AWSS3_6214a974_c8b2_45c3_a1b9_927e63fc8eb7:", "srcRemote": "/melco/PREPROD/Inbound/VerticalPlan/In_LocationMaster.csv", "dstRemote": "o9dl-awsgt10193/int3/2/melco5/EKG/EKG_IN/IN_In_LocationMaster/IN_AWSS3_In_LocationMaster/In_LocationMaster.csv", "_async": True}
job/status end point response:
{
"duration": 300.183732733,
"endTime": "2025-05-13T05:41:50.521502394Z",
"error": "failed to open source object: Open failed: connection lost",
"finished": true,
"group": "job/129238",
"id": 129238,
"output": {},
"startTime": "2025-05-13T05:36:50.337769653Z",
"success": false
}
Rclone version : 1.68.0
Running in remote api mode (rcd)
The source file (/melco/PREPROD/Inbound/VerticalPlan/In_LocationMaster.csv) size is 4.75KB only.
What could be the reason for this and is Rclone re-trying internally with SFTP?
When I try to check this retry flags settings, logs shows retry attempts clearly in command line mode but was not seeing the retry for remote rcd mode.
(this I had tested for some other case but not this connection lost case)
(Retry logic for cmd based copy vs remote api sync/copy)
Thanks in advance,
Mahendra