What is the problem you are having with rclone?
rclone stuck/hang after a file has finish its transfer. The file is already uploaded but rclone was still running, as you can see in the log, the INFO part keep repeating the same information.
For your information, rclone is run using docker in Github Actions runner during our CI process. At first, it happened on the latest version of rclone docker image, and so then I decided to do the following:
- enable verbose mode (-vv)
- enable headers, requests and responses dump
- enable ignore-checksum
- pin docker image version to 1.70.0
However, it still did not resolve the problem that I am facing.
Run the command 'rclone version' and share the full output of the command.
Using docker rclone 1.70.0
docker.io/rclone/rclone:1.70.0@sha256:223fbd5db2554214b1da148db589f300c193901c74b2a55336f486cf3af4ffae
#0 building with "default" instance using docker driver
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 115B done
#1 DONE 0.0s
#2 [internal] load metadata for docker.io/rclone/rclone:1.70.0
#2 ...
#3 [auth] rclone/rclone:pull token for registry-1.docker.io
#3 DONE 0.0s
#2 [internal] load metadata for docker.io/rclone/rclone:1.70.0
#2 DONE 1.7s
#4 [internal] load .dockerignore
#4 transferring context: 2B done
#4 DONE 0.0s
#5 [internal] load build context
#5 transferring context: 260B done
#5 DONE 0.0s
#6 [1/2] FROM docker.io/rclone/rclone:1.70.0@sha256:223fbd5db2554214b1da148db589f300c193901c74b2a55336f486cf3af4ffae
#6 resolve docker.io/rclone/rclone:1.70.0@sha256:223fbd5db2554214b1da148db589f300c193901c74b2a55336f486cf3af4ffae done
.....
Which cloud storage system are you using? (eg Google Drive)
S3
The command you were trying to run (eg rclone copy /tmp remote:tmp
)
rclone copy "$CDM_DIST" "s3-remote:${CDM_STORAGE_BUCKET}" --ignore-existing --no-traverse --header-upload='Cache-Control: max-age=31536000' -vvvv --ignore-checksum --checkers=32 --s3-no-check-bucket --dump headers --dump requests --dump responses
Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.
[s3-remote]
type = s3
provider = AWS
env_auth = true
region = eu-west-1
endpoint = https://s3.amazonaws.com