'device or resource busy' errors

STOP and READ USE THIS TEMPLATE NO EXCEPTIONS - By not using this, you waste your time, our time and really hate puppies. Please remove these two lines and that will confirm you have read them.

What is the problem you are having with rclone?

An error occurs during 1.6TB sync operation.
When I check the destination, the transferred video file exists but cannot be played.

Run the command 'rclone version' and share the full output of the command.

rclone v1.64.2

  • os/version: ubuntu 16.04 (64 bit)
  • os/kernel: 4.15.0-142-generic (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.21.3
  • go/linking: static
  • go/tags: none

Which cloud storage system are you using? (eg Google Drive)

S3

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone sysc src:f1 dest:f1 -P --track-renames --log-file=log.log --s3-use-multipart-etag=false --checksum --multi-thread-streams=16 --server-side-across-configs --transfers=16

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

[odc_s3]
endpoint = https://s3.s-cloud.com
type = s3
provider = Minio
basic_auth = true
access_key_id = XXX
secret_access_key = XXX
env_auth = false
region = us-east-1

[rg_nas]
type = alias
remote = /mnt_rg

A log from the command that you were trying to run with the -vv flag

Most errors are of same type :
2023/12/01 06:55:50 ERROR : aaa/bbb/38402160_28.114.mp4: Failed to copy: multi-thread copy: failed to open source: open /mnt_rg/dev/2022/aaa/bbb/38402160_28.114.mp4: device or resource busy

Below is another type of error:
2023/12/01 07:18:19 ERROR : S3 bucket sdp-iq-data path dev/2022: not deleting files as there were IO errors
2023/12/01 07:18:19 ERROR : S3 bucket sdp-iq-data path dev/2022: not deleting directories as there were IO errors
2023/12/01 07:18:19 ERROR : Attempt 1/3 failed with 781 errors and: multi-thread copy: failed to open source: open /mnt_rg/dev/2022/aaa/bbb/38402160_28.114.mp4: device or resource busy
2023/12/01 07:18:19 ERROR : aaa: error reading destination directory: SignatureDoesNotMatch: The request signature we calculated does not match the signature you provided. Check your key and signing method.
status code: 403, request id: 179C868D20E4D514, host id:

2023/12/01 07:18:19 ERROR : S3 bucket sdp-iq-data path dev/2022: not deleting files as there were IO errors
2023/12/01 07:18:19 ERROR : S3 bucket sdp-iq-data path dev/2022: not deleting directories as there were IO errors
2023/12/01 07:18:19 ERROR : Attempt 2/3 failed with 1 errors and: SignatureDoesNotMatch: The request signature we calculated does not match the signature you provided. Check your key and signing method.
status code: 403, request id: 179C868D20E4D514, host id:
2023/12/01 07:18:20 ERROR : aaa: error reading destination directory: SignatureDoesNotMatch: The request signature we calculated does not match the signature you provided. Check your key and signing method.
status code: 403, request id: 179C868D281E5761, host id:

2023/12/01 07:18:20 ERROR : S3 bucket sdp-iq-data path dev/2022: not deleting files as there were IO errors
2023/12/01 07:18:20 ERROR : S3 bucket sdp-iq-data path dev/2022: not deleting directories as there were IO errors
2023/12/01 07:18:20 ERROR : Attempt 3/3 failed with 1 errors and: SignatureDoesNotMatch: The request signature we calculated does not match the signature you provided. Check your key and signing method.
status code: 403, request id: 179C868D281E5761, host id:
2023/12/01 07:18:20 Failed to sync: SignatureDoesNotMatch: The request signature we calculated does not match the signature you provided. Check your key and signing method.
status code: 403, request id: 179C868D281E5761, host id:

Your source file is not accessible - maybe used by other program etc. rclone tries its best but there are limits what it can do.

Make sure when you sync something that it is available. If you can not guarantee it your sync won't be complete. You can always try to run it again to sort out problematic files - this should be much faster than original sync.

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.