Rclone copy keep waiting on metadata read

Suspected Bug
1

What is the problem you are having with rclone?

We're trying to copy files from a local directory (it's a NFS mount) to OCI Object Storage. Since the number of files and directories to transfer could be huge, we decided to perform the transfer in small batches (files count < 10000) providing the list of files to be copied.

On some files, it seems that rclone keep waiting on metadata read, therefore the copy never ends.

The files are not empty or corrupted either. Moreover:

  • If we try to run the copy only on these untrasferred files, it never completes
  • If we try to run the sync only on these untrasferred files, it works

Run the command 'rclone version' and share the full output of the command.

rclone v1.70.2
- os/version: redhat 9.4 (64 bit)
- os/kernel: 5.14.0-427.13.1.el9_4.x86_64 (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.24.4
- go/linking: static
- go/tags: none

Which cloud storage system are you using?

Oracle Object Storage

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone copy --stats-one-line-date --stats 5s --oos-no-check-bucket --no-traverse --cache-db-purge --transfers 160 --checkers 8 --bwlimit 40M <source_dir> oci:<bucket-name> --files-from files_0000000000

The rclone config contents with secrets removed.

[oci]
type = oracleobjectstorage
provider = user_principal_auth
namespace = XXX
compartment = XXX
region = eu-milan-1
endpoint = <private-endpoint>.eu-milan-1.oci.customer-oci.com

A log from the command with the -vv flag

2025/07/24 10:24:44 DEBUG : <filename>.zip: trying to read metadata <filename>.zip
2

welcome to the forum,

before calling this a bug, need to update rclone and test again

does nothing, can remove it.

can you pick just one single file and post the full debug logs

  • rclone lsf /path/to/file -vv --format=pM
  • rclone copy /path/to/file -vv
3

The output of lsf is:

/rclone lsf /mnt/path/to/file -vv --format=pM

2025/07/30 11:05:33 DEBUG : rclone: Version "v1.70.3" starting with parameters ["./rclone" "lsf" "/mnt/path/to/file" "-vv" "--format=pM"]

2025/07/30 11:05:33 DEBUG : Creating backend with remote "/mnt/path/to/file"

2025/07/30 11:05:33 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"

2025/07/30 11:05:33 DEBUG : fs cache: renaming child cache item "/mnt/path/to/file" to be canonical for parent "path/to"

file;{"atime":"2024-06-29T17:01:42.676138+02:00","btime":"1970-01-01T01:00:00+01:00","gid":"507","mode":"100640","mtime":"2024-06-29T17:01:42.676138+02:00","uid":"507"}

2025/07/30 11:05:33 DEBUG : 4 go routines active

That's instead the output of copy:

rclone copy /mnt/path/to/file -vv oci:bucket1/
2025/07/30 11:06:58 DEBUG : rclone: Version "v1.70.3" starting with parameters ["./rclone" "copy" "/mnt/path/to/file" "-vv" "oci:bucket/"]
2025/07/30 11:06:58 DEBUG : Creating backend with remote "/mnt/path/to/file"
2025/07/30 11:06:58 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2025/07/30 11:06:58 DEBUG : fs cache: renaming child cache item "/mnt/path/to/file" to be canonical for parent "/mnt/path/to"
2025/07/30 11:06:58 DEBUG : Creating backend with remote "oci:bucket/"
2025/07/30 11:06:58 DEBUG : fs cache: renaming cache item "oci:bucket/" to be canonical "oci:bucket"
2025/07/30 11:06:58 DEBUG : file: trying to read metadata file
2025/07/30 11:06:58 DEBUG : file: Need to transfer - File not found at Destination
2025/07/30 11:07:09 DEBUG : file: trying to read metadata file
2025/07/30 11:07:09 DEBUG : file: md5 = a658c91e96633355302e85ff0648a9e8 OK
2025/07/30 11:07:09 INFO  : file: Copied (new)
2025/07/30 11:07:09 INFO  : 
Transferred:   	   65.281 MiB / 65.281 MiB, 100%, 5.718 MiB/s, ETA 0s
Transferred:            1 / 1, 100%
Elapsed time:        10.7s

By the way, also using rclone 1.70.2 the behaviour of lsf and copy on a single file looks the same

4

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.