I have a local directory
/A, with many sub directories
/1, /2, /3 ..., each with many data files and
_SUCCESS mark files. I want to copy this local directory
/A to the remote object store. During the copying process, I want the
_SUCCESS file in the sub directory to be copied after all data files in the sub directory copied.
I have the following questions:
- how to copy _SUCCESS file in the end after all other files copied?
- What is the behavior of copying subfolders？Is it first
rclone lsto get a flattern file list, and then transfer it concurrently in order?
rclone copy config-a:a/b/c/ config-b:a/b/c/ -P --transfers=12 --dry-run --order-by size,descending
- I tried to use
order-by size,descendingto make _SUCCESS the last one to copy. But affected by parallel tranfers, _SUCCESS file will be transferred with some data files in the final, and finished faster than the normal big data files.
rclone v1.63.1 - os/version: darwin 12.5.1 (64 bit) - os/kernel: 21.6.0 (x86_64) - os/type: darwin - os/arch: amd64 - go/version: go1.20.6 - go/linking: dynamic - go/tags: cmount