Rclone not copying or syncing parent directory with empty child directory

Help and Support
1

STOP and READ USE THIS TEMPLATE NO EXCEPTIONS - By not using this, you waste your time, our time and really hate puppies. Please remove these two lines and that will confirm you have read them.

What is the problem you are having with rclone?

I have a parent repo with empty child repo. I am trying to Syn it to remote. But its not creating any repo on remote, even using copy command is not helping out.

Run the command 'rclone version' and share the full output of the command.

rclone: Version "v1.66.0"

Which cloud storage system are you using? (eg Google Drive)

Oracle cloud(Oracle Object Storage Bucket)

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone -vv copy testdir devcorp:fsgbu_obcbcs_cndevcorp_crdr_test2/testdir
rclone -vv copy testdir devcorp:fsgbu_obcbcs_cndevcorp_crdr_test2/testdir --create-empty-src-dirs
rclone -vv sync testdir devcorp:fsgbu_obcbcs_cndevcorp_crdr_test2/testdir
rclone -vv sync testdir devcorp:fsgbu_obcbcs_cndevcorp_crdr_test2/testdir --create-empty-src-dirs

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

[oracle@filesystem-pod2 ~]$ rclone config redacted
[devcorp]
type = oracleobjectstorage
provider = user_principal_auth
namespace = XXX
compartment = XXX
region = xx-yy-zz
config_profile = DEVCORP
### Double check the config for sensitive info before posting publicly

A log from the command that you were trying to run with the -vv flag

2024/06/21 06:32:32 DEBUG : rclone: Version "v1.66.0" starting with parameters ["rclone" "-vv" "copy" "testdir" "devcorp:fsgbu_obcbcs_cndevcorp_crdr_test2/testdir" "--create-empty-src-dirs"]
2024/06/21 06:32:32 DEBUG : Creating backend with remote "testdir"
2024/06/21 06:32:32 DEBUG : Using config file from "/home/oracle/.config/rclone/rclone.conf"
2024/06/21 06:32:32 DEBUG : fs cache: renaming cache item "testdir" to be canonical "/home/oracle/testdir"
2024/06/21 06:32:32 DEBUG : Creating backend with remote "devcorp:fsgbu_obcbcs_cndevcorp_crdr_test2/testdir"
2024/06/21 06:32:32 DEBUG : testdir: trying to read metadata testdir
2024/06/21 06:32:32 DEBUG : oos:bucket fsgbu_obcbcs_cndevcorp_crdr_test2, path testdir: listing: bucket : fsgbu_obcbcs_cndevcorp_crdr_test2, directory:
2024/06/21 06:32:32 DEBUG : parentdir: Making directory
2024/06/21 06:32:32 DEBUG : parentdir/childdir: Making directory
2024/06/21 06:32:32 DEBUG : oos:bucket fsgbu_obcbcs_cndevcorp_crdr_test2, path testdir: Waiting for checks to finish
2024/06/21 06:32:32 DEBUG : oos:bucket fsgbu_obcbcs_cndevcorp_crdr_test2, path testdir: Waiting for transfers to finish
2024/06/21 06:32:32 DEBUG : parentdir/childdir: Making directory
2024/06/21 06:32:32 DEBUG : oos:bucket fsgbu_obcbcs_cndevcorp_crdr_test2, path testdir: copied 1 directories
2024/06/21 06:32:32 INFO  : There was nothing to transfer
2024/06/21 06:32:32 INFO  :
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Elapsed time:         0.0s

2024/06/21 06:32:32 DEBUG : 6 go routines active
2

The object storage is a flat system, unlike hierarchical file systems, so there is no “folders” concept.

There should be an option to simulate empty directories. But for some reason I can’t find it now. Something got messed up with oracle storage docs.

I will come back to you later unless somebody can dig it out before.

3

welcome to the forum,

should rclone selfupdate and test again, as the latest rclone changes how it handles directories.

what is a repo? do you mean directory?

to test the ability to create an empty dir.

rclone mkdir devcorp:fsgbu_obcbcs_cndevcorp_crdr_test2/emptydir -vv
rclone lsd devcorp:fsgbu_obcbcs_cndevcorp_crdr_test2: -vv

well, rclone claims it can create a directory and the log shows rclone log doing that.

rclone backend features oracleobjectstorage | grep CanHaveEmptyDirectories
                "CanHaveEmptyDirectories": true

and from the log
DEBUG : parentdir/childdir: Making directory

whereas, with s3, object storage, rclone claims it can create an empty directory but, by default, rclone cannot

rclone backend features oracleobjectstorage | grep CanHaveEmptyDirectories
                "CanHaveEmptyDirectories": true

notice that rclone emits a Warning for s3, but not for oos

rclone mkdir wasabi01:zork/emptydir
NOTICE: S3 bucket zork path emptydir: Warning: running mkdir on a remote which can't have empty directories does nothing

on s3 to create an empty dir, must do the following

rclone mkdir wasabi01:zork/emptydir --s3-directory-markers -v
INFO  : S3 bucket zork path emptydir: Bucket "zork" created with ACL ""

however, at https://tip.rclone.org/oracleobjectstorage
there is no equivalent --oos-directory-markers

4

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.