One Drive Union

mkspawn · August 29, 2023, 2:00am

What is the problem you are having with rclone?

I want merge some 5 TB Onedrive to One Drive Exampe so i have 15TB.
Filestructur ist in example.

Onedrive1:
Movies\A\AMovie.avi
Movies\B\BMovie.ava

Onedrive2:
Movies\A\AAMovie.avi
Movies\B\BBMovie.avi

Onedrive3:
Movies\A\AAAMovie.avi
Movies\B\BBBmovie.avi

When i make a union, the i see only files from Onerdrive3:

Run the command 'rclone version' and share the full output of the command.

rclone v1.63.1

os/version: Microsoft Windows 11 Pro 21H2 (64 bit)
os/kernel: 10.0.22000.2295 (x86_64)
os/type: windows
os/arch: amd64
go/version: go1.20.6
go/linking: static
go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)

Ondrive

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

rclone mount combi: x: --vfs-cache-mode=full  --vfs-fast-fingerprint  --no-checksum --no-modtime --network-mode -vv

The rclone config contents with secrets removed.

Paste config here

A log from the command with the `-vv` flag

Paste  log here

kapitainsky · August 29, 2023, 6:16am

Do you need any help here?

In case if yes please share all missing info.

mkspawn · August 29, 2023, 8:41am

Ui Sorry
I have make first both onedrive readonly becasue full.

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

rclone mount secret1: x: --vfs-cache-mode=full  --vfs-fast-fingerprint  --no-checksum --no-modtime --network-mode -vv

The rclone config contents with secrets removed.

[11]
type = onedrive
region = global
token = {"access_token":
drive_id = b!-
drive_type = business
client_id = 
client_secret = 
[12]
type = onedrive
region = global
token = {"access_token":
drive_id = b!-
drive_type = business
client_id = 
client_secret = 
[13]
type = onedrive
region = global
token = {"access_token":
drive_id = b!-
drive_type = business
client_id = 
client_secret = 
[union1]
type = union
upstreams = 11:ro 12:ro 13:
action_policy = epall
create_policy = epmfs
search_policy = ff
[secret1]
type = crypt
remote = union1:
password =

A log from the command with the `-vv` flag

2023/08/29 10:37:25 DEBUG : rclone: Version "v1.63.1" starting with parameters ["rclone" "mount" "secret1:" "x:" "--vfs-cache-mode=full" "--vfs-fast-fingerprint" "--no-checksum" "--no-modtime" "--network-mode" "-vv"]
2023/08/29 10:37:25 DEBUG : Creating backend with remote "secret1:"
2023/08/29 10:37:25 DEBUG : Using config file from "C:\\Users\\xxx\\AppData\\Roaming\\rclone\\rclone.conf"
2023/08/29 10:37:25 DEBUG : Creating backend with remote "union1:"
2023/08/29 10:37:25 DEBUG : Creating backend with remote "13:"
2023/08/29 10:37:25 DEBUG : Creating backend with remote "11:ro"
2023/08/29 10:37:25 DEBUG : Creating backend with remote "12:ro"
2023/08/29 10:37:25 DEBUG : OneDrive root 'ro': Token expired but no uploads in progress - doing nothing
2023/08/29 10:37:25 DEBUG : 12: Loaded invalid token from config file - ignoring
2023/08/29 10:37:25 DEBUG : Saving config "token" in section "12" of the config file
2023/08/29 10:37:25 DEBUG : Keeping previous permissions for config file: -rw-rw-rw-
2023/08/29 10:37:25 DEBUG : 12: Saved new token in config file
2023/08/29 10:37:26 DEBUG : union root '': actionPolicy = *policy.EpAll, createPolicy = *policy.EpMfs, searchPolicy = *policy.FF
2023/08/29 10:37:26 DEBUG : vfs cache: root is "C:\\Users\\xxx\\AppData\\Local\\rclone"
2023/08/29 10:37:26 DEBUG : vfs cache: data root is "\\\\?\\C:\\Users\\xxx\\AppData\\Local\\rclone\\vfs\\secret1"
2023/08/29 10:37:26 DEBUG : vfs cache: metadata root is "\\\\?\\C:\\Users\\xxx\\AppData\\Local\\rclone\\vfsMeta\\secret1"
2023/08/29 10:37:26 DEBUG : Creating backend with remote "C:/Users/xxx/AppData/Local/rclone/vfs/secret1/"
2023/08/29 10:37:26 DEBUG : fs cache: renaming cache item "C:/Users/xxx/AppData/Local/rclone/vfs/secret1/" to be canonical "//?/C:/Users/xxx/AppData/Local/rclone/vfs/secret1"
2023/08/29 10:37:26 DEBUG : Creating backend with remote "C:/Users/xxx/AppData/Local/rclone/vfsMeta/secret1/"
2023/08/29 10:37:26 DEBUG : fs cache: renaming cache item "C:/Users/xxx/AppData/Local/rclone/vfsMeta/secret1/" to be canonical "//?/C:/Users/xxx/AppData/Local/rclone/vfsMeta/secret1"
2023/08/29 10:37:26 DEBUG : Network mode mounting is enabled
2023/08/29 10:37:26 DEBUG : Mounting on "x:" ("\\server\\secret1")
2023/08/29 10:37:26 DEBUG : Encrypted drive 'secret1:': Mounting with options: ["-o" "attr_timeout=1" "-o" "uid=-1" "-o" "gid=-1" "--FileSystemName=rclone" "--VolumePrefix=\\server\\secret1"]
2023/08/29 10:37:26 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2023/08/29 10:37:26 DEBUG : Encrypted drive 'secret1:': Init:
2023/08/29 10:37:26 DEBUG : Encrypted drive 'secret1:': >Init:
2023/08/29 10:37:26 DEBUG : /: Statfs:
2023/08/29 10:37:26 DEBUG : OneDrive root '': Next delta token is: xxx
2023/08/29 10:37:26 DEBUG : OneDrive root 'ro': Next delta token is: xxx
2023/08/29 10:37:26 DEBUG : OneDrive root 'ro': Next delta token is: xxx
2023/08/29 10:37:26 DEBUG : /: >Statfs: stat={Bsize:4096 Frsize:4096 Blocks:4026531840 Bfree:545880491 Bavail:545880491 Files:1000000000 Ffree:1000000000 Favail:0 Fsid:0 Flag:0 Namemax:255}, errc=0
2023/08/29 10:37:26 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/08/29 10:37:26 DEBUG : /: >Getattr: errc=0
2023/08/29 10:37:26 DEBUG : /: Readlink:
2023/08/29 10:37:26 DEBUG : /: >Readlink: linkPath="", errc=-40
2023/08/29 10:37:26 DEBUG : /: Getxattr: name="non-existant-xxx"
2023/08/29 10:37:26 DEBUG : /: >Getxattr: errc=-40, value=""
The service rclone has been started.
2023/08/29 10:37:26 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/08/29 10:37:26 DEBUG : /: >Getattr: errc=0
2023/08/29 10:37:26 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/08/29 10:37:26 DEBUG : /: >Getattr: errc=0
2023/08/29 10:37:26 DEBUG : /: Opendir:
2023/08/29 10:37:26 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2023/08/29 10:37:26 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2023/08/29 10:37:26 DEBUG : /: >Opendir: errc=0, fh=0x0
2023/08/29 10:37:26 DEBUG : /: Releasedir: fh=0x0
2023/08/29 10:37:26 DEBUG : /: >Releasedir: errc=0
2023/08/29 10:37:26 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/08/29 10:37:26 DEBUG : /: >Getattr: errc=0
2023/08/29 10:37:26 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/08/29 10:37:26 DEBUG : /: >Getattr: errc=0
2023/08/29 10:37:26 DEBUG : /: Opendir:
2023/08/29 10:37:26 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2023/08/29 10:37:26 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2023/08/29 10:37:26 DEBUG : /: >Opendir: errc=0, fh=0x0
2023/08/29 10:37:26 DEBUG : /: Releasedir: fh=0x0
2023/08/29 10:37:26 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/08/29 10:37:26 DEBUG : /: >Getattr: errc=0
2023/08/29 10:37:26 DEBUG : /: >Releasedir: errc=0
2023/08/29 10:37:26 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/08/29 10:37:26 DEBUG : /: >Getattr: errc=0
2023/08/29 10:37:26 DEBUG : /: Opendir:
2023/08/29 10:37:26 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2023/08/29 10:37:26 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2023/08/29 10:37:26 DEBUG : /: >Opendir: errc=0, fh=0x0
2023/08/29 10:37:26 DEBUG : /: Releasedir: fh=0x0
2023/08/29 10:37:26 DEBUG : /: >Releasedir: errc=0
2023/08/29 10:37:26 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/08/29 10:37:26 DEBUG : /: >Getattr: errc=0
2023/08/29 10:37:26 DEBUG : /Desktop.ini: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/08/29 10:37:27 DEBUG : /Desktop.ini: >Getattr: errc=-2
2023/08/29 10:37:27 DEBUG : /Desktop.ini: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/08/29 10:37:27 DEBUG : /Desktop.ini: >Getattr: errc=-2
2023/08/29 10:37:27 DEBUG : /AutoRun.inf: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/08/29 10:37:27 DEBUG : /AutoRun.inf: >Getattr: errc=-2
2023/08/29 10:37:27 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/08/29 10:37:27 DEBUG : /: >Getattr: errc=0
2023/08/29 10:37:27 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/08/29 10:37:27 DEBUG : /: >Getattr: errc=0
2023/08/29 10:37:27 DEBUG : /: Opendir:
2023/08/29 10:37:27 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2023/08/29 10:37:27 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2023/08/29 10:37:27 DEBUG : /: >Opendir: errc=0, fh=0x0
2023/08/29 10:37:27 DEBUG : /: Releasedir: fh=0x0
2023/08/29 10:37:27 DEBUG : /: >Releasedir: errc=0
2023/08/29 10:37:27 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/08/29 10:37:27 DEBUG : /: >Getattr: errc=0
2023/08/29 10:37:27 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/08/29 10:37:27 DEBUG : /: >Getattr: errc=0
2023/08/29 10:37:27 DEBUG : /: Opendir:
2023/08/29 10:37:27 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2023/08/29 10:37:27 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2023/08/29 10:37:27 DEBUG : /: >Opendir: errc=0, fh=0x0
2023/08/29 10:37:27 DEBUG : /: Releasedir: fh=0x0
2023/08/29 10:37:27 DEBUG : /: >Releasedir: errc=0
2023/08/29 10:37:27 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/08/29 10:37:27 DEBUG : /: >Getattr: errc=0
2023/08/29 10:37:27 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/08/29 10:37:27 DEBUG : /: >Getattr: errc=0
2023/08/29 10:37:27 DEBUG : /: Opendir:
2023/08/29 10:37:27 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2023/08/29 10:37:27 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2023/08/29 10:37:27 DEBUG : /: >Opendir: errc=0, fh=0x0
2023/08/29 10:37:27 DEBUG : /: Releasedir: fh=0x0
2023/08/29 10:37:27 DEBUG : /: >Releasedir: errc=0
2023/08/29 10:37:27 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/08/29 10:37:27 DEBUG : /: >Getattr: errc=0
2023/08/29 10:37:27 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/08/29 10:37:27 DEBUG : /: >Getattr: errc=0
2023/08/29 10:37:27 DEBUG : /: Opendir:
2023/08/29 10:37:27 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2023/08/29 10:37:27 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2023/08/29 10:37:27 DEBUG : /: >Opendir: errc=0, fh=0x0
2023/08/29 10:37:27 DEBUG : /: Releasedir: fh=0x0
2023/08/29 10:37:27 DEBUG : /: >Releasedir: errc=0
2023/08/29 10:37:27 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/08/29 10:37:27 DEBUG : /: >Getattr: errc=0
2023/08/29 10:37:27 DEBUG : /: Getattr: fh=0xFFFFFFFFFFFFFFFF
2023/08/29 10:37:27 DEBUG : /: >Getattr: errc=0
2023/08/29 10:37:27 DEBUG : /: Opendir:
2023/08/29 10:37:27 DEBUG : /: OpenFile: flags=O_RDONLY, perm=-rwxrwxrwx
2023/08/29 10:37:27 DEBUG : /: >OpenFile: fd=/ (r), err=<nil>
2023/08/29 10:37:27 DEBUG : /: >Opendir: errc=0, fh=0x0
2023/08/29 10:37:27 DEBUG : /: Releasedir: fh=0x0
2023/08/29 10:37:27 DEBUG : /: >Releasedir: errc=0

When i mount the three Onedrives, then i see only last, because i think, overall same directory with same subdirectory is not working, but filename is not same. how you can see on my first post.

kapitainsky · August 29, 2023, 8:46am

With all details it is very clear where the issue is:)

I am sure you do not have folders called ro on your 11 and 12 remote... Only content of these non existing folders appear in your union - so you see nothing.

What you want is to change it to:

upstreams = 11::ro 12::ro 13:

Then it will make 11 and 12 remotes root content read only part of the union.

mkspawn · August 29, 2023, 9:11am

Thank you for your help, sometimes is it easy

system · September 1, 2023, 9:11am

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.

One Drive Union

What is the problem you are having with rclone?

Run the command 'rclone version' and share the full output of the command.

Which cloud storage system are you using? (eg Google Drive)

The command you were trying to run (eg rclone copy /tmp remote:tmp)

The rclone config contents with secrets removed.

A log from the command with the -vv flag

The command you were trying to run (eg rclone copy /tmp remote:tmp)

The rclone config contents with secrets removed.

A log from the command with the -vv flag

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

A log from the command with the `-vv` flag

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

A log from the command with the `-vv` flag