Combining different storage pools

What is the problem you are having with rclone?

I have 3 different OneDrive accounts, 2x with 5TB and one with 1x TB. Is it possible to apply something that it would combine these three drives into one big storage of 11TB where it would ignore the max size of 5TB and just add the files in question into the 11TB pool?

I tried combine before but that just gives separate folders.
Would the union command be what I need to look for? Combined with eplfs?

Run the command 'rclone version' and share the full output of the command.

rclone v1.65.2
- os/version: Microsoft Windows 11 Pro 23H2 (64 bit)
- os/kernel: 10.0.22631.3227 (x86_64)
- os/type: windows
- os/arch: amd64
- go/version: go1.21.6
- go/linking: static
- go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)

OneDrive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

Not relevant

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

; empty config

A log from the command that you were trying to run with the -vv flag

Not relevant

This is what works the best for me:

[big-onedrive]
type = union
upstreams = onedrive1:data onedrive2:data onedrive3:data
action_policy = epall
create_policy = mfs
search_policy = ff

You might also wrap it in chunker overlay if you store really big files - it helps with data distribution across all union members.

Here all my setup:

[onedrive1]
type = onedrive

[onedrive2]
type = onedrive

[onedrive3]
type = onedrive

[big-onedrive]
type = union
upstreams = onedrive1:data onedrive2:data onedrive3:data
action_policy = epall
create_policy = mfs
search_policy = ff
cache_time = 60

[big-onedrive-enc]
type = crypt
remote = big-onedrive:
password = XXX
password2 = XXX
filename_encoding = base32768

[big-onedrive-enc-chunker]
type = chunker
remote = big-onedrive-enc:
chunk_size = 250Mi
hash_type = sha1all
name_format = *.rcc###

And always access your new BIG remote using big-onedrive-enc-chunker. All data is encrypted and I have SHA1 hashes available for all my files. For best experience create your onedrive remotes with personalised client_id/secret - here how.

1 Like

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.