What is the problem you are having with rclone?
I have two different (empty) shared drives in google drive which I want to merge together and copy files over them.
I'd like to make the load as equal as possible, so I choose the eplno create policy (i left the default epall for action and ff for search). For experimenting, I also tried the erand policy , but the result is the same.
To my understanding of things, eplno (or eprand) should choose ONE of the two remotes and rclone should copy a file into only ONE of the remotes.
rclone instead is copying the files into BOTH folders, which is effectively the same as the epall policy.
Is it me not getting how union works? Or is there a bug?
Run the command 'rclone version' and share the full output of the command.
rclone v1.59.0-beta.6340.62bcc84f6
- os/version: Microsoft Windows 11 Enterprise 22H2 (64 bit)
- os/kernel: 10.0.25151.1010 (x86_64)
- os/type: windows
- os/arch: amd64
- go/version: go1.18.3
- go/linking: static
- go/tags: cmount
I used 1.59.0 beta because of this issue.
Which cloud storage system are you using? (eg Google Drive)
Two Team Drives merged with union, trying to copy a local folder
The command you were trying to run (eg rclone copy /tmp remote:tmp)
rclone copy .\Test_Folder\ gunion:\Test1951 -vvvvv -P
The rclone config contents with secrets removed.
[gone]
type = drive
client_id = redacted
client_secret = redacted
scope = drive
auth_owner_only = false
use_trash = true
skip_gdocs = true
skip_checksum_gphotos = true
upload_cutoff = 128Mi
chunk_size = 64Mi
acknowledge_abuse = true
server_side_across_configs = true
stop_on_upload_limit = true
stop_on_download_limit = true
token =redacted
team_drive = redacted
[gtwo]
type = drive
client_id = redacted
client_secret = redacted
scope = drive
auth_owner_only = false
use_trash = true
skip_gdocs = true
skip_checksum_gphotos = true
upload_cutoff = 128Mi
chunk_size = 64Mi
acknowledge_abuse = true
server_side_across_configs = true
stop_on_upload_limit = true
stop_on_download_limit = true
token = redacted
team_drive = redacted2
root_folder_id =
[gunion]
type = union
upstreams = gone: gtwo:
create_policy = eprand
search_policy = epff
cache_time = 50
#tried both with and without action_policy
action_policy = eprand
A log from the command with the -vv flag
2022/07/08 19:51:26 DEBUG : rclone: Version "v1.59.0-beta.6340.62bcc84f6" starting with parameters ["c:\\windows\\system32\\rclone.exe" "copy" ".\\Test_Folder\\" "gunion:\\Test1951" "-vvvvv" "-P"]
2022/07/08 19:51:26 DEBUG : Creating backend with remote ".\\Test_Folder\\"
2022/07/08 19:51:26 DEBUG : Using config file from "C:\\Users\\Davide\\.config\\rclone\\rclone.conf"
2022/07/08 19:51:26 DEBUG : fs cache: renaming cache item ".\\Test_Folder\\" to be canonical "//?/D:/Downloads/Test_Folder"
2022/07/08 19:51:26 DEBUG : Creating backend with remote "gunion:\\Test1951"
2022/07/08 19:51:26 DEBUG : Creating backend with remote "gtwo:"
2022/07/08 19:51:26 DEBUG : Creating backend with remote "gone:"
2022/07/08 19:51:26 DEBUG : Creating backend with remote "gtwo:/Test1951"
2022/07/08 19:51:26 DEBUG : Creating backend with remote "gone:/Test1951"
2022/07/08 19:51:26 DEBUG : fs cache: renaming cache item "gtwo:/Test1951" to be canonical "gtwo:Test1951"
2022/07/08 19:51:26 DEBUG : fs cache: renaming cache item "gone:/Test1951" to be canonical "gone:Test1951"
2022/07/08 19:51:26 DEBUG : union root '/Test1951': actionPolicy = *policy.EpRand, createPolicy = *policy.EpRand, searchPolicy = *policy.EpFF
2022/07/08 19:51:26 DEBUG : fs cache: renaming cache item "gunion:\\Test1951" to be canonical "gunion:/Test1951"
2022-07-08 19:51:27 DEBUG : union root '/Test1951': Waiting for checks to finish
2022-07-08 19:51:27 DEBUG : union root '/Test1951': Waiting for transfers to finish
2022-07-08 19:51:28 DEBUG : Google drive root '': read info from Shared Drive "sd_02"
2022-07-08 19:51:28 DEBUG : Google drive root '': read info from Shared Drive "sd_02"
2022-07-08 19:51:28 DEBUG : Google drive root '': read info from Shared Drive "sd_01"
2022-07-08 19:51:29 DEBUG : Google drive root '': read info from Shared Drive "sd_01"
2022-07-08 19:51:36 DEBUG : file_b.txt: md5 = 918c6f47a5f309df1469397a0b656525 OK
2022-07-08 19:51:36 INFO : file_b.txt: Copied (new)
2022-07-08 19:51:36 DEBUG : file_a.txt: md5 = 5e74bf3011d7eed034250d4bc8f7c27d OK
2022-07-08 19:51:36 INFO : file_a.txt: Copied (new)
Transferred: 12 B / 12 B, 100%, 1 B/s, ETA 0s
Transferred: 2 / 2, 100%
Elapsed time: 10.3s
2022/07/08 19:51:36 INFO :
Transferred: 12 B / 12 B, 100%, 1 B/s, ETA 0s
Transferred: 2 / 2, 100%
Elapsed time: 10.3s
2022/07/08 19:51:36 DEBUG : 19 go routines active
After this I expect to have either the files in gone: OR in gtwo: , but instead, I have them in both
PS D:\Downloads> rclone ls gunion:
6 Test1951/file_a.txt
6 Test1951/file_b.txt
PS D:\Downloads> rclone ls gone:
6 Test1951/file_b.txt
6 Test1951/file_a.txt
PS D:\Downloads> rclone ls gtwo:
6 Test1951/file_b.txt
6 Test1951/file_a.txt
edit: as a side note, i'm experiencing delays in google drive. The uploaded files will only appear many minutes after the upload. I don't know if it's my fault or if google has issues.
