Gdrive to sharepoint server side sync resulted in a much larger usage of sharepoint space

What is the problem you are having with rclone?

Gdrive to sharepoint server side sync resulted in a much larger usage of sharepoint space
I have around 27TB worth of encrypted files on Gdrive, and copying them to an encrypted union of 2 Sharepoint sites resulted in a larger use of storage space (around 32TB), and deduping them didn't seem to help

Run the command 'rclone version' and share the full output of the command.

rclone v1.62.2

  • os/version: Microsoft Windows 10 Pro 22H2 (64 bit)
  • os/kernel: 10.0.19045.3208 Build 19045.3208.3208 (x86_64)
  • os/type: windows
  • os/arch: amd64
  • go/version: go1.20.2
  • go/linking: static
  • go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)

GDrive, sharepoint

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone sync google: onedrive: -P -vv  --user-agent "ISV|rclone.org|rclone/v1.62.2" --tpslimit=10 --transfers 8 --union-min-free-space 1G --delete-during --drive-use-trash```


#### The rclone config contents with secrets removed.  

[onedrive1]
type = onedrive
client_id = redacted
client_secret = redacted
token = {"access_token":"redacted"}
drive_id = redacted
drive_type = redacted

[onedrive2]
type = onedrive
client_id = redacted
client_secret = redacted
token = {"access_token":"redacted"}
drive_id = redacted
drive_type = redacted

[onedrive]
type = crypt
remote = onedriveunion:sites
password = redacted
password2 = redacted
filename_encoding = base32768

[onedriveunion]
type = union
upstreams = onedrive1: onedrive2:
action_policy = epall
create_policy = mfs

[gcrypt]
type = drive
client_id = redacted
client_secret = redacted
scope = drive
token = {"access_token":"redacted"}
team_drive =

[google2]
type = crypt
remote = gcrypt:encryptedfiles
password = redacted
password2 = redacted```

A log from the command with the -vv flag

Paste  log here

could you provide some hard evidence? e.g.:

rclone size google2:path/to/sampleFolder
rclone size onedrive:path/to/sampleFolder

quick way to find if there are any folders with different size is to run:

rclone ncdu remote:

for each remote at the same time.

Other reason might be versioning

If you do not use versions run:

rclone cleanup remote onedrive1:
rclone cleanup remote onedrive2:
1 Like

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.