Destination size is way bigger than source's after sync

Help and Support
1

What is the problem you are having with rclone?

I formatted my backup drive (H:). Windows Properties folder tab says my source drive (E:) has a size of 1.60TB, but after syncing this data to H:, H: now has 2.25TB. Both are local NTFS drives, so there shouldnt be duplicate filenames.

Run the command 'rclone version' and share the full output of the command.

PS C:\Users\marco> rclone --version
rclone v1.60.0

  • os/version: Microsoft Windows 11 Pro N for Workstations 21H2 (64 bit)
  • os/kernel: 10.0.22000.1455 (x86_64)
  • os/type: windows
  • os/arch: amd64
  • go/version: go1.19.2
  • go/linking: static
  • go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone sync 'E:\' 'H:\' --progress --stats-one-line --drive-acknowledge-abuse --fast-list -v

The rclone config contents with secrets removed.

This shouldnt be the issue, because I dont use any of my remotes.

PS C:\Users\marco> rclone config show
[gdrive_ucm]
type = drive
client_id = ###.apps.googleusercontent.com
client_secret = ###
scope = drive
token = {"access_token":"###","expiry":"2022-11-03T11:56:37.8872112+01:00"}
team_drive =

[onedrive_uned]
type = onedrive
token = {"access_token":"###","expiry":"2022-11-03T12:04:50.048369+01:00"}
drive_id = ###
drive_type = business

[nextcloud_prod]
type = webdav
url = https://192.168.1.131/nextcloud/remote.php/dav/files/###/
vendor = nextcloud
user = ###
pass = ###

A log from the command with the -vv flag

Just a regular 1.6TB sync log. There wasn't anything weird with it. This is the -v log version. -vv is completely unreadable.

2023-02-10 10:31:02 ERROR : System Volume Information: failed to open directory "System Volume Information": open \\?\E:\System Volume Information: Access is denied.
2023-02-10 10:31:02 ERROR : System Volume Information: failed to open directory "System Volume Information": open \\?\H:\System Volume Information: Access is denied.
2023-02-10 10:31:02 INFO  : amazingfile.xlsx: Copied (new)
2023-02-10 10:31:02 INFO  : amazingfile2.xls: Copied (new)
2023-02-10 10:31:37 ERROR : Local file system at //?/H:/: not deleting files as there were IO errors
2023-02-10 10:31:37 ERROR : Local file system at //?/H:/: not deleting directories as there were IO errors
2023-02-10 10:31:37 ERROR : Attempt 1/3 failed with 3 errors and: not deleting files as there were IO errors
2023-02-10 10:31:37 ERROR : System Volume Information: failed to open directory "System Volume Information": open \\?\H:\System Volume Information: Access is denied.
2023-02-10 10:31:37 ERROR : System Volume Information: failed to open directory "System Volume Information": open \\?\E:\System Volume Information: Access is denied.
2023-02-10 10:31:43 ERROR : Local file system at //?/H:/: not deleting files as there were IO errors
2023-02-10 10:31:43 ERROR : Local file system at //?/H:/: not deleting directories as there were IO errors
2023-02-10 10:31:43 ERROR : Attempt 2/3 failed with 3 errors and: not deleting files as there were IO errors
2023-02-10 10:31:43 ERROR : System Volume Information: failed to open directory "System Volume Information": open \\?\H:\System Volume Information: Access is denied.
2023-02-10 10:31:43 ERROR : System Volume Information: failed to open directory "System Volume Information": open \\?\E:\System Volume Information: Access is denied.
2023-02-10 10:31:48 ERROR : Local file system at //?/H:/: not deleting files as there were IO errors
2023-02-10 10:31:48 ERROR : Local file system at //?/H:/: not deleting directories as there were IO errors
2023-02-10 10:31:48 ERROR : Attempt 3/3 failed with 3 errors and: not deleting files as there were IO errors
51.885 KiB / 51.885 KiB, 100%, 510 B/s, ETA 0s
2023/02/10 10:31:48 INFO  :    51.885 KiB / 51.885 KiB, 100%, 510 B/s, ETA 0s
2023/02/10 10:31:48 Failed to sync with 3 errors: last error was: not deleting files as there were IO errors
2

Try this - it will tell you the matching and non matching files

rclone check 'E:\' 'H:\' --progress --stats-one-line

And this which will give you rclone's view on how much space is used on each drive

rclone size 'E:\'
rclone size 'H:\'

Note that if the disk drives are very different sizes, the allocation sizes will be different so the same files may actually take more space.

3

i would run rclone sync again with --dry-run or rclone check
need to compare just the actual folders/files that were copied.

comparing the root of E: to root of H: is not a good comparison, as the windows os, takes up space.
for example vss snapshots.

the sync failed three times. need to exclude that folder
--exclude="/System Volume Information/"

4

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.