.
What is the problem you are having with rclone?
rclone sync deletes files on destination even if the exact same files are existing at source. I transferred multiple terabytes of data from my remote to my local system.
Now I wanted to do another sync to get the changes which have been made since the last sync. But for some reason all files are going to be deleted from the destination. The Log is just an excerpt because it goes on like this forever, as it tries to delete every file on destination.
Run the command 'rclone version' and share the full output of the command.
- os/version: ubuntu 22.04 (64 bit)
- os/kernel: 5.15.0-107-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.22.1
- go/linking: static
- go/tags: none
Which cloud storage system are you using? (eg Google Drive)
Dropbox
The command you were trying to run (eg rclone copy /tmp remote:tmp)
rclone sync db-movies-crypt:Media /mnt/local/Media --checkers 16 --dropbox-chunk-size 128M --retries 1 --tpslimit 10 --tpslimit-burst 12 --stats 60s --transfers 50 --user-agent "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.131 Safari/537.36" -v --dry-run --delete-during
Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.
[migrate-movies-crypt]
type = crypt
remote = migrate_movies:Apps/MOV
password = XXX
password2 = XXX
[migrate-tv-crypt]
type = crypt
remote = migrate_tv:Apps/Serie
password = XXX
password2 = XXX
[migrate_movies]
type = dropbox
client_id = XXX
client_secret = XXX
token = XXX
[migrate_tv]
type = dropbox
client_id = XXX
client_secret = XXX
token = XXX
A log from the command that you were trying to run with the -vv flag
rclone sync db-movies-crypt:Media /mnt/local/Media --checkers 16 --dropbox-chunk-size 128M --retries 1 --tpslimit 10 --tpslimit-burst 12 --stats 60s --transfers 50 --user-agent "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.131 Safari/537.36" -vv --dry-run --delete-during
2024/06/05 19:05:17 INFO : Starting transaction limiter: max 10 transactions/s with burst 12
2024/06/05 19:05:17 DEBUG : rclone: Version "v1.66.0" starting with parameters ["rclone" "sync" "db-movies-crypt:Media" "/mnt/local/Media" "--checkers" "16" "--dropbox-chunk-size" "128M" "--retries" "1" "--tpslimit" "10" "--tpslimit-burst" "12" "--stats" "60s" "--transfers" "50" "--user-agent" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.131 Safari/537.36" "-vv" "--dry-run" "--delete-during"]
2024/06/05 19:05:17 DEBUG : Creating backend with remote "db-movies-crypt:Media"
2024/06/05 19:05:17 DEBUG : Using config file from "/home/sbuser/.config/rclone/rclone.conf"
2024/06/05 19:05:17 DEBUG : Creating backend with remote "db-movies:uj4cklee8u0o8j4bqjfeug2eqs"
2024/06/05 19:05:17 DEBUG : db-movies: detected overridden config - adding "{OgfZc}" suffix to name
2024/06/05 19:05:18 DEBUG : fs cache: renaming cache item "db-movies:uj4cklee8u0o8j4bqjfeug2eqs" to be canonical "db-movies{OgfZc}:uj4cklee8u0o8j4bqjfeug2eqs"
2024/06/05 19:05:18 DEBUG : fs cache: switching user supplied name "db-movies:uj4cklee8u0o8j4bqjfeug2eqs" for canonical name "db-movies{OgfZc}:uj4cklee8u0o8j4bqjfeug2eqs"
2024/06/05 19:05:18 DEBUG : Creating backend with remote "/mnt/local/Media"
2024/06/05 19:05:18 DEBUG : Waiting for deletions to finish
2024/06/05 19:05:18 NOTICE: Movies: Skipped set directory modification time as --dry-run is set (size 4Ki)
2024/06/05 19:05:18 DEBUG : Added delayed dir = "", newDst=<nil>
2024/06/05 19:05:18 ERROR : lost+found: failed to open directory "lost+found": open /mnt/local/Media/lost+found: permission denied
2024/06/05 19:05:18 NOTICE: TV/tv_mount.bin: Skipped delete as --dry-run is set (size 0)
2024/06/05 19:05:18 NOTICE: TV/TV4K/Barry/Season 2/Barry (2018) - S02E05 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][x265]-TSCC.mkv: Skipped delete as --dry-run is set (size 5.062Gi)
2024/06/05 19:05:18 NOTICE: TV/TV4K/American Horror Stories/Season 1/American Horror Stories (2021) - S01E01 - RubberwoMan 1 [WEBDL-2160p][AC3 5.1][DE+EN][h265]-FRAGGERS.mkv: Skipped delete as --dry-run is set (size 4.934Gi)
2024/06/05 19:05:18 NOTICE: TV/TV4K/Barry/Season 2/Barry (2018) - S02E02 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][x265]-TSCC.mkv: Skipped delete as --dry-run is set (size 4.671Gi)
2024/06/05 19:05:18 NOTICE: TV/TV4K/Barry/Season 4/Barry (2018) - S04E07 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][x265]-TSCC.mkv: Skipped delete as --dry-run is set (size 4.561Gi)
2024/06/05 19:05:18 NOTICE: TV/TV4K/American Horror Stories/Season 1/American Horror Stories (2021) - S01E03 - Drive In [WEBDL-2160p][AC3 5.1][DE+EN][h265]-FRAGGERS.mkv: Skipped delete as --dry-run is set (size 4.061Gi)
2024/06/05 19:05:18 NOTICE: TV/TV4K/Barry/Season 4/Barry (2018) - S04E05 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][x265]-TSCC.mkv: Skipped delete as --dry-run is set (size 5.120Gi)
2024/06/05 19:05:18 NOTICE: TV/TV4K/Barry/Season 4/Barry (2018) - S04E08 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][x265]-TSCC.mkv: Skipped delete as --dry-run is set (size 5.200Gi)
2024/06/05 19:05:18 NOTICE: TV/TV4K/Barry/Season 2/Barry (2018) - S02E08 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][x265]-TSCC.mkv: Skipped delete as --dry-run is set (size 5.498Gi)
2024/06/05 19:05:18 NOTICE: TV/TV4K/Barry/Season 4/Barry (2018) - S04E04 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][x265]-TSCC.mkv: Skipped delete as --dry-run is set (size 5.169Gi)
2024/06/05 19:05:18 NOTICE: TV/TV4K/Barry/Season 2/Barry (2018) - S02E04 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][x265]-TSCC.mkv: Skipped delete as --dry-run is set (size 4.791Gi)
2024/06/05 19:05:18 NOTICE: TV/TV4K/American Horror Stories/Season 1/American Horror Stories (2021) - S01E02 - RubberwoMan 2 [WEBDL-2160p][AC3 5.1][DE+EN][h265]-FRAGGERS.mkv: Skipped delete as --dry-run is set (size 4.094Gi)
2024/06/05 19:05:18 NOTICE: TV/TV4K/Black Mirror/Season 3/Black Mirror (2011) - S03E02 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][h265]-FX.mkv: Skipped delete as --dry-run is set (size 6.752Gi)
2024/06/05 19:05:18 NOTICE: TV/TV4K/American Horror Stories/Season 1/American Horror Stories (2021) - S01E04 - The Naughty List [WEBDL-2160p][AC3 5.1][DE+EN][h265]-FRAGGERS.mkv: Skipped delete as --dry-run is set (size 3.925Gi)
2024/06/05 19:05:18 NOTICE: TV/TV4K/Black Mirror/Season 3/Black Mirror (2011) - S03E05 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][h265]-FX.mkv: Skipped delete as --dry-run is set (size 6.408Gi)
2024/06/05 19:05:18 NOTICE: TV/TV4K/Barry/Season 4/Barry (2018) - S04E06 - [WEBDL-2160p][DV HDR10][AC3 5.1][DE+EN][x265]-TSCC.mkv: Skipped delete as --dry-run is set (size 4.594Gi)
2024/06/05 19:05:18 NOTICE: TV/TV4K/Black Mirror/Season 3/Black Mirror (2011) - S03E03 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][h265]-FX.mkv: Skipped delete as --dry-run is set (size 6.187Gi)
2024/06/05 19:05:18 NOTICE: TV/TV4K/Barry/Season 4/Barry (2018) - S04E01 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][x265]-TSCC.mkv: Skipped delete as --dry-run is set (size 3.987Gi)
2024/06/05 19:05:18 NOTICE: TV/TV4K/Barry/Season 3/Barry (2018) - S03E04 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][x265]-TSCC.mkv: Skipped delete as --dry-run is set (size 4.806Gi)
2024/06/05 19:05:18 NOTICE: TV/TV4K/Barry/Season 3/Barry (2018) - S03E05 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][x265]-TSCC.mkv: Skipped delete as --dry-run is set (size 4.375Gi)
2024/06/05 19:05:18 NOTICE: TV/TV4K/American Horror Stories/Season 1/American Horror Stories (2021) - S01E06 - Feral [WEBDL-2160p][AC3 5.1][DE+EN][h265]-FRAGGERS.mkv: Skipped delete as --dry-run is set (size 3.496Gi)
Example:
This is "Barry" on the remote:
-rwxrwxr-x 1 sbuser sbuser 5015294129 Jul 29 2023 'Barry (2018) - S02E02 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][x265]-TSCC.mkv'*
-rwxrwxr-x 1 sbuser sbuser 4646844745 Jul 29 2023 'Barry (2018) - S02E03 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][x265]-TSCC.mkv'*
-rwxrwxr-x 1 sbuser sbuser 5144559399 Jul 29 2023 'Barry (2018) - S02E04 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][x265]-TSCC.mkv'*
-rwxrwxr-x 1 sbuser sbuser 5435157717 Jul 29 2023 'Barry (2018) - S02E05 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][x265]-TSCC.mkv'*
-rwxrwxr-x 1 sbuser sbuser 4834701316 Jul 29 2023 'Barry (2018) - S02E06 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][x265]-TSCC.mkv'*
-rwxrwxr-x 1 sbuser sbuser 4768523730 Jul 29 2023 'Barry (2018) - S02E07 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][x265]-TSCC.mkv'*
-rwxrwxr-x 1 sbuser sbuser 5903836574 Jul 29 2023 'Barry (2018) - S02E08 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][x265]-TSCC.mkv'*
and this is "Barry" local:
-rw-rw-r-- 1 sbuser sbuser 5510115162 Jul 29 2023 'Barry (2018) - S02E01 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][x265]-TSCC.mkv'
-rw-rw-r-- 1 sbuser sbuser 5015294129 Jul 29 2023 'Barry (2018) - S02E02 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][x265]-TSCC.mkv'
-rw-rw-r-- 1 sbuser sbuser 4646844745 Jul 29 2023 'Barry (2018) - S02E03 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][x265]-TSCC.mkv'
-rw-rw-r-- 1 sbuser sbuser 5144559399 Jul 29 2023 'Barry (2018) - S02E04 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][x265]-TSCC.mkv'
-rw-rw-r-- 1 sbuser sbuser 5435157717 Jul 29 2023 'Barry (2018) - S02E05 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][x265]-TSCC.mkv'
-rw-rw-r-- 1 sbuser sbuser 4834701316 Jul 29 2023 'Barry (2018) - S02E06 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][x265]-TSCC.mkv'
-rw-rw-r-- 1 sbuser sbuser 4768523730 Jul 29 2023 'Barry (2018) - S02E07 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][x265]-TSCC.mkv'
-rw-rw-r-- 1 sbuser sbuser 5903836574 Jul 29 2023 'Barry (2018) - S02E08 - [WEBDL-2160p][DV HDR10][EAC3 5.1][DE+EN][x265]-TSCC.mkv'
The same Files and yet rclone wants to delete the destination files .