What is the problem you are having with rclone?
I tried to use rclone to transfer all of the files from a legacy backblaze b2 bucket to a new one that supports the S3 gateway. The backblaze web UI shows that there currently 626467 files in my bucket.
I initially ran the command rclone copy --progress b2:nerdsinspace-matrix-media-repo-prod b2:nerdsinspace-matrix-media-repo
which only copied 542581 files. After doing a bit of research, I found out that additional files may be in my bucket in the form of "previous versions" and learned of the --b2-versions
option.
I didn't want to spend another 4 days copying files so I ran a quick dry run test using the command rclone copy --dry-run --b2-versions --progress b2:nerdsinspace-matrix-media-repo-prod b2:nerdsinspace-matrix-media-repo
which then only reported that 583882 files would have been copied.
What can explain the discrepancy between the 583882 files rclone reports (including versions) and the 626467 files the backblaze web UI reports?
What is your rclone version (output from rclone version
)
I am using the debian package
rclone --version
rclone v1.45
- os/arch: linux/amd64
- go version: go1.11.6
Which OS you are using and how many bits (eg Windows 7, 64 bit)
No LSB modules are available.
Distributor ID: Debian
Description: Debian GNU/Linux 10 (buster)
Release: 10
Codename: buster
Which cloud storage system are you using? (eg Google Drive)
BackBlaze B2
The command you were trying to run (eg rclone copy /tmp remote:tmp
)
rclone copy --dry-run --b2-versions --progress b2:nerdsinspace-matrix-media-repo-prod b2:nerdsinspace-matrix-media-repo
The rclone config contents with secrets removed.
No special config except for my b2 login information