rclone copy whenever new files are downloaded on my seedbox. Using
watchexec, it runs once when the first new episode is downloaded, and then again once that's finished (which usually picks up the rest of the season).
The problem is that the first upload, with a single file, runs incredibly slowly (like 2-3MB/s). If it's trying to upload two files, I get roughly 6-10MB/s. And it appears somewhat linear up to ~30MB/s for lots of files (which feels like the Box limit).
bigmoney@10:~/src/infinity$ rclone version
- os/version: debian 10.13 (64 bit)
- os/kernel: 4.19.0-22-amd64 (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.20.6
- go/linking: static
- go/tags: none
Box Business (5GB file size limit)
rclone copy ~/Media box-crypt-chunked:/Media --ignore-existing --progress --checksum --transfers=100
[box] type = box token = ... [box-crypt] type = crypt remote = box:/rclone/mount-a password = ... password2 = ... filename_encoding = base32768 [box-crypt-chunked] type = chunker remote = box-crypt:/ chunk_size = 5000M name_format = *.rcc### hash_type = sha1all
Didn't capture it with -vv yet, but here's the normal output showing the issue:
With one file:
Transferred: 768.859 MiB / 9.853 GiB, 8%, 2.361 MiB/s, ETA 1h5m47s Checks: 56 / 56, 100% Transferred: 0 / 1, 0% Elapsed time: 3m54.3s Transferring: * TV/Foundation (2021)/S…asStudio-Scrambled.mkv: 7% /9.853Gi, 2.361Mi/s,
With two files:
Transferred: 12.572 GiB / 22.084 GiB, 57%, 8.113 MiB/s, ETA 20m Checks: 56 / 56, 100% Transferred: 0 / 2, 0% Elapsed time: 25m10.9s Transferring: * TV/Foundation (2021)/S….DV.HEVC-CasStudio.mkv: 67% /12.231Gi, 5.149Mi/s, 13m10s * TV/Foundation (2021)/S…asStudio-Scrambled.mkv: 43% /9.853Gi, 2.964Mi/s, 31m53s
I'll push a new version of my watch script that adds better logging tomorrow, unless the issue is immediately obvious to someone?