Hi Guys
After a long time, im a happy user of rclone and using since years, recently i feel some files are missing to upload on dropbox, so want to ask to gurus what is the best option to move a folder that have a lot of ts files from local drive to dropbox?
Currently im using "mv" cmd to move files from my local drive to mounted dropbox path, maybe there is any other option that move folder/files with rclone cmd,
Thanks and will be really appreciated any help
hi,
could use rclone move
to move files from local to dropbox, without using rclone mount
something like this, which does not use a cache. direct from local to dropbox
rclone move /path/to/local dropbox:
tho if that rclone mount
is working, might just tweak the command.
when you posted, there was a template of questions that helps us to better help you?
Thanks this is working fine, now just want to improve my cmd line what im using below
rclone move /local/path Dropbox: --delete-empty-src-dirs --tpslimit 12 --tpslimit-burst 12 --transfers 32 --log-file /www/wwwroot/rclone.log --dropbox-batch-mode async &
any recommendation to improve performance and stability ?
can i use below cmd with my main cmd to make better performance?
--dropbox-batch-mode async --dropbox-batch-size 1000 --dropbox-batch-timeout 10s --checkers 32 --checksum
Thanks a lot
cannot say for sure, tho i tend to use as few flags as possible, use as many defaults as possible
i would so establish a baseline speed test with the simplest command possible.
at some point, tweaking for minor gains of performance comes at the cost of reliability
for example, why use --dropbox-batch-mode async
"rclone can't check the file got uploaded properly using this mode."
so for me, would never use that flag.
so i should have to change it with
is that right?
thanks for your quick reply
i would remove that flag as the default value is sync
"This mode ensures full data integrity."
tho i would use --tpslimit 12 --tpslimit-burst 12
as that is the recommend values for dropbox.
what about these flags?
Thanks again
what is the total size of data to be moved?
how many files are to be moved?
i would
--- remove all those flags.
--- and based on rclone docs,
add --transfers=32
or --transfers=64
there is lot of small ts files, 500 to 2000 normally depend on video size, and every file size is less the 1mb,
ok, at this point, think there is enough info for you to run your command.
tho make sure to test using --dry-run
rclone move /path Dropbox: --delete-empty-src-dirs --tpslimit 12 --tpslimit-burst 12 --transfers 64 --log-file /www/wwwroot/rclone.log
im having issue with this cmd
2022/11/05 23:41:59 NOTICE: too_many_requests/...: Too many requests or write operations. Trying again in 300 seconds.
2022/11/05 23:42:12 NOTICE: too_many_requests/...: Too many requests or write operations. Trying again in 300 seconds.
2022/11/05 23:42:12 NOTICE: too_many_requests/: Too many requests or write operations. Trying again in 300 seconds.
2022/11/05 23:42:12 NOTICE: too_many_requests/: Too many requests or write operations. Trying again in 300 seconds.
2022/11/05 23:42:12 NOTICE: too_many_requests/...: Too many requests or write operations. Trying again in 300 seconds.
2022/11/05 23:42:12 NOTICE: too_many_requests/..: Too many requests or write operations. Trying again in 300 seconds.
2022/11/05 23:42:13 NOTICE: too_many_requests/...: Too many requests or write operations. Trying again in 300 seconds.
2022/11/05 23:42:13 NOTICE: too_many_requests/...: Too many requests or write operations. Trying again in 300 seconds.
2022/11/05 23:42:13 NOTICE: too_many_requests/..: Too many requests or write operations. Trying again in 300 seconds.
2022/11/05 23:42:13 NOTICE: too_many_requests/..: Too many requests or write operations. Trying again in 300 seconds.
2022/11/05 23:42:13 NOTICE: too_many_requests/...: Too many requests or write operations. Trying again in 300 seconds.
2022/11/05 23:42:13 NOTICE: too_many_requests/..: Too many requests or write operations. Trying again in 300 seconds.
2022/11/05 23:42:13 NOTICE: too_many_requests/: Too many requests or write operations. Trying again in 300 seconds.
2022/11/05 23:42:13 NOTICE: too_many_requests/: Too many requests or write operations. Trying again in 300 seconds.
2022/11/05 23:42:22 NOTICE: too_many_requests/...: Too many requests or write operations. Trying again in 300 seconds.
what im doing wrong ?
Thanks
im not getting tis point can you explain me a bit more plz.
Thanks
reduce the value of --transfers
and post the redacted output of rclone config show Dropbox:
i forget how to see config file, sorry
should i use rclone config
?
run the command rclone config show Dropbox:
type = dropbox
client_id =
client_secret =
token = {"access_token":"sl.BSijgj6E7-7YQTbxO-4yDXwPF1XFZQiHEVCMvR0mPZheK_ngUd5Oqa0A_0Tx8USD4HRMJ-nDsCRWRAB9-i5DPPldtsolokUE3i-MTzfNQFKpsvvKNgUBEjzPsNJUEY1DdYUCqNY","token_type":"bearer","refresh_token":"z0pwy2btTWMAAAAAAAAAAXUVjynUlZIH4ucCNy07iJFTKcNMj9Iz3u59cO7QlJpU","expiry":"2022-11-06T03:20:22.982287734+01:00"}
root@Debian-1101-bullseye-amd64-base ~ #
app details are removed
for client_id
was there a value that you redacted?
or
not using client_id
client id and client secret key i removed for security reason, do you want me to show them ?
no need to show them
just wanted to confirm that you are using client_id
so what is your suggestions?
i change transfer with 32
anything else that can help a lot of small videos?
Thanks