What is the problem you are having with rclone?
When I have a LARGE queue of files to be uploaded (few hundred) and rclone is restarted, the mount will take a very long time to upload. Apparently it is slowly enumerating all files to be uploaded and will mount once it finishes that list. Once all files are uploaded and the queue is clear things mount very quickly.
Is this normal behavior? Is there a way to let the rclone mount first and queue files asynchronously?
EDIT: I mean the mount will take a very long time to mount and be available to the system for read/write. Until the enumeration of files to be uploaded is done, the drive won't mount.
What is your rclone version (output from rclone version)
rclone v1.54.0
- os/arch: windows/amd64
- go version: go1.15.7
Which OS you are using and how many bits (eg Windows 7, 64 bit)
Windows 10, 64bit
Which cloud storage system are you using? (eg Google Drive)
Gdrive suite
The command you were trying to run (eg rclone copy /tmp remote:tmp)
mount --cache-dir=D:\rclonecache --dir-cache-time 1000h --poll-interval 15s --vfs-cache-max-age 24h --vfs-cache-max-size 30G --buffer-size 64M --vfs-read-ahead 128M --drive-chunk-size 128M --dir-cache-time 50h --log-level INFO --vfs-read-chunk-size 128M --vfs-read-chunk-size-limit off gdrive: P: --config "C:\Users\XXXX\.config\rclone\rclone.conf" --vfs-cache-mode=full --vfs-write-back 24h --bwlimit "08:00,30M 01:00,off"
The rclone config contents with secrets removed.
[gdrive]
type = drive
client_id = 709XXXX8-oeqe9g5srbij9ik7lfXXXXXs.googleusercontent.com
client_secret = 6wGXXXXXXL3QtS
scope = drive
token = {"access_token":"XXXXXX-XXXXX-XXXXXX","token_type":"Bearer","refresh_token":"XXXXXXXXXXXXXXXXX,"expiry":"2021-02-14T00:57:52.2718697+08:00"}
root_folder_id = 0XXXXXXXXXXXXXXX
A log from the command with the -vv flag
2021/02/14 00:52:40 INFO : Music/Ministry Of Sound - Collection 1994-2019 613 ALBUMS MP3 Part 1/2006 - Ministry of Sound - Clubland X-Treme Hardcore Vol. 3 [3CD]/CD2/05 - Breeze & Re-Con - Only If.mp3: vfs cache: queuing for upload in 24h0m0s
2021/02/14 00:52:40 INFO : Music/Ministry Of Sound - Collection 1994-2019 613 ALBUMS MP3 Part 1/2006 - Ministry of Sound - Clubland X-Treme Hardcore Vol. 3 [3CD]/CD2/06 - Cascada - Truly,Madly, Deeply (Styles & Breeze Remix).mp3: vfs cache: queuing for upload in 24h0m0s
2021/02/14 00:52:40 INFO : Music/Ministry Of Sound - Collection 1994-2019 613 ALBUMS MP3 Part 1/2006 - Ministry of Sound - Clubland X-Treme Hardcore Vol. 3 [3CD]/CD2/07 - Breeze & Euphony - Never Be Alone.mp3: vfs cache: queuing for upload in 24h0m0s
2021/02/14 00:52:41 INFO : Music/Ministry Of Sound - Collection 1994-2019 613 ALBUMS MP3 Part 1/2006 - Ministry of Sound - Clubland X-Treme Hardcore Vol. 3 [3CD]/CD2/08 - BodyRox - Yeah Yeah (Dougal & Gammer's The Beal's The Bass Remix).mp3: vfs cache: queuing for upload in 24h0m0s
2021/02/14 00:52:41 INFO : Music/Ministry Of Sound - Collection 1994-2019 613 ALBUMS MP3 Part 1/2006 - Ministry of Sound - Clubland X-Treme Hardcore Vol. 3 [3CD]/CD2/09 - - Ramos, Supreme & Sunset Regime.mp3: vfs cache: queuing for upload in 24h0m0s
2021/02/14 00:52:41 INFO : Music/Ministry Of Sound - Collection 1994-2019 613 ALBUMS MP3 Part 1/2006 - Ministry of Sound - Clubland X-Treme Hardcore Vol. 3 [3CD]/CD2/10 - Breese Vs Lost Witness - Rise Again).mp3: vfs cache: queuing for upload in 24h0m0s
2021/02/14 00:52:42 INFO : Music/Ministry Of Sound - Collection 1994-2019 613 ALBUMS MP3 Part 1/2006 - Ministry of Sound - Clubland X-Treme Hardcore Vol. 3 [3CD]/CD2/11 - SHM & Scottie B - Crash.mp3: vfs cache: queuing for upload in 24h0m0s
2021/02/14 00:52:42 INFO : Music/Ministry Of Sound - Collection 1994-2019 613 ALBUMS MP3 Part 1/2006 - Ministry of Sound - Clubland X-Treme Hardcore Vol. 3 [3CD]/CD2/12 - Breeze & UFO - Dirty.mp3: vfs cache: queuing for upload in 24h0m0s
2021/02/14 00:52:42 INFO : Music/Ministry Of Sound - Collection 1994-2019 613 ALBUMS MP3 Part 1/2006 - Ministry of Sound - Clubland X-Treme Hardcore Vol. 3 [3CD]/CD2/13 - SY & Unknown Feat. Lou Lou - Touch The Sky.mp3: vfs cache: queuing for upload in 24h0m0s
2021/02/14 00:52:43 INFO : Music/Ministry Of Sound - Collection 1994-2019 613 ALBUMS MP3 Part 1/2006 - Ministry of Sound - Clubland X-Treme Hardcore Vol. 3 [3CD]/CD2/14 - Breeze & Re-Con - Love You For A Lifetime.mp3: vfs cache: queuing for upload in 24h0m0s
2021/02/14 00:52:43 INFO : Music/Ministry Of Sound - Collection 1994-2019 613 ALBUMS MP3 Part 1/2006 - Ministry of Sound - Clubland X-Treme Hardcore Vol. 3 [3CD]/CD2/15 - Sublime - Walking In The Rain (Styles & Breeze Remix).mp3: vfs cache: queuing for upload in 24h0m0s
2021/02/14 00:52:43 INFO : Music/Ministry Of Sound - Collection 1994-2019 613 ALBUMS MP3 Part 1/2006 - Ministry of Sound - Clubland X-Treme Hardcore Vol. 3 [3CD]/CD2/16 - Styles & Breeze - Come On.mp3: vfs cache: queuing for upload in 24h0m0s
2021/02/14 00:52:44 INFO : Music/Ministry Of Sound - Collection 1994-2019 613 ALBUMS MP3 Part 1/2006 - Ministry of Sound - Clubland X-Treme Hardcore Vol. 3 [3CD]/CD2/17 - Re-Con & Squad-E - Good To Me.mp3: vfs cache: queuing for upload in 24h0m0s
This goes on for a long time until all files are listed.