What is the problem you are having with rclone?
I have a vfs cache mount (mode=full) that is accepting files but no longer seems to be uploading them to box. I am seeing these messages in the log
2021/06/11 06:31:58 INFO : vfs cache: cleaned: objects 8652 (was 8652) in use 8652, to upload 8730, uploading 16, total size 355.182G (was 355.182G)
2021/06/11 06:32:58 INFO : vfs cache: cleaned: objects 8652 (was 8652) in use 8652, to upload 8730, uploading 16, total size 355.182G (was 355.182G)
2021/06/11 06:33:58 INFO : vfs cache: cleaned: objects 8652 (was 8652) in use 8652, to upload 8730, uploading 16, total size 355.182G (was 355.182G)
2021/06/11 06:34:58 INFO : vfs cache: cleaned: objects 8652 (was 8652) in use 8652, to upload 8730, uploading 16, total size 355.182G (was 355.182G)
2021/06/11 06:35:58 INFO : vfs cache: cleaned: objects 8652 (was 8652) in use 8652, to upload 8730, uploading 16, total size 355.182G (was 355.182G)
Note that the the number of objects to upload didn't change over 5 minutes.
I increased the debugging level to LogLevel 7 but I see nothing that helps other than the cache not removing files
2021/06/11 06:38:58 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item nightly/504L02/TEST2.CommEngine_504L02_Custbuild/2021/202106-June/202106-June-10/bcm96855GWO_SPDSVC_TR069TR143_USBNET_OVS_emmc_squashfs_loader_update.pkgtb.gz not removed, freed 0 bytes
2021/06/11 06:38:58 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item nightly/504L02/TEST2.CommEngine_504L02_Custbuild/2021/202106-June/202106-June-10/bcm96856O_PROV_uboot_rootfs_256.ubifs not removed, freed 0 bytes
2021/06/11 06:38:58 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item nightly/504L02/TEST.CommEngine_504L02_Consbuild/2021/202106-June/202106-June-10/bcm96878GWO_DPI_JUMBO_MAP_PURE181_uboot_rootfs_nonubifs not removed, freed 0 bytes
2021/06/11 06:38:58 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item nightly/504L02/TEST2.CommEngine_504L02_Custbuild/2021/202106-June/202106-June-11/bcm96858O_DPOE_TOD_SPDSVC_TR069TR143_linux_raw_image_256.bin not removed, freed 0 bytes
2021/06/11 06:38:58 INFO : vfs cache: cleaned: objects 8655 (was 8655) in use 8655, to upload 8733, uploading 16, total size 355.182G (was 355.182G)
I tried stopping and starting the mount. When I do so, it does not actually mount from BOX.
I have to remove the cache in order to get it to mount correctly.
If I cd into the mount point, I see
df -h .
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/centos_auto-auto 14T 394G 13T 3% /auto
which is the local filesystem
It should report the following:
Filesystem Size Used Avail Use% Mounted on
Box_BCACPE_VFS_Mount:test_nightly 9.8P 3.1T 9.8P 1% /auto/bcacpebuilder/bca_daemon_vfs/mount
The log shows that it is now uploading files but the mount point is not pointing at box
2021/06/11 06:50:59 INFO : nightly/504L02/TEST.CommEngine_504L02_Consbuild/2021/202106-June/202106-June-10/bcm955153DPU_uboot_bootstrap_image_emmc_boot_part.bin: vfs cache: upload succeeded try #1
2021/06/11 06:51:03 INFO : nightly/504L02/TEST.CommEngine_504L02_Consbuild/2021/202106-June/202106-June-10/bcm955153DPU_uboot_linux.itb: vfs cache: queuing for upload in 5s
2021/06/11 06:51:04 INFO : nightly/504L02/TEST.CommEngine_504L02_Consbuild/2021/202106-June/202106-June-10/bcm955153DPU_uboot_bootstrap_image_emmc_userdata_part.bin: Copied (replaced existing)
2021/06/11 06:51:04 INFO : nightly/504L02/TEST.CommEngine_504L02_Consbuild/2021/202106-June/202106-June-10/bcm955153DPU_uboot_bootstrap_image_emmc_userdata_part.bin: vfs cache: upload succeeded try #1
I have moved the cache aside and restarted and now the mount point is correct but my cache files aren't uploaded.
What is your rclone version (output from rclone version)
../rclone/rclone --version
rclone v1.55.0
- os/type: linux
- os/arch: amd64
- go/version: go1.16.2
- go/linking: static
- go/tags: cmount
Which OS you are using and how many bits (eg Windows 7, 64 bit)
CentOS 7.6.1810, x86_64
uname -a
Linux 3.10.0-1062.1.1.el7.x86_64 #1 SMP Fri Sep 13 22:55:44 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Which cloud storage system are you using? (eg Google Drive)
Box
The command you were trying to run (eg rclone copy /tmp remote:tmp)
/auto/bcacpebuilder/rclone/rclone mount \
--allow-other \
--buffer-size=128M \
--cache-dir=/auto/bcacpebuilder/bca_daemon_vfs/cache \
--config=/auto/bcacpebuilder/rclone/rclone.conf \
--dir-cache-time=5m0s \
--fast-list \
--log-file=/auto/bcacpebuilder/bca_daemon_vfs/bca_daemon_vfs.log \
--low-level-retries=1 \
--max-read-ahead=128k \
--rc \
--rc-addr=127.0.0.1:5582 \
--transfers=16 \
--vfs-cache-mode=full \
--vfs-read-chunk-size=128M \
--vfs-read-chunk-size-limit=2G \
-v \
Box_BCACPE_VFS_Mount:test_nightly \
/auto/bcacpebuilder/bca_daemon_vfs/mount
The rclone config contents with secrets removed.
type = box
token =
A log from the command with the -vv flag
Duplicating log entries from above
2021/06/11 06:31:58 INFO : vfs cache: cleaned: objects 8652 (was 8652) in use 8652, to upload 8730, uploading 16, total size 355.182G (was 355.182G)
2021/06/11 06:32:58 INFO : vfs cache: cleaned: objects 8652 (was 8652) in use 8652, to upload 8730, uploading 16, total size 355.182G (was 355.182G)
2021/06/11 06:33:58 INFO : vfs cache: cleaned: objects 8652 (was 8652) in use 8652, to upload 8730, uploading 16, total size 355.182G (was 355.182G)
2021/06/11 06:34:58 INFO : vfs cache: cleaned: objects 8652 (was 8652) in use 8652, to upload 8730, uploading 16, total size 355.182G (was 355.182G)
2021/06/11 06:35:58 INFO : vfs cache: cleaned: objects 8652 (was 8652) in use 8652, to upload 8730, uploading 16, total size 355.182G (was 355.182G)
[...]
2021/06/11 06:38:58 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item nightly/504L02/TEST2.CommEngine_504L02_Custbuild/2021/202106-June/202106-June-10/bcm96855GWO_SPDSVC_TR069TR143_USBNET_OVS_emmc_squashfs_loader_update.pkgtb.gz not removed, freed 0 bytes
2021/06/11 06:38:58 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item nightly/504L02/TEST2.CommEngine_504L02_Custbuild/2021/202106-June/202106-June-10/bcm96856O_PROV_uboot_rootfs_256.ubifs not removed, freed 0 bytes
2021/06/11 06:38:58 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item nightly/504L02/TEST.CommEngine_504L02_Consbuild/2021/202106-June/202106-June-10/bcm96878GWO_DPI_JUMBO_MAP_PURE181_uboot_rootfs_nonubifs not removed, freed 0 bytes
2021/06/11 06:38:58 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item nightly/504L02/TEST2.CommEngine_504L02_Custbuild/2021/202106-June/202106-June-11/bcm96858O_DPOE_TOD_SPDSVC_TR069TR143_linux_raw_image_256.bin not removed, freed 0 bytes
2021/06/11 06:38:58 INFO : vfs cache: cleaned: objects 8655 (was 8655) in use 8655, to upload 8733, uploading 16, total size 355.182G (was 355.182G)