Rclone rc interrupt upload on mount

Help and Support
1

What is the problem you are having with rclone?

VFS cache uploads slowly until mount is restarted.

If I restart the mount, I get normal speeds. Is there a way to use rclone rc to stop (and restart) the transfer, without restarting the mount?

This is the console output (mostly of bash aliases) that is somewhat relevant.

agneev@server:~ $ vtr
8312 packets sampled in 5 seconds
Traffic average for eth0

      rx         9.17 Mbit/s           965 packets/s
      tx         3.53 Mbit/s           697 packets/s

agneev@server:~ $ sssto drive
agneev@server:~ $ sssta drive
agneev@server:~ $ sss drive
● drive.service - rclone-drive daemon
   Loaded: loaded (/etc/systemd/system/drive.service; disabled; vendor preset: e
   Active: active (running) since Sat 2020-11-07 16:51:11 IST; 40s ago
  Process: 4453 ExecStartPost=/usr/bin/rclone rc vfs/refresh recursive=true --rc
 Main PID: 4296 (rclone)
    Tasks: 11 (limit: 4915)
   CGroup: /system.slice/drive.service
           └─4296 /usr/bin/rclone mount --umask 002 --allow-other --buffer-size 

Nov 07 16:50:27 server systemd[1]: Starting rclone-drive daemon...
Nov 07 16:51:11 server rclone[4453]: {
Nov 07 16:51:11 server rclone[4453]:         "result": {
Nov 07 16:51:11 server rclone[4453]:                 "": "OK"
Nov 07 16:51:11 server rclone[4453]:         }
Nov 07 16:51:11 server rclone[4453]: }
Nov 07 16:51:11 server systemd[1]: Started rclone-drive daemon.
agneev@server:~ $ vtr
63122 packets sampled in 5 seconds
Traffic average for eth0

      rx        11.33 Mbit/s          3751 packets/s
      tx        97.09 Mbit/s          8873 packets/s

What is your rclone version (output from rclone version)

rclone v1.53.2
- os/arch: linux/arm
- go version: go1.15.3

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Raspberry Pi OS - Debian Buster

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

N/A

The rclone config contents with secrets removed.

ExecStart=/usr/bin/rclone mount \
        --umask 002 --allow-other \
        --buffer-size 256M \
        --transfers=2 \
        --drive-chunk-size 32M \
        --dir-cache-time 1000h \
        --poll-interval 15s \
        --vfs-cache-mode writes \
        --vfs-cache-max-age 168h \
        --vfs-cache-max-size 20G \
        --cache-dir /mnt/pool/Seagate4T/.rclone \
        -v --stats=30s --stats-one-line \
        --log-file /home/agneev/logs/drive.log \
        --rc --rc-addr 127.0.0.1:5800 --rc-no-auth \
        drive: /drive

A log from the command with the -vv flag

N/A

2

Why do you think that is? Are there other transfers going on? Or did one transfer get stuck?

Do you mean a transfer initiated by the mount? Not at the moment, but there could be.

3

Not entirely sure why, but I can guess it could some sort of issue when the upload is initiated. No other transfers going on.

Yes, when I copy files to the mount, per my config.

4

I would have hoped the transfer would time out eventually then rclone would retry it.

However a remote control to cancel uploads via the rc that are in progress with the vfs would be possible. I guess you'd want to be able to

  • list in progress or pending uploads
  • cancel and retry a pending upload
  • cancel and don't retry a pending upload

Anything else?

5

Maybe cancel and retry all pending uploads?

6

Good idea.

Do you fancy writing that up in a new issue on github ?

7

Sure, thanks :slight_smile:

8

using rclone rc core/stats, I was able to get the following info:

{
	"bytes": 20380574948,
	"checks": 0,
	"deletes": 0,
	"elapsedTime": 24931.748317763,
	"errors": 1,
	"fatalError": false,
	"lastError": "Post \"https://www.googleapis.com/upload/drive/v3/files?alt=json\u0026fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks\u0026supportsAllDrives=true\u0026uploadType=resumable\u0026upload_id=<REDACTED>\": can't copy - source file is being updated (mod time changed from 2020-11-09 11:19:13.459533267 +0530 IST to 2020-11-09 12:01:28.110495974 +0530 IST)",
	"renames": 0,
	"retryError": true,
	"speed": 10979535.57372856,
	"transferTime": 1856.232880812,
	"transfers": 7
}

I don't have any remaining transfers right now, but I seem to recall this command showing file names and other transfer stats like current speed/ETA.

EDIT: Yup, inside the transferring dictionary: https://rclone.org/rc/#core-stats

9

It will only do that when you are transferring stuff.

10

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.