How do I delete the cache that's created when I copy a file to the mount?

Help and Support
1

Hi all,

Facing a bit of a problem where I've attempted to move a folder over to the rclone mount and it filled up the storage completely and even a restart did not empty the cache...

How do I empty it and is there a way to specify where the file goes when I copy a file to the mount?

2

Not sure what your mount command is or what cache you are referring to.

What's the mount command you are using?

What's filling it up?

3

Yeah so the vfs folder within .config/rclone had the files that filled up the disk.

Is there a way to upload multiple files simultaneously if I open multiple terminals and copy to the mount (without vfs cache enabled of course)??

4

What's your mount command you are using?

5

I duplicated the current one and edited it so it wouldn't write to the VFS cache.

media.service 
[Unit]
Description=rclone media mount
Wants=network-online.target
After=network-online.target

[Service]
Type=notify
ExecStart=/usr/bin/rclone mount \
        --config=/home/agneev/.config/rclone/rclone.conf \
        --allow-other \
        --allow-non-empty \
        --dir-cache-time 48h \
        --drive-chunk-size 64M \
        --vfs-cache-mode writes \
        --log-level INFO \
        --log-file /opt/media.log \
        --rc \
        media:/ /mnt/media
Restart=on-failure
ExecStop=/bin/fusermount -u /mnt/media
User=root
Group=root

[Install]
WantedBy=multi-user.target
media2.service 
[Unit]
Description=rclone media mount
Wants=network-online.target
After=network-online.target

[Service]
Type=notify
ExecStart=/usr/bin/rclone mount \
        --config=/home/agneev/.config/rclone/rclone.conf \
        --allow-other \
        --allow-non-empty \
        --dir-cache-time 48h \
        --drive-chunk-size 64M \
        media:/ /mnt/media2
Restart=on-failure
ExecStop=/bin/fusermount -u /mnt/media
User=root
Group=root

[Install]
WantedBy=multi-user.target

(I know I probably should create a separate user or stop using root)

6

So that writes to the default cache directory and will upload files once the write is completed. When you say filling up, how much data do you have in there? You still have the daily 750GB upload limit.

If you check the log file, are you seeing any errors? Can you are share the /opt/media.log file?

7

yeah media.service is the one being used by Plex, Sonarr and Radarr.
media2.service is the one I'm currently using to avoid filling up disk space.

So with media2, I was inquiring about whether it's possible to use rsync to copy the folder directly to the mount (w/o vfs cache)...

8

Let's take a step back.

If you have a local file and you want to copy it or move it to your cloud storage, you have many options to do that.

You can copy it to the mount and the mount uploads it.
You can use rclone or rclone move to your remote directly.

If your local disk is filling up, it could be because you hit your daily limit (hard to tell without looking at the log) or something else.

9

Local disk (25GB) was filling up because I was copying to the vfs cache, which I no longer wish to do. This is on a DO droplet fyi.

I didn't realize rclone move was for local transfers...

10

I'm still getting lost as your workflow.

If you are copying to a rclone moune with vfs-cache-mode writes, that's you want to copy a local file to your remote. I wouldn't call that a local transfer.

Instead of copying to the mount, you can do the same thing with rclone copy (or move if you want to delete the source file) and go directly to the remote.

If you can explain your workflow and what you want to accomplish, that would help.

11

I just said that I will no longer use vfs cache as I'm using the mount created by media2.service not media.service.

Right now I'm experimenting with rsync, let's see how that goes...

agneev@server1:/mnt/disk2/done$ rsync --recursive --progress "/mnt/disk2/
done/Star.Trek.Discovery.S02.1080p.AMZN.WEBRip.DD5.1.x264-AJP69[rartv]" /mnt/media2
sending incremental file list
Star.Trek.Discovery.S02.1080p.AMZN.WEBRip.DD5.1.x264-AJP69[rartv]/
Star.Trek.Discovery.S02.1080p.AMZN.WEBRip.DD5.1.x264-AJP69[rartv]/RARBG.txt
             31 100%    0.00kB/s    0:00:00 (xfr#1, to-chk=14/16)
Star.Trek.Discovery.S02.1080p.AMZN.WEBRip.DD5.1.x264-AJP69[rartv]/Star.Trek.Discovery.S02E01.Brother.REPACK.1080p.AMZN.WEB-DL.DD5.1.H.264-AJP69.mkv
  3,565,256,704  80%   15.41MB/s    0:00:55
12

So you are making it hard for yourself going that route as rclone copy or move is the way to go, but good luck!

13

Do those commands provide a progress bar?

14

Yes.

 -P, --progress                             Show progress during transfer.
15

It's able to copy the files (often recursively) inside the folders without changing their attributes right?

The copy should be made to the mount right? Not the remote?
Ok, then command to copy from /mnt/disk2/done/[folder name] would be
rclone copy -P source:/mnt/disk2/done/[folder_name] dest:/mnt/media2 correct?

16

From a workflow if you go local -> cloud regardless if you do it via rsync on a mount or rclone copy, it does the same thing as it had to upload it to the remote.

rclone copy or move will run recursively.

17

I've just found that the Google Drive web UI showed that the 2 mkv video files that uploaded through rsync as binary files for some reason.

Whats the correct syntax for the command?

18

It would be helpful to:

  • perform your action on one file (rsync / rclone copy / whatever you want)
  • share a log for that file

and we can review the log and see what is going on.

19

If you only told me what the rclone copy command would be for the example I gave 3 posts above, I would be able to do that.

20

To copy one file, you can use:

rclone copy /somewhere/file.mkv remotename:

and that drops it in the root folder of the remote.