Rclone + vps + qbittorrent

Acb_Ezio · January 7, 2023, 10:43am

Recently I have purchased a fedora VPS and installed & configured rclone and qbittorrent without an issue.

I mounted a teamdrive using below commands

$ mkdir ~/gdrive
$ rclone mount td1: ~/gdrive/

After the mounting I gave qbittorrent save path as "/home/fedora/gdrive" in web ui. When I added a new torrent qbittorrent "Stautus" show ERRORED.

Is there any solution for this issue?

ncw · January 7, 2023, 11:21am

You will certainly need --vfs-cache-mode writes with qbittorrent.

asdffdsa · January 7, 2023, 2:05pm

hi, might need to add --allow-other

if you answer the questions in help template, then we can share better advice.

asdffdsa · January 7, 2023, 2:40pm

check ouy my wiki, for a different way to use qbit.
use rclone move instead of rclone mount

https://forum.rclone.org/t/how-to-move-a-downloaded-torrent-to-the-cloud/23493

Acb_Ezio · January 7, 2023, 4:05pm

I'm facing the same scenario as below

https://forum.rclone.org/t/how-to-download-large-files-that-exceed-servers-disk-storage/25427

asdffdsa · January 7, 2023, 4:08pm

what is the goal of your setup?

use the vps to download torrents and then move them to cloud?

Acb_Ezio · January 7, 2023, 4:08pm

Didn't work. Tried below.

rclone mount remote:new-files /home/fedora/gdrive --vfs-cache-mode writes --allow-other

asdffdsa · January 7, 2023, 4:09pm

please add -vv and post the full output.

Acb_Ezio · January 7, 2023, 4:10pm

Download directly to teamdrive without compromising VPS storage.

Acb_Ezio · January 7, 2023, 4:16pm

Last login: Sat Jan  7 15:50:49 2023 from 112.14.45.7
[fedora@hello ~]$ rclone mount remote:new-files /home/fedora/gdrive --vfs-cache-mode writes --allow-other -vv
2023/01/07 16:11:55 DEBUG : rclone: Version "1.60.1" starting with parameters ["rclone" "mount" "remote:new-files" "/home/fedora/gdrive" "--vfs-cache-mode" "writes" "--allow-other" "-vv"]
2023/01/07 16:11:55 DEBUG : Creating backend with remote "remote:new-files"
2023/01/07 16:11:55 DEBUG : Using config file from "/home/fedora/.config/rclone/rclone.conf"
2023/01/07 16:11:57 DEBUG : vfs cache: root is "/home/fedora/.cache/rclone"
2023/01/07 16:11:57 DEBUG : vfs cache: data root is "/home/fedora/.cache/rclone/vfs/remote/new-files"
2023/01/07 16:11:57 DEBUG : vfs cache: metadata root is "/home/fedora/.cache/rclone/vfsMeta/remote/new-files"
2023/01/07 16:11:57 DEBUG : Creating backend with remote "/home/fedora/.cache/rclone/vfs/remote/new-files"
2023/01/07 16:11:57 DEBUG : Creating backend with remote "/home/fedora/.cache/rclone/vfsMeta/remote/new-files"
2023/01/07 16:11:57 DEBUG : Google drive root 'new-files': Mounting on "/home/fedora/gdrive"
2023/01/07 16:11:57 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2023/01/07 16:11:57 DEBUG : : Root:
2023/01/07 16:11:57 DEBUG : : >Root: node=/, err=<nil>
2023/01/07 16:12:10 DEBUG : /: Attr:
2023/01/07 16:12:10 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2023/01/07 16:12:10 DEBUG : : Statfs:
2023/01/07 16:12:10 DEBUG : Google drive root 'new-files': read info from Shared Drive "remote"
2023/01/07 16:12:10 DEBUG : : >Statfs: stat={Blocks:274877906944 Bfree:274877906944 Bavail:274877906944 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=<nil>
2023/01/07 16:12:57 DEBUG : Google drive root 'new-files': Checking for changes on remote
2023/01/07 16:12:57 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2023/01/07 16:13:57 DEBUG : Google drive root 'new-files': Checking for changes on remote
2023/01/07 16:13:57 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0

asdffdsa · January 7, 2023, 4:16pm

sorry, that is not possible.
if the torrent is 100GiB in size, then you need 100GiB of free local storage on the vps.

basically the sequence is

download the full torrent to local vps
stop seeding
now rclone can move the full file to gdrive.

and rclone can do that two ways, tho in both cases, need to have enough local stoarge

rclone mount
rclone move - that is what i use. based on my wiki.

asdffdsa · January 7, 2023, 4:17pm

that looks good.

should see someting in /home/fedora/gdrive

what is the output of
ls /home/fedora/gdrive

Acb_Ezio · January 7, 2023, 4:18pm

Thank you for the detailed explanation.

Acb_Ezio · January 7, 2023, 4:21pm

It doesn't show my teamdrive files.

asdffdsa · January 7, 2023, 4:27pm

rclone ls remote:new-files
that command should show your files, correct?

Acb_Ezio · January 7, 2023, 4:29pm

Yes that works without an issue, also the ncdu command.

Is there any other alternative way available to do this task?

asdffdsa · January 7, 2023, 4:43pm

ok, then i am not sure why the files do not appear on the mount.

in the /etc/fuse.conf, need to uncomment #user_allow_other

as far as i know, there is no --magic solution.
and to seed all those torrents, need additional local storage to cache that.

so what is lacking with my wiki solution, works great for me, uses minimal local storage.
once a torrent has finished downloading, qbit automatically moves it to cloud.

Acb_Ezio · January 7, 2023, 4:52pm

I've tried the #user_allow_other workaround also.

I'm not planning to seed these.

My VPS is limited to 20GB and torrent that I've added is 58GB. With experience on Google Collab, I thought this will be quite easy. Looks like it turned into a little bit complex situation.

Anyway, thank you very much for helping me. If I found a solution. I will mention it in the future.

asdffdsa · January 7, 2023, 5:07pm

ok, if no seeding, then this is what i do.
works around the issue of limited local storage.

in this case, can get a 600GiB torrent into gdrive, tho the vps has limited space.

rent a cheap torrent seedbox, approx $5.00/month - get 600MiB of storage.
most seedbox let you access the torrents over sftp. rclone works with sftp
rent a cheap vm for, approx. $5.00/month, has just 40GiB free space, more than enough

now, on that vm,
use rclone move to move the torrents from seedbox to gdrive.
note: rclone move does not use local storage, only memory.

Acb_Ezio · January 7, 2023, 5:10pm

Thank you for the advise.