What is the problem you are having with rclone?
Mounting a union of a google drive and a local SMB backed filesystem prevents uploading files.
Run the command 'rclone version' and share the full output of the command.
rclone version
rclone v1.63.0
- os/version: arch "rolling" (64 bit)
- os/kernel: 6.4.3-arch1-1 (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.20.5
- go/linking: dynamic
- go/tags: none
Which cloud storage system are you using? (eg Google Drive)
union between Google Drive & alias backed systemd automounted SMB folder
The command you were trying to run (eg rclone copy /tmp remote:tmp
)
The google drive, 197TB over a 5TB allocation due to googles recent policy changes
Mounted as read only
# rclone about gd: -vv
2023/08/27 14:13:29 DEBUG : rclone: Version "v1.63.0" starting with parameters ["rclone" "about" "gd:" "-vv"]
2023/08/27 14:13:29 DEBUG : Creating backend with remote "gd:"
2023/08/27 14:13:29 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
Total: 5 TiB
Used: 203.931 TiB
Free: off
Trashed: 773.763 GiB
Other: 0 B
2023/08/27 14:13:30 DEBUG : 6 go routines active
The alias backed SMB filesystem - 133TB free
# rclone about mtankmedia: -vv
2023/08/27 14:14:16 DEBUG : rclone: Version "v1.63.0" starting with parameters ["rclone" "about" "mtankmedia:" "-vv"]
2023/08/27 14:14:16 DEBUG : Creating backend with remote "mtankmedia:"
2023/08/27 14:14:16 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2023/08/27 14:14:16 DEBUG : Creating backend with remote "/mnt/mtankmedia"
2023/08/27 14:14:16 DEBUG : fs cache: renaming cache item "mtankmedia:" to be canonical "/mnt/mtankmedia"
Total: 133.285 TiB
Used: 0 B
Free: 133.285 TiB
2023/08/27 14:14:16 DEBUG : 4 go routines active
and the union mount which I expected to show
- capacity = sum of google + local
- free as just SMB share due to google being marked read only
### rclone about allmedia: -vv
2023/08/27 14:14:49 DEBUG : rclone: Version "v1.63.0" starting with parameters ["rclone" "about" "allmedia:" "-vv"]
2023/08/27 14:14:49 DEBUG : Creating backend with remote "allmedia:"
2023/08/27 14:14:49 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2023/08/27 14:14:49 DEBUG : Creating backend with remote "mtankmedia:"
2023/08/27 14:14:49 DEBUG : Creating backend with remote "gd:Media"
2023/08/27 14:14:49 DEBUG : Creating backend with remote "/mnt/mtankmedia"
2023/08/27 14:14:49 DEBUG : fs cache: renaming cache item "mtankmedia:" to be canonical "/mnt/mtankmedia"
2023/08/27 14:14:49 DEBUG : fs cache: switching user supplied name "mtankmedia:" for canonical name "/mnt/mtankmedia"
2023/08/27 14:14:49 DEBUG : union root '': actionPolicy = *policy.EpAll, createPolicy = *policy.EpMfs, searchPolicy = *policy.FF
Total: 138.285 TiB
Used: 203.931 TiB
Free: off
2023/08/27 14:14:50 DEBUG : 6 go routines active
rclone mount google drive command
rclone mount gd:Media /opt/gd-media \
--gid 1001 --uid 1001 \
--daemon-wait=5m \
--fast-list \
--dir-cache-time 5000h \
--poll-interval 10s \
--drive-pacer-min-sleep 10ms \
--drive-pacer-burst 200 \
--config /root/.config/rclone/rclone.conf \
--log-file=/var/log/rclone.log \
--log-level=INFO \
--allow-other \
--drive-chunk-size=128M \
--cache-dir=/mnt/Cache \
--vfs-cache-mode full \
--vfs-cache-max-size 256G \
--vfs-cache-max-age 5000h \
--vfs-read-ahead 1G
rclone alias local SMB share from NAS (not optimised because of testing SMB vs alias + union)
/rclone mount allmedia: /opt/all-media \
--gid 1001 --uid 1001 \
--config /root/.config/rclone/rclone.conf \
--log-file=/var/log/rclone-allmedia.log \
--log-level=DEBUG
The rclone config contents with secrets removed.
[gd]
type = drive
client_id = <SNIP>.apps.googleusercontent.com
client_secret = <SNIP>
scope = drive
root_folder_id = <SNIP>
service_account_file =
token = {"access_token":"<SNIP>","expiry":"2023-08-27T15:30:25.131088687-07:00"}
[mtankmedia]
type = alias
remote = /mnt/mtankmedia
[allmedia]
type = union
upstreams = gd:Media:ro mtankmedia:
A log from the command with the -vv
flag
2023/08/27 15:02:41 DEBUG : rclone: Version "v1.63.0" starting with parameters ["/usr/bin/rclone" "mount" "allmedia:" "/opt/all-media" "--gid" "1001" "--uid" "1001" "--config" "/root/.config/rclone/rclone.conf" "--log-file=/var/log/rclone-allmedia.log" "--log-level=DEBUG"]
2023/08/27 15:02:41 DEBUG : Creating backend with remote "allmedia:"
2023/08/27 15:02:41 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2023/08/27 15:02:41 DEBUG : Creating backend with remote "mtankmedia:"
2023/08/27 15:02:41 DEBUG : Creating backend with remote "/mnt/mtankmedia"
2023/08/27 15:02:41 DEBUG : Creating backend with remote "gd:Media"
2023/08/27 15:02:41 DEBUG : fs cache: renaming cache item "mtankmedia:" to be canonical "/mnt/mtankmedia"
2023/08/27 15:02:41 DEBUG : fs cache: switching user supplied name "mtankmedia:" for canonical name "/mnt/mtankmedia"
2023/08/27 15:02:41 DEBUG : union root '': actionPolicy = *policy.EpAll, createPolicy = *policy.EpMfs, searchPolicy = *policy.FF
2023/08/27 15:02:41 INFO : union root '': poll-interval is not supported by this remote
2023/08/27 15:02:41 DEBUG : union root '': Mounting on "/opt/all-media"
2023/08/27 15:02:41 DEBUG : : Root:
2023/08/27 15:02:41 DEBUG : : >Root: node=/, err=<nil>
2023/08/27 15:02:48 DEBUG : /: Lookup: name="TV"
2023/08/27 15:02:49 DEBUG : /: >Lookup: node=TV/, err=<nil>
2023/08/27 15:02:49 DEBUG : TV/: Attr:
2023/08/27 15:02:49 DEBUG : TV/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2023/08/27 15:05:11 DEBUG : : Statfs:
2023/08/27 15:05:11 DEBUG : : >Statfs: stat={Blocks:37120675328 Bfree:4503582005646051 Bavail:4503582005646051 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=<nil>
and from sonarr
Aug 27 15:04:51 dockerhost docker[916260]: [Warn] FreeSpaceSpecification: Not enough free space (0) to import: /downloads/completed/Series/<snip>.mkv (45692457)
EDIT: Also tried using mfs (most free space) for action and create poliicies but no difference.