Rclone multiple places

Hi,

I just want to know if there could be some issues in running rclone from multiple places with the same content.

What is the problem you are having with rclone?

I mean I have it running on my remote server and have it running on my synology ds2411+ also, but the content is not shown on the syno

This is from Syno
rclone1

This is from my ubuntu server
rclone2

Run the command 'rclone version' and share the full output of the command.

rclone v1.64.0
- os/version: unknown
- os/kernel: 3.10.105 (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.21.1
- go/linking: static
- go/tags: none

Which cloud storage system are you using? (eg Google Drive)

Dropbox

The command you were trying to run (eg rclone copy /tmp remote:tmp)

From my ubuntu server

[Unit]
Description=RClone VFS Service
Wants=network-online.target
After=network-online.target

[Service]
Type=notify
Environment=RCLONE_CONFIG=/home/klapvogn/.config/rclone/rclone.conf
KillMode=none
RestartSec=5
ExecStart=/usr/bin/rclone mount dropbox-crypt:drive1/ /home/klapvogn/data/shared-drives/drive-01 \
--use-mmap \
# This is for allowing users other than the user running rclone access to the mount
--allow-other \
# log file
--log-file /home/klapvogn/.config/rclone/rclone-dropbox-shared-data-01.log \
#--log-level DEBUG \
# Google Drive is a polling remote so this value can be set very high and any changes are detected via polling.
--dir-cache-time 5000h \
# I reduce the poll interval down to 10 seconds as this makes changes appear fast the API quotas per day are huge
--poll-interval 10s \
# This is setting the file permission on the mount to user and group have the same access and other can read
--umask 002 \
# Please set this to your own value below
--user-agent='Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36' \
# This sets up the remote control daemon so you can issue rc commands locally
--rc \
# This is the default port it runs on
--rc-addr :6601 \
# no-auth is used as no one else uses my server and it is not a shared seedbox
--rc-no-auth \
# The local disk used for caching
--cache-dir=/home/klapvogn/.cache/dropbox-01 \
# 
# My quota per user / per 100 seconds is 20,000 requests. This can be found in your quota section.
# This changes the sleep calls to something much lower to take advantage of the API boost.
# change the min sleep from 100ms
--drive-pacer-min-sleep 10ms \
# Changing to have the ability to burst higher
--drive-pacer-burst 200 \
# This is used for caching files to local disk for streaming OLD - full
--vfs-cache-mode writes \
# This limits the cache size to the value below - 1000G
--vfs-cache-max-size 100G \
# This limits the age in the cache if the size is reached and it removes the oldest files first
--vfs-cache-max-age 5000h \
# The polling interval for increased based on there is enough buffer space
--vfs-cache-poll-interval 5m \
# Add read ahead buffer to network latency issues - 2G
--vfs-read-ahead 512M \
--buffer-size 1G \
# This sets a per file bandwidth control and I limit this to a little bigger than my largest bitrate I'd want to play
#--bwlimit-file 32M \
# TPS LIMIT
--tpslimit 10
#MOUNTS
StandardOutput=file:/home/klapvogn/logs/rclone/dropbox_01_vfs_mount.log
ExecStop=/bin/fusermount -uz /home/klapvogn/data/shared-drives/drive-01
ExecStartPost=/usr/bin/rclone rc vfs/refresh recursive=true --rc-addr 127.0.0.1:6601 _async=true
Restart=on-failure

[Install]
WantedBy=default.target

From my syno

#!/bin/bash

#!/bin/rclone

# Make script executable with: chmod a+x /volume1/homes/klapvogn/scripts/nas-mounter.sh

/bin/rclone mount -v dropbox-crypt:drive1/ /volume1/homes/klapvogn/data/shared-drives/drive-01 --config=/volume1/homes/klapvogn/.config/rclone/rclone.conf --allow-other --dir-cache-time 9999h --log-level INFO --log-file /volume1/homes/klapvogn/.config/rclone/rclone-dropbox-shared-data-01.log --umask 002 --rc --rc-addr 127.0.0.1:5574 --rc-no-auth --cache-dir=/volume1/homes/klapvogn/.cache/dropbox-01 --vfs-cache-mode full --vfs-cache-max-size 600G --vfs-fast-fingerprint --vfs-cache-max-age 9999h --dropbox-pacer-min-sleep 100ms --tpslimit 10 &

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

2023/12/10 17:43:39 NOTICE: Config file "/root/.config/rclone/rclone.conf" not found - using defaults
; empty config

when you posted, there was a template of questions.
please answer all the questions

there done I hope :slight_smile:

well, that is a problem.

didn't notice that. hmm to correct that

I did the "rclone config redacted" as the wrong user, so the output is :

[dropbox]
type = dropbox
token = XXX

[dropbox-crypt]
type = crypt
remote = dropbox:/VideoServer/Twitch
password = XXX
### Double check the config for sensitive info before posting publicly

This is from my .sh runnining from Synology task scheduler :

/bin/sh
/bin/rclone mount dropbox-crypt:drive1/ /volume1/homes/klapvogn/data/shared-drives/drive-01 --config=/volume1/homes/klapvogn/.config/rclone/rclone.conf --allow-other --dir-cache-time 5000h --poll-interval 10s --log-file /volume1/homes/klapvogn/.config/rclone/rclone-dropbox-shared-data-01.log --umask 002 --rc --rc-addr 127.0.0.1:6005 --rc-no-auth --cache-dir=/volume1/homes/klapvogn/.cache/dropbox-01 --vfs-cache-mode writes --vfs-cache-max-size 100G --vfs-cache-max-age 5000h --dropbox-pacer-min-sleep 10ms --vfs-read-ahead 512M --buffer-size 1G --tpslimit 10

And from Ubuntu server :

[Unit]
Description=RClone VFS Service
Wants=network-online.target
After=network-online.target

[Service]
Type=notify
Environment=RCLONE_CONFIG=/home/klapvogn/.config/rclone/rclone.conf
KillMode=none
RestartSec=5
ExecStart=/usr/bin/rclone mount dropbox-crypt:drive1/ /home/klapvogn/data/shared-drives/drive-01 \
--use-mmap \
# This is for allowing users other than the user running rclone access to the mount
--allow-other \
# log file
--log-file /home/klapvogn/.config/rclone/rclone-dropbox-shared-data-01.log \
#--log-level DEBUG \
# Google Drive is a polling remote so this value can be set very high and any changes are detected via polling.
--dir-cache-time 5000h \
# I reduce the poll interval down to 10 seconds as this makes changes appear fast the API quotas per day are huge
--poll-interval 10s \
# This is setting the file permission on the mount to user and group have the same access and other can read
--umask 002 \
# Please set this to your own value below
--user-agent='Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36' \
# This sets up the remote control daemon so you can issue rc commands locally
--rc \
# This is the default port it runs on
--rc-addr :6601 \
# no-auth is used as no one else uses my server and it is not a shared seedbox
--rc-no-auth \
# The local disk used for caching
--cache-dir=/home/klapvogn/.cache/dropbox-01 \
# 
# My quota per user / per 100 seconds is 20,000 requests. This can be found in your quota section.
# This changes the sleep calls to something much lower to take advantage of the API boost.
# change the min sleep from 100ms
--drive-pacer-min-sleep 10ms \
# Changing to have the ability to burst higher
--drive-pacer-burst 200 \
# This is used for caching files to local disk for streaming OLD - full
--vfs-cache-mode writes \
# This limits the cache size to the value below - 1000G
--vfs-cache-max-size 100G \
# This limits the age in the cache if the size is reached and it removes the oldest files first
--vfs-cache-max-age 5000h \
# The polling interval for increased based on there is enough buffer space
--vfs-cache-poll-interval 5m \
# Add read ahead buffer to network latency issues - 2G
--vfs-read-ahead 512M \
--buffer-size 1G \
# This sets a per file bandwidth control and I limit this to a little bigger than my largest bitrate I'd want to play
#--bwlimit-file 32M \
# TPS LIMIT
--tpslimit 10
#MOUNTS
StandardOutput=file:/home/klapvogn/logs/rclone/dropbox_01_vfs_mount.log
ExecStop=/bin/fusermount -uz /home/klapvogn/data/shared-drives/drive-01
ExecStartPost=/usr/bin/rclone rc vfs/refresh recursive=true --rc-addr 127.0.0.1:6601 _async=true
Restart=on-failure

[Install]
WantedBy=default.target

The main issue is that the Synology mount does not have the same content as the Ubuntu server (look at the screen shoot further up)

This is your mount point according to your rclone mount

But then you check content of some completely different directory.

Unless you explain clearly what you are doing it is impossible to guess and help.

I suggest you post what is the content of /home/klapvogn/data/shared-drives/drive-01 on both Synology and Ubunty.

Simply run:

ls /home/klapvogn/data/shared-drives/drive-01

From my Syno :

ls /volume1/homes/klapvogn/data/shared-drives/drive-01
CARTOONS  DANiSH-MOViES  DOKUMENTAR  MOVIE-NON-SUBS  MOVIES  OLD-DANiSH-MOViES  OLD-MOVIES  STAND-UP  X-MAS
ls /volume1/homes/klapvogn/data/shared-drives/drive-02
JULEKALENDER  TV-CARTOONS  TV-DANiSH  TV-DOKUMENTAR  TV-NON-SUBS  TV-NORDIC  TV-XMAS

Ubuntu :

ls /home/klapvogn/data/shared-drives/drive-01
CARTOONS  DANiSH-MOViES  DOKUMENTAR  MOVIE-NON-SUBS  MOVIES  OLD-DANiSH-MOViES  OLD-MOVIES  STAND-UP  X-MAS
ls /home/klapvogn/data/shared-drives/drive-02
JULEKALENDER  TV-CARTOONS  TV-DANiSH  TV-DOKUMENTAR  TV-NON-SUBS  TV-NORDIC  TV-XMAS

Looks exactly the same for me...

It does yes, but the content from IE: "Julekalender is not the same

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.