Make rclone work as a RAID 1 - Part 2

Help and Support
1

As the topic was closed, I created another one with reference to the previous one.

The following is happening, I have a union, as seen in the other topic, everything was working fine, I'm traveling, I went to create a paste and I noticed that it is being created only on one drive and not on all, I don't know why .

Creating like this seems OK, but using the direct terminal the drive that is mounted has problems and I don't know how to generate a log.

jelly@jellyfin2:~$ rclone -vv mkdir jelly-uniao:/test
2022/11/21 20:22:05 DEBUG : rclone: Version "v1.60.0" starting with parameters ["rclone" "-vv" "mkdir" "jelly-uniao:/test"]
2022/11/21 20:22:05 DEBUG : Creating backend with remote "jelly-uniao:/test"
2022/11/21 20:22:05 DEBUG : Using config file from "/home/jelly/.config/rclone/rclone.conf"
2022/11/21 20:22:05 DEBUG : Creating backend with remote "bkp-jelly-06-crypt:"
2022/11/21 20:22:05 DEBUG : Creating backend with remote "bkp-jelly-03-crypt:"
2022/11/21 20:22:05 DEBUG : Creating backend with remote "bkp-jelly-02-crypt:"
2022/11/21 20:22:05 DEBUG : Creating backend with remote "bkp-jelly-05-crypt:"
2022/11/21 20:22:05 DEBUG : Creating backend with remote "bkp-jelly-01-crypt:"
2022/11/21 20:22:05 DEBUG : Creating backend with remote "jelly-start-crypt:"
2022/11/21 20:22:05 DEBUG : Creating backend with remote "bkp-jelly-04-crypt:"
2022/11/21 20:22:05 DEBUG : Creating backend with remote "bkp-jelly-02:/"
2022/11/21 20:22:05 DEBUG : fs cache: renaming cache item "bkp-jelly-02:/" to be canonical "bkp-jelly-02:"
2022/11/21 20:22:05 DEBUG : Creating backend with remote "bkp-jelly-02-crypt:test"
2022/11/21 20:22:05 DEBUG : Creating backend with remote "bkp-jelly-03:/"
2022/11/21 20:22:05 DEBUG : fs cache: renaming cache item "bkp-jelly-03:/" to be canonical "bkp-jelly-03:"
2022/11/21 20:22:05 DEBUG : Creating backend with remote "bkp-jelly-03-crypt:test"
2022/11/21 20:22:05 DEBUG : Creating backend with remote "jelly-start:/"
2022/11/21 20:22:05 DEBUG : fs cache: renaming cache item "jelly-start:/" to be canonical "jelly-start:"
2022/11/21 20:22:05 DEBUG : Creating backend with remote "jelly-start-crypt:test"
2022/11/21 20:22:05 DEBUG : Creating backend with remote "bkp-jelly-01:/"
2022/11/21 20:22:05 DEBUG : fs cache: renaming cache item "bkp-jelly-01:/" to be canonical "bkp-jelly-01:"
2022/11/21 20:22:05 DEBUG : Creating backend with remote "bkp-jelly-01-crypt:test"
2022/11/21 20:22:05 DEBUG : Creating backend with remote "bkp-jelly-04:/"
2022/11/21 20:22:05 DEBUG : fs cache: renaming cache item "bkp-jelly-04:/" to be canonical "bkp-jelly-04:"
2022/11/21 20:22:05 DEBUG : Creating backend with remote "bkp-jelly-04-crypt:test"
2022/11/21 20:22:05 DEBUG : Creating backend with remote "bkp-jelly-06:/"
2022/11/21 20:22:05 DEBUG : fs cache: renaming cache item "bkp-jelly-06:/" to be canonical "bkp-jelly-06:"
2022/11/21 20:22:05 DEBUG : Creating backend with remote "bkp-jelly-06-crypt:test"
2022/11/21 20:22:06 DEBUG : Creating backend with remote "bkp-jelly-02:/bf4oringqibat8rhjco16t2tto"
2022/11/21 20:22:06 DEBUG : Creating backend with remote "bkp-jelly-03:/l02e0pt29m56ag1ora33r1b7ts"
2022/11/21 20:22:06 DEBUG : Creating backend with remote "jelly-start:/u50r521g9kslm10j52v3etfvk4"
2022/11/21 20:22:06 DEBUG : Creating backend with remote "bkp-jelly-05:/"
2022/11/21 20:22:06 DEBUG : fs cache: renaming cache item "bkp-jelly-05:/" to be canonical "bkp-jelly-05:"
2022/11/21 20:22:06 DEBUG : Creating backend with remote "bkp-jelly-05-crypt:test"
2022/11/21 20:22:06 DEBUG : Creating backend with remote "bkp-jelly-01:/sue8ahm10qh9if4d2htr6rurdk"
2022/11/21 20:22:06 DEBUG : Creating backend with remote "bkp-jelly-04:/pohg6ppdloij7hq2lhtkni397c"
2022/11/21 20:22:06 DEBUG : Creating backend with remote "bkp-jelly-06:/ut9npn3234mjvrl3jgqbc6p0u0"
2022/11/21 20:22:06 DEBUG : Creating backend with remote "bkp-jelly-05:/t202ie7n61mullmqq9c6f4j3vk"
2022/11/21 20:22:06 DEBUG : fs cache: renaming cache item "bkp-jelly-04:/pohg6ppdloij7hq2lhtkni397c" to be canonical "bkp-jelly-04:pohg6ppdloij7hq2lhtkni397c"
2022/11/21 20:22:06 DEBUG : fs cache: switching user supplied name "bkp-jelly-04:/pohg6ppdloij7hq2lhtkni397c" for canonical name "bkp-jelly-04:pohg6ppdloij7hq2lhtkni397c"
2022/11/21 20:22:06 DEBUG : fs cache: renaming cache item "bkp-jelly-06:/ut9npn3234mjvrl3jgqbc6p0u0" to be canonical "bkp-jelly-06:ut9npn3234mjvrl3jgqbc6p0u0"
2022/11/21 20:22:06 DEBUG : fs cache: switching user supplied name "bkp-jelly-06:/ut9npn3234mjvrl3jgqbc6p0u0" for canonical name "bkp-jelly-06:ut9npn3234mjvrl3jgqbc6p0u0"
2022/11/21 20:22:06 DEBUG : fs cache: renaming cache item "bkp-jelly-01:/sue8ahm10qh9if4d2htr6rurdk" to be canonical "bkp-jelly-01:sue8ahm10qh9if4d2htr6rurdk"
2022/11/21 20:22:06 DEBUG : fs cache: switching user supplied name "bkp-jelly-01:/sue8ahm10qh9if4d2htr6rurdk" for canonical name "bkp-jelly-01:sue8ahm10qh9if4d2htr6rurdk"
2022/11/21 20:22:06 DEBUG : fs cache: renaming cache item "bkp-jelly-05:/t202ie7n61mullmqq9c6f4j3vk" to be canonical "bkp-jelly-05:t202ie7n61mullmqq9c6f4j3vk"
2022/11/21 20:22:06 DEBUG : fs cache: switching user supplied name "bkp-jelly-05:/t202ie7n61mullmqq9c6f4j3vk" for canonical name "bkp-jelly-05:t202ie7n61mullmqq9c6f4j3vk"
2022/11/21 20:22:06 DEBUG : fs cache: renaming cache item "bkp-jelly-02:/bf4oringqibat8rhjco16t2tto" to be canonical "bkp-jelly-02:bf4oringqibat8rhjco16t2tto"
2022/11/21 20:22:06 DEBUG : fs cache: switching user supplied name "bkp-jelly-02:/bf4oringqibat8rhjco16t2tto" for canonical name "bkp-jelly-02:bf4oringqibat8rhjco16t2tto"
2022/11/21 20:22:06 DEBUG : fs cache: renaming cache item "jelly-start:/u50r521g9kslm10j52v3etfvk4" to be canonical "jelly-start:u50r521g9kslm10j52v3etfvk4"
2022/11/21 20:22:06 DEBUG : fs cache: switching user supplied name "jelly-start:/u50r521g9kslm10j52v3etfvk4" for canonical name "jelly-start:u50r521g9kslm10j52v3etfvk4"
2022/11/21 20:22:06 DEBUG : fs cache: renaming cache item "bkp-jelly-03:/l02e0pt29m56ag1ora33r1b7ts" to be canonical "bkp-jelly-03:l02e0pt29m56ag1ora33r1b7ts"
2022/11/21 20:22:06 DEBUG : fs cache: switching user supplied name "bkp-jelly-03:/l02e0pt29m56ag1ora33r1b7ts" for canonical name "bkp-jelly-03:l02e0pt29m56ag1ora33r1b7ts"
2022/11/21 20:22:06 DEBUG : union root 'test': actionPolicy = *policy.EpAll, createPolicy = *policy.EpAll, searchPolicy = *policy.FF
2022/11/21 20:22:06 DEBUG : fs cache: renaming cache item "jelly-uniao:/test" to be canonical "jelly-uniao:test"
2022/11/21 20:22:06 DEBUG : union root 'test': Making directory
2022/11/21 20:22:07 DEBUG : Google drive root '': read info from Shared Drive "Backup DATA 05"
2022/11/21 20:22:07 DEBUG : Google drive root '': read info from Shared Drive "Backup DATA 01"
2022/11/21 20:22:07 DEBUG : Google drive root '': read info from Shared Drive "Jelly Start"
2022/11/21 20:22:07 DEBUG : Google drive root '': read info from Shared Drive "Backup DATA 06"
2022/11/21 20:22:07 DEBUG : Google drive root '': read info from Shared Drive "Backup DATA 03"
2022/11/21 20:22:07 DEBUG : Google drive root '': read info from Shared Drive "Backup DATA 02"
2022/11/21 20:22:09 DEBUG : Google drive root '': read info from Shared Drive "Backup DATA 06"
2022/11/21 20:22:09 DEBUG : Google drive root '': read info from Shared Drive "Jelly Start"
2022/11/21 20:22:09 DEBUG : Google drive root '': read info from Shared Drive "Backup DATA 05"
2022/11/21 20:22:09 DEBUG : Google drive root '': read info from Shared Drive "Backup DATA 02"
2022/11/21 20:22:09 DEBUG : Google drive root '': read info from Shared Drive "Backup DATA 01"
2022/11/21 20:22:09 DEBUG : Google drive root '': read info from Shared Drive "Backup DATA 03"
2022/11/21 20:22:09 DEBUG : 30 go routines active

[Install]
WantedBy=multi-user.target

[Unit]
Description=rClone montar drive criptografado
AssertPathIsDirectory=/home/jelly/Jellyfin
After=network-online.target

[Service]
Type=simple
ExecStart=/usr/bin/rclone mount \
  --config=/home/jelly/.config/rclone/rclone.conf \
        --buffer-size=128M \
        --max-read-ahead=256M \
        --poll-interval=1m \
        --dir-cache-time=12h \
        --timeout=10m \
        --transfers=14 \
        --drive-chunk-size=128M \
        --allow-other \
        --umask=027 \
        -vP \
        jelly-uniao:/ /home/jelly/Jellyfin
ExecStop=/usr/bin/fusermount -u /home/jelly/Jellyfin
Restart=on-failure
RestartSec=10
User=jelly

[Install]
WantedBy=multi-user.target

Now it created correctly, but the BACKUP did not create it, only on drive 06:

jelly@jellyfin2:~/Jellyfin$ mkdir boll
jelly@jellyfin2:~/Jellyfin$ ls
BKP  boll  test
jelly@jellyfin2:~/Jellyfin$ rclone lsd jelly-uniao:
          -1 2022-11-21 20:08:39        -1 BKP
          -7 2022-11-21 20:26:01        -1 boll
          -7 2022-11-21 20:22:07        -1 test
jelly@jellyfin2:~/Jellyfin$ rclone lsd jelly-start-crypt:
          -1 2022-11-21 20:26:01        -1 boll
          -1 2022-11-21 20:22:07        -1 test
jelly@jellyfin2:~/Jellyfin$ rclone lsd bkp-jelly-01-crypt:
          -1 2022-11-21 20:26:01        -1 boll
          -1 2022-11-21 20:22:07        -1 test
jelly@jellyfin2:~/Jellyfin$ rclone lsd bkp-jelly-02-crypt:
          -1 2022-11-21 20:26:01        -1 boll
          -1 2022-11-21 20:22:07        -1 test
jelly@jellyfin2:~/Jellyfin$ rclone lsd bkp-jelly-03-crypt:
          -1 2022-11-21 20:26:01        -1 boll
          -1 2022-11-21 20:22:07        -1 test
jelly@jellyfin2:~/Jellyfin$ rclone lsd bkp-jelly-04-crypt:
          -1 2022-11-21 20:08:39        -1 BKP
          -1 2022-11-21 20:26:01        -1 boll
          -1 2022-11-21 20:22:07        -1 test
jelly@jellyfin2:~/Jellyfin$ rclone lsd bkp-jelly-05-crypt:
          -1 2022-11-21 20:26:01        -1 boll
          -1 2022-11-21 20:22:07        -1 test
jelly@jellyfin2:~/Jellyfin$ rclone lsd bkp-jelly-06-crypt:
          -1 2022-11-21 20:26:01        -1 boll
          -1 2022-11-21 20:22:07        -1 test

jelly@jellyfin2:~/Jellyfin$ rclone -vv mkdir jelly-uniao:/BKP
2022/11/21 20:35:01 DEBUG : rclone: Version "v1.60.0" starting with parameters ["rclone" "-vv" "mkdir" "jelly-uniao:/BKP"]
2022/11/21 20:35:01 DEBUG : Creating backend with remote "jelly-uniao:/BKP"
2022/11/21 20:35:01 DEBUG : Using config file from "/home/jelly/.config/rclone/rclone.conf"
2022/11/21 20:35:01 DEBUG : Creating backend with remote "bkp-jelly-06-crypt:"
2022/11/21 20:35:01 DEBUG : Creating backend with remote "bkp-jelly-02-crypt:"
2022/11/21 20:35:01 DEBUG : Creating backend with remote "bkp-jelly-03-crypt:"
2022/11/21 20:35:01 DEBUG : Creating backend with remote "bkp-jelly-01-crypt:"
2022/11/21 20:35:01 DEBUG : Creating backend with remote "bkp-jelly-04-crypt:"
2022/11/21 20:35:01 DEBUG : Creating backend with remote "jelly-start-crypt:"
2022/11/21 20:35:01 DEBUG : Creating backend with remote "bkp-jelly-05-crypt:"
2022/11/21 20:35:02 DEBUG : Creating backend with remote "bkp-jelly-06:/"
2022/11/21 20:35:02 DEBUG : fs cache: renaming cache item "bkp-jelly-06:/" to be canonical "bkp-jelly-06:"
2022/11/21 20:35:02 DEBUG : Creating backend with remote "bkp-jelly-06-crypt:BKP"
2022/11/21 20:35:02 DEBUG : Creating backend with remote "jelly-start:/"
2022/11/21 20:35:02 DEBUG : fs cache: renaming cache item "jelly-start:/" to be canonical "jelly-start:"
2022/11/21 20:35:02 DEBUG : Creating backend with remote "jelly-start-crypt:BKP"
2022/11/21 20:35:02 DEBUG : Creating backend with remote "bkp-jelly-04:/"
2022/11/21 20:35:02 DEBUG : fs cache: renaming cache item "bkp-jelly-04:/" to be canonical "bkp-jelly-04:"
2022/11/21 20:35:02 DEBUG : Creating backend with remote "bkp-jelly-04-crypt:BKP"
2022/11/21 20:35:02 DEBUG : Creating backend with remote "bkp-jelly-05:/"
2022/11/21 20:35:02 DEBUG : fs cache: renaming cache item "bkp-jelly-05:/" to be canonical "bkp-jelly-05:"
2022/11/21 20:35:02 DEBUG : Creating backend with remote "bkp-jelly-05-crypt:BKP"
2022/11/21 20:35:02 DEBUG : Creating backend with remote "bkp-jelly-01:/"
2022/11/21 20:35:02 DEBUG : fs cache: renaming cache item "bkp-jelly-01:/" to be canonical "bkp-jelly-01:"
2022/11/21 20:35:02 DEBUG : Creating backend with remote "bkp-jelly-01-crypt:BKP"
2022/11/21 20:35:02 DEBUG : Creating backend with remote "bkp-jelly-02:/"
2022/11/21 20:35:02 DEBUG : fs cache: renaming cache item "bkp-jelly-02:/" to be canonical "bkp-jelly-02:"
2022/11/21 20:35:02 DEBUG : Creating backend with remote "bkp-jelly-02-crypt:BKP"
2022/11/21 20:35:02 DEBUG : Creating backend with remote "jelly-start:/fie3p9bdsvugpfppnllb0ghdps"
2022/11/21 20:35:02 DEBUG : Creating backend with remote "bkp-jelly-06:/524akva278fk77a5fefkmopong"
2022/11/21 20:35:02 DEBUG : Creating backend with remote "bkp-jelly-03:/"
2022/11/21 20:35:02 DEBUG : fs cache: renaming cache item "bkp-jelly-03:/" to be canonical "bkp-jelly-03:"
2022/11/21 20:35:02 DEBUG : Creating backend with remote "bkp-jelly-03-crypt:BKP"
2022/11/21 20:35:02 DEBUG : Creating backend with remote "bkp-jelly-05:/m9ids6i53f798tgmaqp1s11fh8"
2022/11/21 20:35:02 DEBUG : Creating backend with remote "bkp-jelly-02:/caqe22c7hhrfld6of7icadfvb4"
2022/11/21 20:35:02 DEBUG : Creating backend with remote "bkp-jelly-04:/77k0g1clc95mdd9ctn37bmuln8"
2022/11/21 20:35:02 DEBUG : Creating backend with remote "bkp-jelly-01:/vl79oi1pat6qtpbse0aett4984"
2022/11/21 20:35:02 DEBUG : Creating backend with remote "bkp-jelly-03:/mfavpfikpsr7nbetkbcrvb5uk4"
2022/11/21 20:35:02 DEBUG : fs cache: renaming cache item "bkp-jelly-01:/vl79oi1pat6qtpbse0aett4984" to be canonical "bkp-jelly-01:vl79oi1pat6qtpbse0aett4984"
2022/11/21 20:35:02 DEBUG : fs cache: switching user supplied name "bkp-jelly-01:/vl79oi1pat6qtpbse0aett4984" for canonical name "bkp-jelly-01:vl79oi1pat6qtpbse0aett4984"
2022/11/21 20:35:02 DEBUG : fs cache: renaming cache item "bkp-jelly-05:/m9ids6i53f798tgmaqp1s11fh8" to be canonical "bkp-jelly-05:m9ids6i53f798tgmaqp1s11fh8"
2022/11/21 20:35:02 DEBUG : fs cache: switching user supplied name "bkp-jelly-05:/m9ids6i53f798tgmaqp1s11fh8" for canonical name "bkp-jelly-05:m9ids6i53f798tgmaqp1s11fh8"
2022/11/21 20:35:02 DEBUG : fs cache: renaming cache item "bkp-jelly-02:/caqe22c7hhrfld6of7icadfvb4" to be canonical "bkp-jelly-02:caqe22c7hhrfld6of7icadfvb4"
2022/11/21 20:35:02 DEBUG : fs cache: switching user supplied name "bkp-jelly-02:/caqe22c7hhrfld6of7icadfvb4" for canonical name "bkp-jelly-02:caqe22c7hhrfld6of7icadfvb4"
2022/11/21 20:35:02 DEBUG : fs cache: renaming cache item "bkp-jelly-03:/mfavpfikpsr7nbetkbcrvb5uk4" to be canonical "bkp-jelly-03:mfavpfikpsr7nbetkbcrvb5uk4"
2022/11/21 20:35:02 DEBUG : fs cache: switching user supplied name "bkp-jelly-03:/mfavpfikpsr7nbetkbcrvb5uk4" for canonical name "bkp-jelly-03:mfavpfikpsr7nbetkbcrvb5uk4"
2022/11/21 20:35:02 DEBUG : fs cache: renaming cache item "bkp-jelly-04:/77k0g1clc95mdd9ctn37bmuln8" to be canonical "bkp-jelly-04:77k0g1clc95mdd9ctn37bmuln8"
2022/11/21 20:35:02 DEBUG : fs cache: switching user supplied name "bkp-jelly-04:/77k0g1clc95mdd9ctn37bmuln8" for canonical name "bkp-jelly-04:77k0g1clc95mdd9ctn37bmuln8"
2022/11/21 20:35:02 DEBUG : fs cache: renaming cache item "jelly-start:/fie3p9bdsvugpfppnllb0ghdps" to be canonical "jelly-start:fie3p9bdsvugpfppnllb0ghdps"
2022/11/21 20:35:02 DEBUG : fs cache: switching user supplied name "jelly-start:/fie3p9bdsvugpfppnllb0ghdps" for canonical name "jelly-start:fie3p9bdsvugpfppnllb0ghdps"
2022/11/21 20:35:02 DEBUG : fs cache: renaming cache item "bkp-jelly-06:/524akva278fk77a5fefkmopong" to be canonical "bkp-jelly-06:524akva278fk77a5fefkmopong"
2022/11/21 20:35:02 DEBUG : fs cache: switching user supplied name "bkp-jelly-06:/524akva278fk77a5fefkmopong" for canonical name "bkp-jelly-06:524akva278fk77a5fefkmopong"
2022/11/21 20:35:02 DEBUG : union root 'BKP': actionPolicy = *policy.EpAll, createPolicy = *policy.EpAll, searchPolicy = *policy.FF
2022/11/21 20:35:02 DEBUG : fs cache: renaming cache item "jelly-uniao:/BKP" to be canonical "jelly-uniao:BKP"
2022/11/21 20:35:02 DEBUG : union root 'BKP': Making directory
2022/11/21 20:35:03 DEBUG : Google drive root '': read info from Shared Drive "Jelly Start"
2022/11/21 20:35:03 DEBUG : Google drive root '': read info from Shared Drive "Backup DATA 05"
2022/11/21 20:35:03 DEBUG : Google drive root '': read info from Shared Drive "Backup DATA 04"
2022/11/21 20:35:03 DEBUG : Google drive root '': read info from Shared Drive "Backup DATA 06"
2022/11/21 20:35:03 DEBUG : Google drive root '': read info from Shared Drive "Backup DATA 01"
2022/11/21 20:35:03 DEBUG : Google drive root '': read info from Shared Drive "Backup DATA 02"
2022/11/21 20:35:03 DEBUG : Google drive root '': read info from Shared Drive "Backup DATA 03"
2022/11/21 20:35:05 DEBUG : Google drive root '': read info from Shared Drive "Backup DATA 06"
2022/11/21 20:35:05 DEBUG : Google drive root '': read info from Shared Drive "Backup DATA 04"
2022/11/21 20:35:05 DEBUG : Google drive root '': read info from Shared Drive "Backup DATA 02"
2022/11/21 20:35:05 DEBUG : 30 go routines active
jelly@jellyfin2:~/Jellyfin$ rclone lsd bkp-jelly-05-crypt:
          -1 2022-11-21 20:35:03        -1 BKP
jelly@jellyfin2:~/Jellyfin$ rclone lsd bkp-jelly-04-crypt:
          -1 2022-11-21 20:35:03        -1 BKP
jelly@jellyfin2:~/Jellyfin$ rclone lsd bkp-jelly-06-crypt:
          -1 2022-11-21 20:35:03        -1 BKP
2

Can you reproduce the issue with a debug log? That would be the important part to debug what's going on.

3

The problem only happens when it's mounted, how could I generate a log?
I put the file I use in systemd to mount.

4

add

--log-file /some/directory/rclone.log -vv

Recreate the issue and post a log file.

5

See: 2022/11/22 18:22:32 DEBUG : rclone: Version "v1.60.0" starting with parameters [ - Pastebin.com

Notice that the bola.txt file was not created on all drives, some gave an error saying that I exceeded the limit, but that doesn't make sense because on others I created it and then managed to create more files.

6

Google quotas are tough to work with as they aren't documented.

The error means you ran out of quota so you'd have to try later.

7

But as if I exceeded the quota if it was copied to the other drives and then I created another file and it was the same way, it was copied to some drives and others gave an error.

8

I'm not sure what you are trying to say.

The error say you ran out of quota so it did not copy.

9

I did a RAID 1, or something like that, if you notice the file was copied to some drives but not others. So I created another file and the process repeated. So how could it be a QUOTA issue with one drive and not the other?

10

I just report on the data.

You have one drive that had a quota error from your log file.

Not sure what else to say as that's the error from the log.

11

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.