New setup and lost some data

Help and Support
1

hi everyone

i had to change the disk on my nas and i installed the rclone again with same config

but my gcache is gone

and now i see i missing lost of data on gcrypt

is there a way to restore them ? or if i got the old gcache from old disk and copy/paste would help me ?

2

hi,
same config
same config file from the old disk or a new config file with the same settings?

please post all the following info so we can help you.

What is the problem you are having with rclone?

What is your rclone version (output from rclone version)

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Which cloud storage system are you using? (eg Google Drive)

The command you were trying to run (eg rclone copy /tmp remote:tmp)

Paste command here

The rclone config contents with secrets removed.

Paste config here

A log from the command with the -vv flag

Paste  log here
3

same config from old disk copied/pasted so same settings

What is the problem you are having with rclone?

i am missing lots of files on gcrypt after new setup

What is your rclone version

rclone v1.52.3

Which OS you are using and how many bits

synology nas os/arch: linux/amd64

Which cloud storage system are you using

google drive

The rclone config contents with secrets removed.

[gdrive]
type = drive
scope = drive
token = x
root_folder_id = x
client_id = x
client_secret = x

[gcache]
type = cache
remote = gdrive:
plex_url = http://192.168.178.25:32400
plex_username = x
plex_password = x
chunk_size = 5M
info_age = 2d
chunk_total_size = 10G
plex_token = x

[gcrypt]
type = crypt
remote = gcache:/Plex/crypt
filename_encryption = standard
directory_name_encryption = true
password = x
password2 = x

A log from the command with the -vv flag

i dont know how to get log ?

4

ok, same config file.

5

theres no any command im having issues.

i just mounted it and i see on webui theres files missing. is this because of gcache is gone you think ?

6

you are missing all the files on gcrypt or some of files on gcrypt?

can you post the mount command?

7

some files.

rclone mount gdrive: /volume1/rclone/gdrive --allow-other --allow-non-empty --daemon

rclone mount gcrypt: /volume1/rclone/plex --allow-other --allow-non-empty --daemon

8

you should remove --allow-non-empty

you should not need the cache to see the files, in fact, it is recommenced not to use the cache backend anymore
https://rclone.org/cache/#status

i could create a new remote named crypt2
[gcrypt2]
type = crypt
remote = gdrive:/Plex/crypt
filename_encryption = standard
directory_name_encryption = true
password = x
password2 = x

and do a ls gcrypt2:

9

do you think crypt2 would help me to reach lost data ?

10

we will not know until you try

11

yes it looks like all is back (will be sure later) now shall i remove from config file old crpyt? and how can i remove cache if its not necessary

12

glad i was able to help you get all the files back.

  • the gcache is just an entry in the config file, nothing to get rid of.
    tho you might want to be sure there are not an orphaned files in
    $HOME/.cache/rclone/cache-backend"

  • that cache backend is buggy, never left beta and soon to be replaced with a new cache.

13

thank you for your help unfortunately now rclone crashing my nas's connection while streaming up after crypt2. do you have an idea about this

14

you are welcome,

not sure what the means?

The command you were trying to run (eg rclone copy /tmp remote:tmp )

Paste command here

The rclone config contents with secrets removed.

Paste config here

A log from the command with the -vv flag

Paste  log here
15

when i start to upload files to upload all other downloads etc stops on my nas which runs on os

The command you were trying to run (eg rclone copy /tmp remote:tmp )

 rclone copy '/volume1/video' '/volume1/rclone/plex/testup' -P```

#### The rclone config contents with secrets removed.

[gdrive]
type = drive
scope = drive
token = x
root_folder_id = x
client_id = x
client_secret = x

[gcache]
type = cache
remote = gdrive:
plex_url = http://192.168.178.25:32400
plex_username = x
plex_password = x
chunk_size = 5M
info_age = 2d
chunk_total_size = 10G
plex_token = x

[gcrypt]
type = crypt
remote = gcache:/Plex/crypt
filename_encryption = standard
directory_name_encryption = true
password = x
password2 = x

[crypt2]
type = crypt
remote = gdrive:/Plex/crypt
filename_encryption = standard
directory_name_encryption = true
password = x
password2 = x


#### A log from the command with the  `-vv`  flag

rclone copy '/volume1/video' '/volume1/rclone/plex/testup' -P -vv2020/09/03 01:19:37 DEBUG : rclone: Version "v1.52.3" starting with parameters ["rclone" "copy" "/volume1/video" "/volume1/rclone/plex/testup" "-P" "-vv"]
2020/09/03 01:19:37 DEBUG : Using config file from "/var/services/homes/ENSAR/.config/rclone/rclone.conf"
2020-09-03 01:19:37 DEBUG : TransmissionVPN.zip: Sizes differ (src 16428959033 vs dst 41971712)
2020-09-03 01:19:37 DEBUG : PlexDVR.zip: Sizes differ (src 332115795930 vs dst 33583104)
2020-09-03 01:19:37 DEBUG : docker backup.zip: Sizes differ (src 7832873831 vs dst 25194496)
2020-09-03 01:19:37 DEBUG : haugene-transmission-openvpn1.json: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020-09-03 01:19:37 DEBUG : haugene-transmission-openvpn1.json: Unchanged skipping
2020-09-03 01:19:37 DEBUG : haugene-transmission-openvpn1.syno.json: Modification times differ by -941.555Āµs: 2020-09-02 15:46:52.046941555 +0200 CEST, 2020-09-02 15:46:52.046 +0200 CEST
2020-09-03 01:19:37 DEBUG : transmission-vpn-1.syno.json: Modification times differ by -671.037Āµs: 2020-09-02 16:49:44.612671037 +0200 CEST, 2020-09-02 16:49:44.612 +0200 CEST
2020-09-03 01:19:37 DEBUG : transmission-vpn.json: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020-09-03 01:19:37 DEBUG : transmission-vpn.json: Unchanged skipping
2020-09-03 01:19:37 DEBUG : preAllocate: got error on fallocate, trying combination 1/2: operation not supported
2020-09-03 01:19:37 DEBUG : preAllocate: got error on fallocate, trying combination 2/2: operation not supported
2020-09-03 01:19:37 DEBUG : TransmissionVPN/openvpn-credentials.txt: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020-09-03 01:19:37 DEBUG : TransmissionVPN/openvpn-credentials.txt: Unchanged skipping
2020-09-03 01:19:37 DEBUG : TransmissionVPN/resolv.conf: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020-09-03 01:19:37 DEBUG : TransmissionVPN/resolv.conf: Unchanged skipping
2020-09-03 01:19:37 DEBUG : TransmissionVPN/transmission-credentials.txt: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020-09-03 01:19:37 DEBUG : TransmissionVPN/transmission-credentials.txt: Unchanged skipping
2020-09-03 01:19:37 DEBUG : #recycle/desktop.ini: Modification times differ by -56.462Āµs: 2020-09-02 12:21:08.606056462 +0200 CEST, 2020-09-02 12:21:08.606 +0200 CEST
2020-09-03 01:19:38 DEBUG : TransmissionVPN/transmission-home/dht.dat: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020-09-03 01:19:38 DEBUG : TransmissionVPN/transmission-home/dht.dat: Unchanged skipping
2020-09-03 01:19:38 DEBUG : TransmissionVPN/transmission-home/settings.json.tmp.5Od6EX: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020-09-03 01:19:38 DEBUG : TransmissionVPN/transmission-home/settings.json.tmp.5Od6EX: Unchanged skipping
2020-09-03 01:19:38 DEBUG : TransmissionVPN/transmission-home/settings.json.tmp.KzXxRx: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020-09-03 01:19:38 DEBUG : TransmissionVPN/transmission-home/settings.json.tmp.KzXxRx: Unchanged skipping
2020-09-03 01:19:38 DEBUG : TransmissionVPN/transmission-home/settings.json.tmp.ZJ2tf8: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020-09-03 01:19:38 DEBUG : TransmissionVPN/transmission-home/stats.json: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020-09-03 01:19:38 DEBUG : TransmissionVPN/transmission-home/stats.json: Unchanged skipping
2020-09-03 01:19:38 DEBUG : TransmissionVPN/transmission-home/transmission.log: Sizes differ (src 613212113 vs dst 276852736)
2020-09-03 01:19:38 DEBUG : TransmissionVPN/transmission-home/settings.json.tmp.H48H8I: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020-09-03 01:19:38 DEBUG : TransmissionVPN/transmission-home/settings.json.tmp.H48H8I: Unchanged skipping
2020-09-03 01:19:38 DEBUG : TransmissionVPN/transmission-home/settings.json: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020-09-03 01:19:38 DEBUG : TransmissionVPN/transmission-home/settings.json: Unchanged skipping
2020-09-03 01:19:38 DEBUG : TransmissionVPN/transmission-home/settings.json.tmp.TIEGwL: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020-09-03 01:19:38 DEBUG : TransmissionVPN/transmission-home/settings.json.tmp.TIEGwL: Unchanged skipping
2020-09-03 01:19:38 DEBUG : TransmissionVPN/transmission-home/settings.json.tmp.ZJ2tf8: Unchanged skipping
2020-09-03 01:19:38 DEBUG : transmission-vpn-1.syno.json: MD5 = 5d031084b2f68b8e70a82637a9f00f7d OK
2020-09-03 01:19:38 DEBUG : haugene-transmission-openvpn1.syno.json: MD5 = f4aac6763a1f9908cbe3a92a9cbd4757 OK
2020-09-03 01:19:38 DEBUG : #recycle/desktop.ini: MD5 = 1b1b9ad5ea61182eb6797031e4a160aa OK
2020-09-03 01:19:38 DEBUG : TransmissionVPN/completed/shits/Baāštan Sona āšngilizce Eāšitimi - Sāšfāšrdan Baāšlayanlar āšĆ§in/15. Present and Past Tenses/1. Simple Present Tense.mp4: Sizes differ (src 30892465 vs dst 25194496)
2020-09-03 01:19:38 DEBUG : Local file system at /volume1/rclone/plex/testup: Waiting for checks to finish
2020-09-03 01:19:39 INFO : transmission-vpn-1.syno.json: Updated modification time in destination
2020-09-03 01:19:39 DEBUG : transmission-vpn-1.syno.json: Unchanged skipping
2020-09-03 01:19:39 INFO : haugene-transmission-openvpn1.syno.json: Updated modification time in destination
2020-09-03 01:19:39 DEBUG : haugene-transmission-openvpn1.syno.json: Unchanged skipping
2020-09-03 01:19:39 INFO : #recycle/desktop.ini: Updated modification time in destination
2020-09-03 01:19:39 DEBUG : #recycle/desktop.ini: Unchanged skipping
2020-09-03 01:19:39 DEBUG : Local file system at /volume1/rclone/plex/testup: Waiting for transfers to finish
Transferred: 336.109M / 347.202 GBytes, 0%, 6.569 MBytes/s, ETA 15h1m15s
Checks: 21 / 21, 100%
Transferred: 0 / 2732, 0%
Elapsed time: 51.1s
Transferring:

  •                               PlexDVR.zip:  0% /309.307G, 1.107M/s, 79h26

  •                         docker backup.zip:  0% /7.295G, 640.711k/s, 3h18m

  •                       TransmissionVPN.zip:  0% /15.301G, 625.782k/s, 7h6m
  • TransmissionVPN/transmā€¦-home/transmission.log: 39% /584.805M, 4.312M/s, 1m2
16

is there a rclone mount command?

17

rclone mount gdrive: /volume1/rclone/gdrive --allow-other --daemon

rclone mount crypt2: /volume1/rclone/plex --allow-other --daemon

18

the 'crash' is not from crypt2: but from the way you are using rclone.

really, that is not a good way to do what you want.

double use of rclone.

  1. two rclone mounts
  2. rclone copy between two rclone mounts.

if you want to copy files from gdrive: to gcrypt2:, no need for two mounts.
rclone copy gdrive: gcrypt2:

19

no im trying to upload files from nas to crypt and crypte comes out from last posts which u helpmed me.

so shall i delete from config file old gcrypt and gcache and only keep gdrive and crypt2 ? (sorry for my bad english)

20

your command are very confusing.

i will ask again, why are you using mounts to copy from cloud to cloud?
there is no need for two mounts and copying between those two mounts.

if you want to copy files from gdrive: to crypt2:, no need for two mounts.
rclone copy gdrive: crypt2: