Onedrive union as Backup destination for Synology

What is the problem you are having with rclone?

I have a Synology that I use as a NAS
As basically all my data is stored on the NAS I would like to back it up with Hyper Backup externally to Onedrive with multiple accounts and Office 365 (5Tb Space)

I have created a VM on my proxmox host with 4Gb storage and rclone running on it with this config

But the backup fails in this mounted directory

I tried creating the rclone config on another host and mount that one with Webdav, which worked for a couple Gigabytes but then it stopped working and does not continue

I tried with Borgmatic on the NAS too, but this fails too

Run the command 'rclone version' and share the full output of the command.

rclone v1.61.1

  • os/version: unknown
  • os/kernel: 3.2.101 (armv7l)
  • os/type: linux
  • os/arch: arm
  • go/version: go1.19.4
  • go/linking: static
  • go/tags: none

Latest version does not work with union on Synology

Which cloud storage system are you using? (eg Google Drive)

Onedrive union

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone mount --allow-non-empty --allow-other --dir-cache-time=72h --buffer-size=256M --attr-timeout=1s --vfs-read-chunk-size=128M --vfs-read-chunk-size-limit=off --vfs-cache-max-age=5m --vfs-cache-mode=writes  union:Backup/ /volume2/Rclone/Backup

The rclone config contents with secrets removed.

[Onedrive2]
type = onedrive
token = 
drive_id = 41d3b7b8e58c17bf
drive_type = personal

[Onedrive3]
type = onedrive
token = 
drive_id = f1a2f083fb024c01
drive_type = personal

[union]
type = union
upstreams = Onedrive:/ Onedrive1:/ Onedrive2:/ Onedrive3:/ Onedrive4:/

[chunker]
type = chunker
remote = union:
chunk_size = 100Mi

[combine]
type = combine
upstreams = dir=Onedrive2: dir2=Onedrive3:

[Onedrive]
type = onedrive
token = 
drive_id = 82cf6d5ba7cddee3
drive_type = personal

[Onedrive1]
type = onedrive
token = 
drive_id = 89089cd174a3bb9f
drive_type = personal

[Onedrive4]
type = onedrive
token = 
drive_id = a4ebd271bc1e912a
drive_type = personal


A log from the command with the -vv flag

2023/03/19 18:48:05 DEBUG : synobkpinfo.db(0x3683530): >close: err=<nil>
2023/03/19 18:48:05 DEBUG : &{synobkpinfo.db (rw)}: >Release: err=<nil>
2023/03/19 18:48:05 DEBUG : /: Attr:
2023/03/19 18:48:05 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwx------                                                                                                             , err=<nil>
2023/03/19 18:48:05 DEBUG : /: Lookup: name="last_status.conf"
2023/03/19 18:48:05 DEBUG : /: >Lookup: node=last_status.conf, err=<nil>
2023/03/19 18:48:05 DEBUG : last_status.conf: Attr:
2023/03/19 18:48:05 DEBUG : last_status.conf: >Attr: a=valid=1s ino=0 size=29 mo                                                                                                             de=-rw-------, err=<nil>
2023/03/19 18:48:05 DEBUG : last_status.conf: Open: flags=OpenReadOnly+0x20000
2023/03/19 18:48:05 DEBUG : last_status.conf: Open: flags=O_RDONLY|0x20000
2023/03/19 18:48:05 DEBUG : last_status.conf: >Open: fd=last_status.conf (r), er                                                                                                             r=<nil>
2023/03/19 18:48:05 DEBUG : last_status.conf: >Open: fh=&{last_status.conf (r)},                                                                                                              err=<nil>
2023/03/19 18:48:05 DEBUG : &{last_status.conf (r)}: Read: len=4096, offset=0
2023/03/19 18:48:05 DEBUG : last_status.conf: ChunkedReader.openRange at 0 lengt                                                                                                             h 134217728
2023/03/19 18:48:07 DEBUG : last_status.conf: ChunkedReader.Read at 0 length 409                                                                                                             6 chunkOffset 0 chunkSize 134217728
2023/03/19 18:48:07 DEBUG : &{last_status.conf (r)}: >Read: read=29, err=<nil>
2023/03/19 18:48:07 DEBUG : last_status.conf: Attr:
2023/03/19 18:48:07 DEBUG : last_status.conf: >Attr: a=valid=1s ino=0 size=29 mo                                                                                                             de=-rw-------, err=<nil>
2023/03/19 18:48:07 DEBUG : &{last_status.conf (r)}: Flush:
2023/03/19 18:48:07 DEBUG : &{last_status.conf (r)}: >Flush: err=<nil>
2023/03/19 18:48:07 DEBUG : &{last_status.conf (r)}: Release:
2023/03/19 18:48:07 DEBUG : last_status.conf: ReadFileHandle.Release closing
2023/03/19 18:48:07 DEBUG : &{last_status.conf (r)}: >Release: err=<nil>
2023/03/19 18:48:14 DEBUG : /: Attr:
2023/03/19 18:48:14 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwx------, err=<nil>
2023/03/19 18:48:14 DEBUG : /: Lookup: name="synobkpinfo.db"
2023/03/19 18:48:14 DEBUG : /: >Lookup: node=synobkpinfo.db, err=<nil>
2023/03/19 18:48:14 DEBUG : synobkpinfo.db: Attr:
2023/03/19 18:48:14 DEBUG : synobkpinfo.db: >Attr: a=valid=1s ino=0 size=12288 mode=-rw-------, err=<nil>
2023/03/19 18:48:14 DEBUG : synobkpinfo.db: Open: flags=OpenReadWrite+0xa0000
2023/03/19 18:48:14 DEBUG : synobkpinfo.db: Open: flags=O_RDWR|0xA0000
2023/03/19 18:48:14 DEBUG : synobkpinfo.db: newRWFileHandle:
2023/03/19 18:48:14 DEBUG : synobkpinfo.db: >newRWFileHandle: err=<nil>
2023/03/19 18:48:14 DEBUG : synobkpinfo.db: >Open: fd=synobkpinfo.db (rw), err=<nil>
2023/03/19 18:48:14 DEBUG : synobkpinfo.db: >Open: fh=&{synobkpinfo.db (rw)}, err=<nil>
2023/03/19 18:48:14 DEBUG : &{synobkpinfo.db (rw)}: Read: len=12288, offset=0
2023/03/19 18:48:14 DEBUG : synobkpinfo.db(0x3844ed0): _readAt: size=12288, off=0
2023/03/19 18:48:14 DEBUG : synobkpinfo.db(0x3844ed0): openPending:
2023/03/19 18:48:14 DEBUG : synobkpinfo.db: vfs cache: checking remote fingerprint "12288,2023-03-19 17:17:53 +0000 UTC,8091c764c33cd01cb0aa6bdd24517d4a8573df17" against cached fingerprint "12288,2023-03-19 17:17:53 +0000 UTC,8091c764c33cd01cb0aa6bdd24517d4a8573df17"
2023/03/19 18:48:14 DEBUG : synobkpinfo.db: vfs cache: truncate to size=12288 (not needed as size correct)
2023/03/19 18:48:14 DEBUG : : Added virtual directory entry vAddFile: "synobkpinfo.db"
2023/03/19 18:48:14 DEBUG : synobkpinfo.db(0x3844ed0): >openPending: err=<nil>
2023/03/19 18:48:14 DEBUG : vfs cache: looking for range={Pos:0 Size:12288} in [{Pos:0 Size:12288}] - present true
2023/03/19 18:48:14 DEBUG : synobkpinfo.db(0x3844ed0): >_readAt: n=12288, err=<nil>
2023/03/19 18:48:14 DEBUG : &{synobkpinfo.db (rw)}: >Read: read=12288, err=<nil>
2023/03/19 18:48:14 DEBUG : /: Lookup: name="synobkpinfo.db-journal"
2023/03/19 18:48:14 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2023/03/19 18:48:14 DEBUG : /: Lookup: name="synobkpinfo.db-wal"
2023/03/19 18:48:14 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2023/03/19 18:48:14 DEBUG : synobkpinfo.db: Attr:
2023/03/19 18:48:14 DEBUG : synobkpinfo.db: >Attr: a=valid=1s ino=0 size=12288 mode=-rw-------, err=<nil>
2023/03/19 18:48:14 DEBUG : /: Lookup: name="synobkpinfo.db-journal"
2023/03/19 18:48:14 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2023/03/19 18:48:14 DEBUG : /: Lookup: name="synobkpinfo.db-wal"
2023/03/19 18:48:14 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2023/03/19 18:48:14 DEBUG : /: Lookup: name="synobkpinfo.db-journal"
2023/03/19 18:48:14 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2023/03/19 18:48:14 DEBUG : /: Lookup: name="synobkpinfo.db-wal"
2023/03/19 18:48:14 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2023/03/19 18:48:14 DEBUG : /: Lookup: name="synobkpinfo.db-journal"
2023/03/19 18:48:14 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2023/03/19 18:48:14 DEBUG : /: Lookup: name="synobkpinfo.db-wal"
2023/03/19 18:48:14 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2023/03/19 18:48:14 DEBUG : /: Lookup: name="synobkpinfo.db-journal"
2023/03/19 18:48:14 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2023/03/19 18:48:14 DEBUG : /: Lookup: name="synobkpinfo.db-wal"
2023/03/19 18:48:14 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2023/03/19 18:48:14 DEBUG : /: Lookup: name="synobkpinfo.db-journal"
2023/03/19 18:48:14 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2023/03/19 18:48:14 DEBUG : /: Lookup: name="synobkpinfo.db-wal"
2023/03/19 18:48:14 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2023/03/19 18:48:14 DEBUG : /: Lookup: name="synobkpinfo.db-journal"
2023/03/19 18:48:14 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2023/03/19 18:48:14 DEBUG : /: Lookup: name="synobkpinfo.db-wal"
2023/03/19 18:48:14 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2023/03/19 18:48:14 DEBUG : /: Lookup: name="synobkpinfo.db-journal"
2023/03/19 18:48:14 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2023/03/19 18:48:14 DEBUG : /: Lookup: name="synobkpinfo.db-wal"
2023/03/19 18:48:14 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2023/03/19 18:48:14 DEBUG : &{synobkpinfo.db (rw)}: Flush:
2023/03/19 18:48:14 DEBUG : synobkpinfo.db(0x3844ed0): RWFileHandle.Flush
2023/03/19 18:48:14 DEBUG : &{synobkpinfo.db (rw)}: >Flush: err=<nil>
2023/03/19 18:48:14 DEBUG : &{synobkpinfo.db (rw)}: Release:
2023/03/19 18:48:14 DEBUG : synobkpinfo.db(0x3844ed0): RWFileHandle.Release
2023/03/19 18:48:14 DEBUG : /: Lookup: name="last_status.conf"
2023/03/19 18:48:14 DEBUG : synobkpinfo.db(0x3844ed0): close:
2023/03/19 18:48:14 DEBUG : /: >Lookup: node=last_status.conf, err=<nil>
2023/03/19 18:48:14 DEBUG : last_status.conf: Attr:
2023/03/19 18:48:14 DEBUG : last_status.conf: >Attr: a=valid=1s ino=0 size=29 mode=-rw-------, err=<nil>
2023/03/19 18:48:14 DEBUG : synobkpinfo.db: vfs cache: setting modification time to 2023-03-19 17:17:53 +0000 UTC
2023/03/19 18:48:14 DEBUG : synobkpinfo.db(0x3844ed0): >close: err=<nil>
2023/03/19 18:48:14 DEBUG : &{synobkpinfo.db (rw)}: >Release: err=<nil>
2023/03/19 18:48:14 DEBUG : last_status.conf: Open: flags=OpenReadOnly+0x20000
2023/03/19 18:48:14 DEBUG : last_status.conf: Open: flags=O_RDONLY|0x20000
2023/03/19 18:48:14 DEBUG : last_status.conf: >Open: fd=last_status.conf (r), err=<nil>
2023/03/19 18:48:14 DEBUG : last_status.conf: >Open: fh=&{last_status.conf (r)}, err=<nil>
2023/03/19 18:48:14 DEBUG : &{last_status.conf (r)}: Read: len=4096, offset=0
2023/03/19 18:48:14 DEBUG : last_status.conf: ChunkedReader.openRange at 0 length 134217728
2023/03/19 18:48:15 DEBUG : last_status.conf: ChunkedReader.Read at 0 length 4096 chunkOffset 0 chunkSize 134217728
2023/03/19 18:48:15 DEBUG : &{last_status.conf (r)}: >Read: read=29, err=<nil>
2023/03/19 18:48:15 DEBUG : last_status.conf: Attr:
2023/03/19 18:48:15 DEBUG : last_status.conf: >Attr: a=valid=1s ino=0 size=29 mode=-rw-------, err=<nil>
2023/03/19 18:48:15 DEBUG : &{last_status.conf (r)}: Flush:
2023/03/19 18:48:15 DEBUG : &{last_status.conf (r)}: >Flush: err=<nil>
2023/03/19 18:48:15 DEBUG : &{last_status.conf (r)}: Release:
2023/03/19 18:48:15 DEBUG : last_status.conf: ReadFileHandle.Release closing
2023/03/19 18:48:15 DEBUG : &{last_status.conf (r)}: >Release: err=<nil>

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.