Combined remotes - moving directory within different remotes fails

akuropka · March 6, 2024, 11:13am

What are you trying to do?

Moving a folder from one remote to another.

It works within a combined remote with the rclone move command.
It works while the remotes are separately mounted (using rclone mount for each remote and then mv).

What is the problem you are having with rclone?

Moving a folder within two remotes while mounted as combined throws an e/a-error.
Moving a file or copying a folder this way works.

What is your rclone version (output from `rclone version`)

rclone v1.65.2
- os/version: arch (64 bit)
- os/kernel: 6.6.18-1-rpi-16k (aarch64)
- os/type: linux
- os/arch: arm64 (ARMv8 compatible)
- go/version: go1.21.7
- go/linking: dynamic
- go/tags: none

Which cloud storage systems are you using?

Dropbox, OneDrive, pCloud

The command you were trying to run

root@raspberry ~ # rclone mount cloud: /mnt/cloud
root@raspberry ~ # mv /mnt/cloud/pcloud/8 /mnt/cloud/dropbox/

A log from the command with the `-vv` flag

2024/03/06 10:08:28 DEBUG : rclone: Version "v1.65.2" starting with parameters ["rclone" "mount" "cloud:" "/mnt/cloud" "--config" "/etc/rclone.conf" "--log-level" "DEBUG" "--vfs-cache-mode" "writes"]
2024/03/06 10:08:28 DEBUG : Creating backend with remote "cloud:"
2024/03/06 10:08:28 DEBUG : Using config file from "/etc/rclone.conf"
2024/03/06 10:08:28 DEBUG : Creating backend with remote "pcloud:"
2024/03/06 10:08:28 DEBUG : Creating backend with remote "dropbox:"
2024/03/06 10:08:28 DEBUG : Creating backend with remote "onedrive:"
2024/03/06 10:08:29 DEBUG : vfs cache: root is "/root/.cache/rclone"
2024/03/06 10:08:29 DEBUG : vfs cache: data root is "/root/.cache/rclone/vfs/cloud"
2024/03/06 10:08:29 DEBUG : vfs cache: metadata root is "/root/.cache/rclone/vfsMeta/cloud"
2024/03/06 10:08:29 DEBUG : Creating backend with remote "/root/.cache/rclone/vfs/cloud/"
2024/03/06 10:08:29 DEBUG : fs cache: renaming cache item "/root/.cache/rclone/vfs/cloud/" to be canonical "/root/.cache/rclone/vfs/cloud"
2024/03/06 10:08:29 DEBUG : Creating backend with remote "/root/.cache/rclone/vfsMeta/cloud/"
2024/03/06 10:08:29 DEBUG : fs cache: renaming cache item "/root/.cache/rclone/vfsMeta/cloud/" to be canonical "/root/.cache/rclone/vfsMeta/cloud"
2024/03/06 10:08:29 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2024/03/06 10:08:29 DEBUG : combine root '': Mounting on "/mnt/cloud"
2024/03/06 10:08:29 DEBUG : : Root:
2024/03/06 10:08:29 DEBUG : : >Root: node=/, err=
2024/03/06 10:08:30 DEBUG : OneDrive root '': Next delta token is: NDslMjM0OyUyMzE7Mzs1M2NmZmNmZC0zOGQwLTQwNDYtODZkOC01OTdlNWMwN2U0YTY7NjM4NDUzMTI5MDk5NjMwMDAwOzg1Nzc1NzE2OyUyMzslMjM7JTIzMDslMjM
2024/03/06 10:08:35 DEBUG : /: Lookup: name="pcloud"
2024/03/06 10:08:35 DEBUG : /: >Lookup: node=pcloud/, err=
2024/03/06 10:08:35 DEBUG : pcloud/: Attr:
2024/03/06 10:08:35 DEBUG : pcloud/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=
2024/03/06 10:08:35 DEBUG : pcloud/: Lookup: name="8"
2024/03/06 10:08:35 DEBUG : pcloud/: >Lookup: node=pcloud/8/, err=
2024/03/06 10:08:35 DEBUG : pcloud/8/: Attr:
2024/03/06 10:08:35 DEBUG : pcloud/8/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=
2024/03/06 10:08:35 DEBUG : /: Lookup: name="dropbox"
2024/03/06 10:08:35 DEBUG : /: >Lookup: node=dropbox/, err=
2024/03/06 10:08:35 DEBUG : dropbox/: Attr:
2024/03/06 10:08:35 DEBUG : dropbox/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=
2024/03/06 10:08:35 DEBUG : dropbox/: Lookup: name="8"
2024/03/06 10:08:36 DEBUG : dropbox/: >Lookup: node=, err=no such file or directory
2024/03/06 10:08:36 DEBUG : dropbox/: Lookup: name="8"
2024/03/06 10:08:36 DEBUG : dropbox/: >Lookup: node=, err=no such file or directory
2024/03/06 10:08:36 DEBUG : dropbox/: Lookup: name="8"
2024/03/06 10:08:36 DEBUG : dropbox/: >Lookup: node=, err=no such file or directory
2024/03/06 10:08:36 DEBUG : pcloud/: Rename: oldName="8", newName="8", newDir=dropbox/
2024/03/06 10:08:36 NOTICE: Dropbox root '': srcU.f=pcloud root '', srcURemote="8", dstURemote="8"
2024/03/06 10:08:36 DEBUG : : Can't move directory - not same remote type
2024/03/06 10:08:36 ERROR : pcloud/8: Dir.Rename error: can't move directory - incompatible remotes
2024/03/06 10:08:36 ERROR : IO error: can't move directory - incompatible remotes
2024/03/06 10:08:36 DEBUG : pcloud/: >Rename: err=can't move directory - incompatible remotes
2024/03/06 10:08:36 DEBUG : dropbox/: Lookup: name="8"
2024/03/06 10:08:36 DEBUG : dropbox/: >Lookup: node=, err=no such file or directory

Additional information

The folder exists on source but not destination:

root@raspberry ~ # ls -al /mnt/cloud/pcloud/8
insgesamt 1750
drwxr-xr-x 1 root root 0 6. Mär 09:51 .
drwxr-xr-x 1 root root 0 6. Mär 10:12 ..
-rw-r--r-- 1 root root 666846 6. Mär 09:51 Freunde.jpg
-rw-r--r-- 1 root root 189628 6. Mär 09:52 Glueckliche-familie.jpg
-rw-r--r-- 1 root root 32905 6. Mär 09:51 Im-himmel.jpg
-rw-r--r-- 1 root root 500130 6. Mär 09:51 Liebhaber.jpg
-rw-r--r-- 1 root root 238222 6. Mär 09:51 Romantik.jpg
-rw-r--r-- 1 root root 162388 6. Mär 09:51 Suessigkeiten.jpg
root@raspberry ~ # ls -al /mnt/cloud/dropbox/8
ls: Zugriff auf '/mnt/cloud/dropbox/8' nicht möglich: Datei oder Verzeichnis nicht gefunden

kapitainsky · March 6, 2024, 12:09pm

Could you also run:

$ rclone config redacted

and post output

akuropka · March 6, 2024, 1:54pm

Nothing special with that...

[cloud]
type = combine
upstreams = dropbox=dropbox: onedrive=onedrive: pcloud=pcloud:

[dropbox]
type = dropbox
token = XXX

[onedrive]
type = onedrive
token = XXX
drive_id = XXX
drive_type = personal

[pcloud]
type = pcloud
token = XXX
hostname = eapi.pcloud.com

kapitainsky · March 6, 2024, 2:00pm

I think the problem is that you are combining root directories of your remotes.

You can test it by changing your upstreams to:

upstreams = dropbox=dropbox:test onedrive=onedrive:test pcloud=pcloud:test

and then trying to move some data.

Possibly there is already fix in the pipeline:

github.com/rclone/rclone

`combine`: fix `CopyDirMetadata` error on upstream root

rclone:master ← nielash:fix-combine-copydirmeta

opened 08:52AM - 04 Mar 24 UTC

nielash

+31 -9

#### What is the purpose of this change? `operations.CopyDirMetadata` was fai…ling with: ``` internal error: expecting directory string from combine root '' to have SetMetadata method: optional feature not implemented ``` if the `dst` was the root directory of a `combine` upstream. This is because combine was returning a `*fs.Dir`, which does not satisfy the `fs.SetMetadataer` interface. Here's one proposed solution, but feel free to toss it if you have a different one in mind 🙂 Also, I didn't check, but it seems possible that Union and other similar backends might need a similar fix. #### Was the change discussed in an issue or in the forum before? No, I just noticed it tonight. #### Checklist - [x] I have read the [contribution guidelines](https://github.com/rclone/rclone/blob/master/CONTRIBUTING.md#submitting-a-new-feature-or-bug-fix). - [ ] I have added tests for all changes in this PR if appropriate. - [x] I have added documentation for the changes if appropriate. - [x] All commit messages are in [house style](https://github.com/rclone/rclone/blob/master/CONTRIBUTING.md#commit-messages). - [x] I'm done, this Pull Request is ready for review :-)

@nielash - do you think your PR covers this case?

akuropka · March 6, 2024, 2:21pm

Result is the same...

Config:

[cloud]
type = combine
upstreams = dropbox=dropbox:test onedrive=onedrive:test pcloud=pcloud:test

[dropbox]
type = dropbox
token = XXX

[onedrive]
type = onedrive
token = XXX
drive_id = XXX
drive_type = personal

[pcloud]
type = pcloud
token = XXX
hostname = eapi.pcloud.com

Log:

2024/03/06 15:16:13 DEBUG : rclone: Version "v1.65.2" starting with parameters ["rclone" "mount" "cloud:" "/mnt/cloud" "--config" "/etc/rclone.conf" "--log-level" "DEBUG" "--vfs-cache-mode" "writes"]
2024/03/06 15:16:13 DEBUG : Creating backend with remote "cloud:"
2024/03/06 15:16:13 DEBUG : Using config file from "/etc/rclone.conf"
2024/03/06 15:16:13 DEBUG : Creating backend with remote "pcloud:test"
2024/03/06 15:16:13 DEBUG : Creating backend with remote "onedrive:test"
2024/03/06 15:16:13 DEBUG : onedrive: Loaded invalid token from config file - ignoring
2024/03/06 15:16:13 DEBUG : Creating backend with remote "dropbox:test"
2024/03/06 15:16:18 DEBUG : Saving config "token" in section "onedrive" of the config file
2024/03/06 15:16:18 DEBUG : onedrive: Saved new token in config file
2024/03/06 15:16:19 DEBUG : vfs cache: root is "/root/.cache/rclone"
2024/03/06 15:16:19 DEBUG : vfs cache: data root is "/root/.cache/rclone/vfs/cloud"
2024/03/06 15:16:19 DEBUG : vfs cache: metadata root is "/root/.cache/rclone/vfsMeta/cloud"
2024/03/06 15:16:19 DEBUG : Creating backend with remote "/root/.cache/rclone/vfs/cloud/"
2024/03/06 15:16:19 DEBUG : fs cache: renaming cache item "/root/.cache/rclone/vfs/cloud/" to be canonical "/root/.cache/rclone/vfs/cloud"
2024/03/06 15:16:19 DEBUG : Creating backend with remote "/root/.cache/rclone/vfsMeta/cloud/"
2024/03/06 15:16:19 DEBUG : fs cache: renaming cache item "/root/.cache/rclone/vfsMeta/cloud/" to be canonical "/root/.cache/rclone/vfsMeta/cloud"
2024/03/06 15:16:19 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2024/03/06 15:16:19 DEBUG : combine root '': Mounting on "/mnt/cloud"
2024/03/06 15:16:19 DEBUG : : Root:
2024/03/06 15:16:19 DEBUG : : >Root: node=/, err=<nil>
2024/03/06 15:16:19 DEBUG : OneDrive root 'test': Next delta token is: NDslMjM0OyUyMzE7Mzs1M2NmZmNmZC0zOGQwLTQwNDYtODZkOC01OTdlNWMwN2U0YTY7NjM4NDUzMzEzNzk0OTAwMDAwOzg2MzQ2MjU0OyUyMzslMjM7JTIzMDslMjM
2024/03/06 15:16:46 DEBUG : /: Lookup: name="dropbox"
2024/03/06 15:16:46 DEBUG : /: >Lookup: node=dropbox/, err=<nil>
2024/03/06 15:16:46 DEBUG : dropbox/: Attr:
2024/03/06 15:16:46 DEBUG : dropbox/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2024/03/06 15:16:46 DEBUG : dropbox/: Lookup: name="1"
2024/03/06 15:16:46 DEBUG : dropbox/: >Lookup: node=dropbox/1/, err=<nil>
2024/03/06 15:16:46 DEBUG : dropbox/1/: Attr:
2024/03/06 15:16:46 DEBUG : dropbox/1/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2024/03/06 15:16:46 DEBUG : /: Lookup: name="pcloud"
2024/03/06 15:16:46 DEBUG : /: >Lookup: node=pcloud/, err=<nil>
2024/03/06 15:16:46 DEBUG : pcloud/: Attr:
2024/03/06 15:16:46 DEBUG : pcloud/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2024/03/06 15:16:46 DEBUG : pcloud/: Lookup: name="1"
2024/03/06 15:16:46 DEBUG : pcloud/: >Lookup: node=<nil>, err=no such file or directory
2024/03/06 15:16:46 DEBUG : pcloud/: Lookup: name="1"
2024/03/06 15:16:46 DEBUG : pcloud/: >Lookup: node=<nil>, err=no such file or directory
2024/03/06 15:16:46 DEBUG : pcloud/: Lookup: name="1"
2024/03/06 15:16:46 DEBUG : pcloud/: >Lookup: node=<nil>, err=no such file or directory
2024/03/06 15:16:46 DEBUG : dropbox/: Rename: oldName="1", newName="1", newDir=pcloud/
2024/03/06 15:16:46 NOTICE: pcloud root 'test': srcU.f=Dropbox root 'test', srcURemote="1", dstURemote="1"
2024/03/06 15:16:46 DEBUG : <nil>: Can't move directory - not same remote type
2024/03/06 15:16:46 ERROR : dropbox/1: Dir.Rename error: can't move directory - incompatible remotes
2024/03/06 15:16:46 ERROR : IO error: can't move directory - incompatible remotes
2024/03/06 15:16:46 DEBUG : dropbox/: >Rename: err=can't move directory - incompatible remotes
2024/03/06 15:16:46 DEBUG : pcloud/: Lookup: name="1"
2024/03/06 15:16:46 DEBUG : pcloud/: >Lookup: node=<nil>, err=no such file or directory

Contents in remote storage:

root@raspberry ~ # ls -al /mnt/cloud/dropbox
insgesamt 0
drwxr-xr-x 1 root root 0  6. Mär 15:19 .
drwxr-xr-x 1 root root 0  6. Mär 15:19 ..
drwxr-xr-x 1 root root 0  1. Jan 2000  1
root@raspberry ~ # ls -al /mnt/cloud/pcloud
insgesamt 0
drwxr-xr-x 1 root root 0  6. Mär 15:19 .
drwxr-xr-x 1 root root 0  6. Mär 15:19 ..

Command executed:

root@raspberry ~ # mv /mnt/cloud/dropbox/1 /mnt/cloud/pcloud/

asdffdsa · March 6, 2024, 2:38pm

might be related to Combined remotes - moving directory within different remotes fails

akuropka · March 6, 2024, 2:44pm

@asdffdsa, definitely since you referred to exactly this thread.

asdffdsa · March 6, 2024, 2:51pm

ok, here is the correct thread
Dropbox: IO error: MoveDir failed: from_lookup/not_found/ when try to move (copy works)

akuropka · March 6, 2024, 3:16pm

Not sure... semms at least having something in common. But mine is not related to any special folders are just limited to a certain cloud storage provider.

I did further tests, mv works from remote to local, from local to remote and within one remote. Just not between two combined remotes.

Since it works once both remotes are mounted separately it must be related to the combined mechanism.

nielash · March 6, 2024, 4:45pm

I don't think so, as mine fixes an issue that is new in v1.66 (OP is using v1.65.2.)

This one does look possibly related... are you able to do what ncw suggested here? I agree it would be helpful for debugging:

Another thing that would be helpful to try is doing rclone move on the combine remote when NOT mounted. This could help narrow down whether the issue is in combine or in the VFS.

akuropka · March 6, 2024, 4:53pm

Since it is moving from one remote to another the folder (and files within) are already uploaded or how is this to be understood?

rclone move without mounting works.

Doing cp and rm instead of mv works as well.

nielash · March 6, 2024, 5:02pm

What is supposed to happen is that combine will realize it can't server-side move (because the upstreams are different), and then fall back to regular move (copy + delete). There is a more detailed explanation here if you are interested.

Ok, very likely a VFS bug then. If it's possible to make a reproducible example, I can try to debug it.

I'm also wondering if it's specific to Dropbox? For example, does the same thing happen when trying to move from onedrive to pcloud?

akuropka · March 6, 2024, 5:19pm

So it seems the fallback to copy and delete does not happen, at least I can’t find anything related in the debug log.

I’ve tested it with all three providers (Dropbox, OneDrive, pCloud) and any combination of source and destination out of those fails.

nielash · March 6, 2024, 5:49pm

Wait, I think I see the issue...

There are two similar functions that do similar things: operations.DirMove (used by VFS) and sync.MoveDir (used by rclone move). They check for server-side-move support in different ways.

MoveDir checks by just trying it and seeing what error comes back:

github.com

rclone/rclone/blob/fd8faeb0e6289f6b56699c3fceb102f449d3de53/fs/sync/sync.go#L1360-L1363


      
          		err := fdstDirMove(ctx, fsrc, "", "")
          		switch err {
          		case fs.ErrorCantDirMove, fs.ErrorDirExists:
          			fs.Infof(fdst, "Server side directory move failed - fallback to file moves: %v", err)

This works fine for combine because combine returns fs.ErrorCantDirMove which MoveDir understands what to do with.

DirMove, however, just checks if the function pointer is nil:

github.com

rclone/rclone/blob/fd8faeb0e6289f6b56699c3fceb102f449d3de53/fs/operations/operations.go#L2266-L2273


      
          	// Use DirMove if possible
          	if doDirMove := f.Features().DirMove; doDirMove != nil {
          		err = doDirMove(ctx, f, srcRemote, dstRemote)
          		if err == nil {
          			accounting.Stats(ctx).Renames(1)
          		}
          		return err
          	}

This one gets fooled by combine, because combine does advertise support for DirMove, despite not always being able to do it.

I think I know how this could be fixed. If I send a branch with a patch would you be able to build it and give it a try?

akuropka · March 6, 2024, 6:03pm

Thank you for your support!

nielash · March 6, 2024, 6:30pm

Ok give this a try:

akuropka · March 6, 2024, 7:05pm

Hi @nielash,
it works! Thank you very much!!!

Log:

2024/03/06 21:14:29 DEBUG : rclone: Version "v1.66.0-DEV" starting with parameters ["rclone" "mount" "cloud:" "/mnt/cloud" "--config" "/etc/rclone.conf" "--log-level" "DEBUG" "--vfs-cache-mode" "writes"]
2024/03/06 21:14:29 DEBUG : Creating backend with remote "cloud:"
2024/03/06 21:14:29 DEBUG : Using config file from "/etc/rclone.conf"
2024/03/06 21:14:29 DEBUG : Creating backend with remote "pcloud:"
2024/03/06 21:14:29 DEBUG : Creating backend with remote "onedrive:"
2024/03/06 21:14:29 DEBUG : Creating backend with remote "dropbox:"
2024/03/06 21:14:31 DEBUG : vfs cache: root is "/root/.cache/rclone"
2024/03/06 21:14:31 DEBUG : vfs cache: data root is "/root/.cache/rclone/vfs/cloud"
2024/03/06 21:14:31 DEBUG : vfs cache: metadata root is "/root/.cache/rclone/vfsMeta/cloud"
2024/03/06 21:14:31 DEBUG : Creating backend with remote "/root/.cache/rclone/vfs/cloud/"
2024/03/06 21:14:31 DEBUG : fs cache: renaming cache item "/root/.cache/rclone/vfs/cloud/" to be canonical "/root/.cache/rclone/vfs/cloud"
2024/03/06 21:14:31 DEBUG : Creating backend with remote "/root/.cache/rclone/vfsMeta/cloud/"
2024/03/06 21:14:31 DEBUG : fs cache: renaming cache item "/root/.cache/rclone/vfsMeta/cloud/" to be canonical "/root/.cache/rclone/vfsMeta/cloud"
2024/03/06 21:14:31 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2024/03/06 21:14:31 DEBUG : combine root '': Mounting on "/mnt/cloud"
2024/03/06 21:14:31 DEBUG : : Root:
2024/03/06 21:14:31 DEBUG : : >Root: node=/, err=<nil>
2024/03/06 21:14:31 DEBUG : OneDrive root '': Next delta token is: NDslMjM0OyUyMzE7Mzs1M2NmZmNmZC0zOGQwLTQwNDYtODZkOC01OTdlNWMwN2U0YTY7NjM4NDUzNTI4NzE0NTcwMDAwOzg3MDU0NzQwOyUyMzslMjM7JTIzMDslMjM
2024/03/06 21:14:53 DEBUG : /: Lookup: name="dropbox"
2024/03/06 21:14:53 DEBUG : /: >Lookup: node=dropbox/, err=<nil>
2024/03/06 21:14:53 DEBUG : dropbox/: Attr:
2024/03/06 21:14:53 DEBUG : dropbox/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2024/03/06 21:14:53 DEBUG : dropbox/: Lookup: name="Apps"
2024/03/06 21:14:54 DEBUG : dropbox/: >Lookup: node=dropbox/Apps/, err=<nil>
2024/03/06 21:14:54 DEBUG : dropbox/Apps/: Attr:
2024/03/06 21:14:54 DEBUG : dropbox/Apps/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2024/03/06 21:14:54 DEBUG : dropbox/Apps/: Lookup: name="GoodNotes 5"
2024/03/06 21:14:54 DEBUG : dropbox/Apps/: >Lookup: node=dropbox/Apps/GoodNotes 5/, err=<nil>
2024/03/06 21:14:54 DEBUG : dropbox/Apps/GoodNotes 5/: Attr:
2024/03/06 21:14:54 DEBUG : dropbox/Apps/GoodNotes 5/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2024/03/06 21:14:54 DEBUG : dropbox/Apps/GoodNotes 5/: Lookup: name="Max"
2024/03/06 21:14:55 DEBUG : dropbox/Apps/GoodNotes 5/: >Lookup: node=dropbox/Apps/GoodNotes 5/Max/, err=<nil>
2024/03/06 21:14:55 DEBUG : dropbox/Apps/GoodNotes 5/Max/: Attr:
2024/03/06 21:14:55 DEBUG : dropbox/Apps/GoodNotes 5/Max/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2024/03/06 21:14:55 DEBUG : /: Lookup: name="dropbox"
2024/03/06 21:14:55 DEBUG : /: >Lookup: node=dropbox/, err=<nil>
2024/03/06 21:14:55 DEBUG : dropbox/: Attr:
2024/03/06 21:14:55 DEBUG : dropbox/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2024/03/06 21:14:55 DEBUG : : Statfs:
2024/03/06 21:14:56 DEBUG : : >Statfs: stat={Blocks:14352384 Bfree:11843659 Bavail:11843659 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=<nil>
2024/03/06 21:14:56 DEBUG : /: Lookup: name="dropbox"
2024/03/06 21:14:56 DEBUG : /: >Lookup: node=dropbox/, err=<nil>
2024/03/06 21:14:56 DEBUG : dropbox/: Attr:
2024/03/06 21:14:56 DEBUG : dropbox/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2024/03/06 21:14:56 DEBUG : dropbox/: Lookup: name="Apps"
2024/03/06 21:14:56 DEBUG : dropbox/: >Lookup: node=dropbox/Apps/, err=<nil>
2024/03/06 21:14:56 DEBUG : dropbox/Apps/: Attr:
2024/03/06 21:14:56 DEBUG : dropbox/Apps/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2024/03/06 21:14:56 DEBUG : dropbox/Apps/: Lookup: name="GoodNotes 5"
2024/03/06 21:14:56 DEBUG : dropbox/Apps/: >Lookup: node=dropbox/Apps/GoodNotes 5/, err=<nil>
2024/03/06 21:14:56 DEBUG : dropbox/Apps/GoodNotes 5/: Attr:
2024/03/06 21:14:56 DEBUG : dropbox/Apps/GoodNotes 5/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2024/03/06 21:14:56 DEBUG : dropbox/Apps/GoodNotes 5/: Lookup: name="Max"
2024/03/06 21:14:56 DEBUG : dropbox/Apps/GoodNotes 5/: >Lookup: node=dropbox/Apps/GoodNotes 5/Max/, err=<nil>
2024/03/06 21:14:56 DEBUG : dropbox/Apps/GoodNotes 5/Max/: Attr:
2024/03/06 21:14:56 DEBUG : dropbox/Apps/GoodNotes 5/Max/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2024/03/06 21:15:05 DEBUG : /: Lookup: name="pcloud"
2024/03/06 21:15:05 DEBUG : /: >Lookup: node=pcloud/, err=<nil>
2024/03/06 21:15:05 DEBUG : pcloud/: Attr:
2024/03/06 21:15:05 DEBUG : pcloud/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2024/03/06 21:15:05 DEBUG : pcloud/: Lookup: name="Public2"
2024/03/06 21:15:05 DEBUG : pcloud/: >Lookup: node=pcloud/Public2/, err=<nil>
2024/03/06 21:15:05 DEBUG : pcloud/Public2/: Attr:
2024/03/06 21:15:05 DEBUG : pcloud/Public2/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2024/03/06 21:15:05 DEBUG : /: Lookup: name="onedrive"
2024/03/06 21:15:05 DEBUG : /: >Lookup: node=onedrive/, err=<nil>
2024/03/06 21:15:05 DEBUG : onedrive/: Attr:
2024/03/06 21:15:05 DEBUG : onedrive/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2024/03/06 21:15:05 DEBUG : onedrive/: Lookup: name="Public2"
2024/03/06 21:15:06 DEBUG : onedrive/: >Lookup: node=<nil>, err=no such file or directory
2024/03/06 21:15:06 DEBUG : onedrive/: Lookup: name="Public2"
2024/03/06 21:15:06 DEBUG : onedrive/: >Lookup: node=<nil>, err=no such file or directory
2024/03/06 21:15:06 DEBUG : /: Lookup: name="pcloud"
2024/03/06 21:15:06 DEBUG : /: >Lookup: node=pcloud/, err=<nil>
2024/03/06 21:15:06 DEBUG : pcloud/: Attr:
2024/03/06 21:15:06 DEBUG : pcloud/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2024/03/06 21:15:06 DEBUG : pcloud/: Lookup: name="Public2"
2024/03/06 21:15:06 DEBUG : pcloud/: >Lookup: node=pcloud/Public2/, err=<nil>
2024/03/06 21:15:06 DEBUG : pcloud/Public2/: Attr:
2024/03/06 21:15:06 DEBUG : pcloud/Public2/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2024/03/06 21:15:06 DEBUG : onedrive/: Lookup: name="Public2"
2024/03/06 21:15:06 DEBUG : onedrive/: >Lookup: node=<nil>, err=no such file or directory
2024/03/06 21:15:06 DEBUG : pcloud/: Rename: oldName="Public2", newName="Public2", newDir=onedrive/
2024/03/06 21:15:06 NOTICE: OneDrive root '': srcU.f=pcloud root '', srcURemote="Public2", dstURemote="Public2"
2024/03/06 21:15:06 DEBUG : <nil>: Can't move directory - not same remote type
2024/03/06 21:15:06 INFO  : combine root '': Can't DirMove - falling back to file moves: can't move directory - incompatible remotes
2024/03/06 21:15:09 DEBUG : Public2/How to use the Public folder.rtf: Can't move - not same remote type
2024/03/06 21:15:09 DEBUG : pcloud/Public2/How to use the Public folder.rtf: Can't move, switching to copy
2024/03/06 21:15:09 DEBUG : Public2/How to use the Public folder.rtf: Can't copy - not same remote type
2024/03/06 21:15:09 DEBUG : Couldn't parse Date: from server evc113.pcloud.com: "Wed, 06 Mar 2024 20:15:09 +0000": parsing time "Wed, 06 Mar 2024 20:15:09 +0000" as "Mon Jan _2 15:04:05 2006": cannot parse ", 06 Mar 2024 20:15:09 +0000" as " "
2024/03/06 21:15:10 DEBUG : Public2/How to use the Public folder.rtf: Starting multipart upload
2024/03/06 21:15:11 DEBUG : Public2/How to use the Public folder.rtf: Uploading segment 0/1072 size 1072
2024/03/06 21:15:14 INFO  : pcloud/Public2/How to use the Public folder.rtf: Copied (new) to: onedrive/Public2/How to use the Public folder.rtf
2024/03/06 21:15:14 INFO  : pcloud/Public2/How to use the Public folder.rtf: Deleted
2024/03/06 21:15:14 DEBUG : pcloud/Public2: Updating dir with onedrive/Public2 0x40000efe10
2024/03/06 21:15:14 DEBUG : pcloud/Public2: forgetting directory cache
2024/03/06 21:15:14 DEBUG : pcloud: Added virtual directory entry vDel: "Public2"
2024/03/06 21:15:14 DEBUG : onedrive: Added virtual directory entry vAddDir: "Public2"
2024/03/06 21:15:14 DEBUG : pcloud/: >Rename: err=<nil>
2024/03/06 21:15:14 DEBUG : onedrive/: Invalidating "Public2"

nielash · March 6, 2024, 7:16pm

Glad to hear that Thanks for testing!

kapitainsky · March 6, 2024, 7:19pm

I have tried as well and something unusual is happening:

$ rclone config redacted test:

[test]
type = combine
upstreams = dropbox=dropbox: onedrive=onedrive:

$ ./rclone mount test: ~/Temp/mount --vfs-cache-mode writes --vfs-refresh -vv

$ mv /Users/kptsky/Temp/mount/onedrive/Temp/test /Users/kptsky/Temp/mount/dropbox/Test/

nfs server fuse-t:/test: not responding
nfs server fuse-t:/test: is alive again

macOS, FUSE-T

I have never seen such problem before

nielash · March 6, 2024, 7:43pm

Hmm that is odd! It looks like a FUSE-T error to me... are you able to test with FUSE and nfsmount and see if the same thing happens?

Are there a lot of files in the source directory? I wonder if it is just taking some time to transfer them all and FUSE-T thinks the server has stopped responding. Does the move end up succeeding or failing? And does the debug log on the rclone side show anything useful?