Rclone move, merge folders, Google Drive

Help and Support
1

Hi

I have two folders on Google Drive:
drive:/some/path/current
and
drive:/some/path/2018/date

These contains some of the same folders such as:
drive:/some/path/current/media
and
drive:/some/path/2018/date/media

The folders overlap, but all files in the two paths are unique.

If I do
rclone move drive:/some/path/2018/date drive:/some/path/current
will that merge all folders in drive:/some/path/2018/date into the folders in drive:/some/path/current and keep the files that are already in drive:/some/path/current?

If not how can I merge two folders on the same Google Drive remote?

2

Yes, that should work.

Try with --dry-run to see what happens

3

dry-run gives me no useful stats at all:

rclone move gSuiteCrypted:/RaidZero/2018/2018-07-21T04:00:01Z/ gSuiteCrypted:/RaidZero/current/ --dry-run -vv
2018/07/21 16:32:11 DEBUG : rclone: Version "v1.42" starting with parameters ["rclone" "move" "gSuiteCrypted:/RaidZero/2018/2018-07-21T04:00:01Z/" "gSuiteCrypted:/RaidZero/current/" "--dry-run" "-vv"]
2018/07/21 16:32:11 DEBUG : Using config file from "/Users/cnrd/.config/rclone/rclone.conf"
2018/07/21 16:32:15 NOTICE: Encrypted drive 'gSuiteCrypted:/RaidZero/current/': Not doing server side directory move as --dry-run
2018/07/21 16:32:15 INFO  :
Transferred:      0 Bytes (0 Bytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:          4s

2018/07/21 16:32:15 DEBUG : 6 go routines active
2018/07/21 16:32:15 DEBUG : rclone: Version "v1.42" finishing with parameters ["rclone" "move" "gSuiteCrypted:/RaidZero/2018/2018-07-21T04:00:01Z/" "gSuiteCrypted:/RaidZero/current/" "--dry-run" "-vv"]
4

It’s telling 0 things would be transferred.

Here is an example of copying with a few files in a folder and the other way with 0 files in there.

felix@gemini:/data/test$ rclone sync -vv --dry-run /data/test/s /data/test/t
2018/07/21 10:36:47 DEBUG : rclone: Version "v1.42" starting with parameters ["rclone" "sync" "-vv" "--dry-run" "/data/test/s" "/data/test/t"]
2018/07/21 10:36:47 DEBUG : Using config file from "/home/felix/.rclone.conf"
2018/07/21 10:36:47 INFO  : Local file system at /data/test/t: Waiting for checks to finish
2018/07/21 10:36:47 INFO  : Local file system at /data/test/t: Waiting for transfers to finish
2018/07/21 10:36:47 INFO  : Waiting for deletions to finish
2018/07/21 10:36:47 NOTICE: test: Not deleting as --dry-run
2018/07/21 10:36:47 NOTICE: test1: Not deleting as --dry-run
2018/07/21 10:36:47 NOTICE: test2: Not deleting as --dry-run
2018/07/21 10:36:47 INFO  :
Transferred:      0 Bytes (0 Bytes/s)
Errors:                 0
Checks:                 3
Transferred:            0
Elapsed time:          0s

2018/07/21 10:36:47 DEBUG : 4 go routines active
2018/07/21 10:36:47 DEBUG : rclone: Version "v1.42" finishing with parameters ["rclone" "sync" "-vv" "--dry-run" "/data/test/s" "/data/test/t"]
felix@gemini:/data/test$ rclone sync -vv --dry-run /data/test/s /data/test/t
2018/07/21 10:36:55 DEBUG : rclone: Version "v1.42" starting with parameters ["rclone" "sync" "-vv" "--dry-run" "/data/test/s" "/data/test/t"]
2018/07/21 10:36:55 DEBUG : Using config file from "/home/felix/.rclone.conf"
2018/07/21 10:36:55 INFO  : Local file system at /data/test/t: Waiting for checks to finish
2018/07/21 10:36:55 INFO  : Local file system at /data/test/t: Waiting for transfers to finish
2018/07/21 10:36:55 INFO  : Waiting for deletions to finish
2018/07/21 10:36:55 NOTICE: test: Not deleting as --dry-run
2018/07/21 10:36:55 NOTICE: test1: Not deleting as --dry-run
2018/07/21 10:36:55 NOTICE: test2: Not deleting as --dry-run
2018/07/21 10:36:55 INFO  :
Transferred:      0 Bytes (0 Bytes/s)
Errors:                 0
Checks:                 3
Transferred:            0
Elapsed time:          0s

2018/07/21 10:36:55 DEBUG : 3 go routines active
2018/07/21 10:36:55 DEBUG : rclone: Version "v1.42" finishing with parameters ["rclone" "sync" "-vv" "--dry-run" "/data/test/s" "/data/test/t"]
felix@gemini:/data/test$ ls t
test  test1  test2
felix@gemini:/data/test$ ls s

You can see the not deleting as dry run in the first that shows what will be copied.

5

That should not be the case however as gSuiteCrypted:/RaidZero/2018/2018-07-21T04:00:01Z contains about 1.7TB of data.

6

What’s the output of:

rclone ls gSuiteCrypted:/RaidZero/2018/2018-07-21T04:00:01Z/

7 
rclone ls gSuiteCrypted:/RaidZero/2018/2018-07-21T04:00:01Z/
       14 filelist.bz2
 39858517 docker/dmzdockerhost.zip
      587 docker/unifi.sh
    12292 backups/.DS_Store
        0 backups/.windows
 57784344 newsgroup/MTKV263.zip
921283354 pve/vzdump-lxc-100-2018_07_11-11_26_34.tar.lzo
   210195 nextcloud/nextcloud.log
    12861 docker/py-kms/LICENSE
     1491 docker/py-kms/README.md
    28593 docker/py-kms/dcerpc.py
     4139 docker/py-kms/kmsPidGenerator.py
     3510 docker/py-kms/kmsRequestV4.py
    21138 docker/py-kms/structure.py
    22532 backups/HomeAssistant/.DS_Store
     4096 backups/HomeAssistant/._.DS_Store
     4096 backups/HomeAssistant/._customize.yaml
     4096 backups/HomeAssistant/._entity_registry.yaml
     4096 backups/HomeAssistant/._server_run_cost.json
     4096 backups/HomeAssistant/._trait.py
     4096 backups/HomeAssistant/._ui-lovelace.yaml
        0 backups/HomeAssistant/._zwscene.xml
     2915 backups/HomeAssistant/.ios.conf
 25849594 backups/HomeAssistant/OZW_Log.txt
     4630 backups/HomeAssistant/automations.yaml
     5298 backups/HomeAssistant/floorplan.yaml
       91 backups/HomeAssistant/phue-00178813cc83.conf
     8192 backups/HomeAssistant/pyozw.sqlite
     9876 backups/HomeAssistant/smart_home.py
     2264 backups/HomeAssistant/ui-lovelace.yaml.old.yaml
      108 backups/HomeAssistant/zwscene.xml
     4096 backups/Nextcloud/._.DS_Store
        0 backups/Nextcloud/nextcloud.log

I stopped the command as there are about 100k files in there.

8

Odd. I did the same test and if I have the dest local, it shows all the files, but if the dest is my gd, it doesn’t show anything. I guess it’s got something to do with the server-side copy.

I’d surmise that’s a bug and would file a report.