Help to transfer from Dropbox to two folders in the shared drive.

Help and Support
1

Good afternoon, I am transferring files from Dropbox to the Google shared drive, but I have only managed to transfer about 3TB and there are 2TB of files left. I am using a Google VM. I have already configured the remote for Dropbox, another for the Google Drive that is full, and another for the Google Drive that is empty. How do I copy the files from Dropbox to the empty Google Drive without copying again the ones that are in the full Google Drive?

2

welcome to the forum,

when you posted, there was a template of questions, to be answered.

3

There are multiple ways to approach your problem.

I think I would use rclone union with one union member marked as read only or no create. You then copy dropbox to union and all files not yet copied will go to an empty Google drive.

Anther way could be to generate a list of all files (including path) from dropbox minus all files from one of Google Drives and use it as next transfer source. Something like this:

rclone lsf -R dropbox: | sort > dropbox-list
rclone lsf -R gdrive_full: | sort > gdrive_full-list
comm -23 dropbox-list gdrive_full-list > to-transfer
rclone copy --files-from to-transfer dropbox: gdrive_empty:
4

Thank you very much for the response. I am a complete novice; how do I know if the command is working? It is also my first time using a VM to do this, and I am a bit lost doing things only through SSH.

5

We all were at some stage.

I am sorry but not going to explain basics of Linux cmd here. Do your homework.

Good luck with becoming a bit more advanced user:)

PS. Always remember about --dry-run -vv flags when you are experimenting with rclone commands and real data.

6

@kapitainsky, nice ideas, perhaps a simpler way is to use just rclone.

rclone check dropbox: gdrive_full:  --fast-list --size-only --one-way --missing-on-dst=missing-list
rclone copy  dropbox: gdrive_empty: --files-from=missing-list
1 Like
7

So three option now to choose from. What an abundance:) Lucky OP.

1 Like
8

two volunteers, three answers, not too shabby...

9

Thank you very much for your attention. I started using Linux today, and I still have a lot to learn.

1 Like
10

Thank you very much, I think it's working.

1 Like
11

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.