I am using rclone first time. I am transferring 90GB data from old google drive account's my drive to a new account's shared drive using VPS Hetzner. It ran for 2 weeks (pass 1) and showed 90GB transferred but it was still going on. I mistakenly did Ctrl+C and it stopped. I ran for another pass (pass 2) and stopped it after 23 hours as the ETA was showing 0, thinking that the transfer was done. I am running the final pass now and it shows the below progress. I need to know how long it will take to finish the transfer or is it transferring the same files again. Should I stop it now or how to make it run faster? Please help, I need to report to my client asap.
A log from the command that you were trying to run with the -vv flag
```root@migration-server:~# cat /root/pass1.log
2026/06/05 13:17:28 INFO : Starting transaction limiter: max 3 transactions/s with burst 1
2026/06/05 13:17:29 NOTICE: General Inbox: Duplicate directory found in source - ignoring
2026/06/05 13:17:29 NOTICE: General Inbox: Duplicate directory found in source - ignoring
2026/06/05 13:17:29 NOTICE: General Inbox: Duplicate directory found in source - ignoring
2026/06/05 13:17:29 NOTICE: General Inbox: Duplicate directory found in source - ignoring
2026/06/05 13:17:29 NOTICE: General Inbox: Duplicate directory found in source - ignoring
2026/06/05 13:17:29 NOTICE: General Inbox: Duplicate directory found in source - ignoring
2026/06/05 13:17:29 NOTICE: General Inbox: Duplicate directory found in source - ignoring
2026/06/05 13:17:29 NOTICE: NEW — Hoffmann GmbH — 2026-05-19: Duplicate directory found in source - ignoring
2026/06/05 13:17:29 NOTICE: NEW — Hoffmann GmbH — 2026-05-19: Duplicate directory found in source - ignoring
2026/06/05 13:17:31 NOTICE: 10. SONSTIGES (Umzug) - Zugriff nur GF/20. Notariatsanschreiben : Duplicate directory found in source - ignoring
2026/06/05 13:17:31 NOTICE: 10. SONSTIGES (Umzug) - Zugriff nur GF/30. Ăśbergabe an RAe (1): Duplicate directory found in source - ignoring
2026/06/05 13:17:31 NOTICE: 10. SONSTIGES (Umzug) - Zugriff nur GF/30. Ăśbergabe an RAe : Duplicate directory found in source - ignoring
2026/06/05 13:17:31 NOTICE: 10. SONSTIGES (Umzug) - Zugriff nur GF/30. Ăśbergabe an RAe : Duplicate directory found in source - ignoring
2026/06/05 13:17:31 NOTICE: 10. SONSTIGES (Umzug) - Zugriff nur GF/30. Ăśbergabe an RAe : Duplicate directory found in source - ignoring
2026/06/05 13:17:31 NOTICE: 10. SONSTIGES (Umzug) - Zugriff nur GF/30. Ăśbergabe an RAe : Duplicate directory found in source - ignoring
2026/06/05 13:17:31 NOTICE: 10. SONSTIGES (Umzug) - Zugriff nur GF/30. Ăśbergabe an RAe : Duplicate directory found in source - ignoring
2026/06/05 13:17:31 NOTICE: 10. SONSTIGES (Umzug) - Zugriff nur GF/Fakih: Duplicate directory found in source - ignoring
2026/06/05 13:17:31 NOTICE: 10. SONSTIGES (Umzug) - Zugriff nur GF/NEUKLIENT:IN (Januar 2022) : Duplicate directory found in source - ignoring
2026/06/05 13:17:31 NOTICE: 10. SONSTIGES (Umzug) - Zugriff nur GF/Swierzy: Duplicate directory found in source - ignoring
2026/06/05 13:17:31 NOTICE: 10. SONSTIGES (Umzug) - Zugriff nur GF/Weitere Korrespondenz: Duplicate directory found in source - ignoring
```
If you don't have one you are using a shared resource that will be throttled by Google and is most likely the cause of your distress and copying such an amount of data.
Here are the rclone docs version of creating your own client ID. Take a look at both and see which one is easier for you to follow.
Thanks for your reply. The problem is the listing number is kept rising and it's not ending. But the total file count should not be like this. We counted using Google script 1 month ago and it was 199826, so it should be slightly above 200000 now, not 361353. Right now it's like this-
Thanks a lot for replying. Yes I didn't add Client ID in any of the remote accounts. Should I stop the transfer and do it? or should I edit the rclone config now and add the client_ID, I see I have that option. Is it enough to do only for the destination remote as it is Shared Drive or should I do for both?
Rclone when used without a client ID is using a shared client ID that is used by all rclone connections to Google Drive. This is why Google ends up throttling your connection because your client ID the one that you're using which is blank is being used by a lot of people and a lot of data is being transferred and that makes your transfers slow.
To answer your question regarding whether you need one client ID or two. It would be most beneficial for you to create a client ID for both the source and for the destination. If you don't speed up the connection coming from the source there's no point in upping the speed on the destination side you really need to do both in order to see results.
After you have your two sets of client ids and secrets run this:
Run "rclone config"
Choose "e" to edit each remote and you can add the id/secret.
---
With your request for help I added a new page to my notebook of help tips.
You will need to stop and restart the copy and you should also re-authenticate as per the instructions in the link below.
thanks again. I added client id and secret for both. but if I do Ctrl+C to stop it now and restart, it will start the Listing again from 0 and it will take 2 more days again to reach where it is now. Should I stop and restart or wait for it to complete Transferred to reach 4826? btw this number (4826) is also rising and speed also changes (usually slow).
Transferred: 1.441 GiB / 2.569 GiB, 56%, 211 B/s, ETA 9w3d5h
Glad to see that you got the ID working on both ends. Before you terminate your program for copying the files from location A to B do you have the resources to try a separate copy command in a different window or on a different PC either way will work and try to transfer no more than a few gigabytes and see how much faster it goes then what you're getting from your current settings.
Rclone copy a:/2gbofdata b:/2gbofdata
Try this as a test and see what happens. If the performance goes up by a wide enough margin it might make no difference to you at all if you stop and restart your transfer because the restarted transfer will be going that much faster that it may not take two days it may only take one or less than one hopefully.
If you're on the same PC then yes there is a possibility of everything stopping. Ideally you would want to use a separate PC.
I run windows pro which includes virtual machine software.
By the way, what is your OS type? Win linux mac?
If you're on Windows you have a solution available to you for the future but not for today because the setup requires a reboot. Windows 10 and 11 support the windows subsystem for Linux and that is in essence a virtual machine running Ubuntu Linux and you can install rclone in WSL and it will in no way interfere with whatever you're doing in Windows it's like having two separate computers. The installation requires the reboot so it's not going to help you today.
What you really need to make sure that you don't interfere with your current transfer is another PC.
Any chance you have an Android phone or tablet? There is a program that integrates rclone into an android gui. It's essentially rclone for android. It even has the feature that lets you import your current rclone.conf configuration file with the newly created client IDs and it will be set up automatically for you without having to go through the setup for each of the Google Drives all over again.
This way you can initiate a transfer of 2 GB of data from one of the Google Drives to the android without interfering with your Windows computer and compare the performance. It's not a one-to-one comparison between Android and Windows but I'm thinking that the Android software with the client ID might actually transfer data faster from one site than you're currently doing in Windows.
Let me know if you want information on an Android app to use as a testing tool for performance of the client ID.
I use one of the Android apps to synchronize my files from my phone up to a Cloud Drive.
This is where I would normally suggest using a virtual machine which would not interfere with the host computers file transfer but I'm not sure if this would give you accurate result either given that it's a virtual machine and not the host.
To make space and economy the most for my dollar I purchased a I-9 gaming computer and upgraded the RAM and disc so I can run virtual machines that are running Windows without interfering with my Host Windows computer at all. Something to consider for future purchases. Spend a little extra money on one computer so you can turn it into three computers or four computers depending on how much RAM you put in and what kind of processor you get and how much the space you have. I have an I-9 with 24 cores and 64 gigs of RAM and three terabytes of internal storage. I would normally run what you were doing inside of virtual machine and because of my hardware specs it would run just as fast as if we're running on bare metal machine.
I am using Mac OS to connect with Hetzner's Linux migration-server 7.0.0-15-generic #15-Ubuntu SMP PREEMPT_DYNAMIC x86_64 GNU/Linux
I don't understand what should I do, when will this be finished. transfer stats now-
Transferred: 3.214 GiB / 4.825 GiB, 67%, 14.049 KiB/s, ETA 1d9h23m
I need you to clarify something for me. Which device is running rclone? Is it running on your Mac or is it running on your server running Linux?
Also what are your internet upload and download speeds?
If it's running on the Linux machine you have your Mac available to run rclone to test your new client ID.
You have access to Mac OS and you have access to Linux so you have two devices that can copy files from one Google drive to the other so use the one that you're not using to run a test with the new Google Drive ID.
I did some research with chat gpt. With a Google Drive to Google Drive transfer you should be doing server side copy meaning your local network and machines make no difference.
I plugged in the statistics for my internet account at home. Chat GPT told me to use -vv and check for server side transfer messages. Google should be doing the transfer from server to server internally and I was told by Chad that it should take no more than 4 hours to copy 70 GB of data from one account to another.
hi thanks for all your replies. I am running rclone in the remote Hetzner Linux server. I figured out what went wrong. Before pass3, the client moved one of the folders to my drive that was transferred in shared drive. Also when I tested in the destinations my drive, there was this folder structure already created there. So when rclone found the folder moved to My drive, it transferred all other folders to my drive as well. That is why it was taking so long. Now I have decided to stop the current pass 3 transfer. And then only transfer data to the folder that was moved. And after finishing that transfer, I will go with the final pass excluding that folder. so that we can check if everything was transferred in the shared drive. And I will do this with the client ID. so, hopefully, it will be faster.
I knew there had to be something drastically wrong for it to be taking such a long time to copy the data.
When I compared test results between using a client ID and not using a client ID there is a distinct difference in performance especially if you're copying a lot of data. If you're only copying a small amount of data like saving a Word document to the server it really doesn't matter if you have a client ID or not. Moving lots of small files can cause throttling.
Hi. After adding Client ID and checkers 16, my last pass ended in 1.5 hours. Of course, I skipped that folder which was removed by our client after being transferred. Turns out it was not moved to MyDrive but got deleted from shared drive where it was transferred in the 1st pass. So in Pass 3, rclone was not transferring the folder to MyDrive but got stuck somehow and was showing that it was transferring files in that folder. But the folder was not being transferred in the shared drive either (in pass 3).
Anyway, Thanks a lot for your help !
Think of it this way. You learned new technology and now if you want to take it one step further you can use rclone to encrypt all of the data too. I keep my important data encrypted on the cloud drives.
Things worked out for you and because you were persistent.
Nice that the last pass dropped to 1.5 hours. Before calling it finished, I would still do one verification run from the source to the Shared Drive, maybe with rclone check --one-way if the destination is only supposed to contain the migrated set. For small office files it is easy to miss one renamed or deleted folder, and the check output is usually clearer than watching another copy pass scroll by.
At least you're now able to use rclone as intended and get good results from the transfers. That is very important. I'm curious if you run the copy command even on some sample files and put a -vv look for references to server to server copy versus client server copy if it's doing service to server the data is never passing through your local Workstation. This can happen frequently when transferring data save from one Google drive to another. Some Cloud drives support server to server and others do not.
