Rclone copy problem - copies files already copied

Help and Support
1

I am running the following command on free google cloud instance

rclone -vv --ignore-existing --tpslimit 8 --transfers=8 --no-traverse --no-check-certificate --drive-chunk-size=512M copy googledrive-source: googledrive-destination:

My previous Google Cloud instance trial ended after one year. I got another trial instance under different google account. I installed rclone again, and tried to copy new files from googledrive-source to googledrive-destination

Problem is, it seems it started to copy ALL files from source to destination again, files that are already on destination (I have about 12 TB of data).

Is it because the old google cloud instance had rclone datase of already copied files?

What can I do so rclone running on this new Google cloud instance doe snot copy files from source to destination which already exist on destination?

Thank you very much in advance.

2

What’s the log file show when it recopies a file that is already there?

3

Among many messages such as pacer: Rate limited and sleeping messages
it shows
DATE TIME DEBUG: file-name-1 Sending chunk 0 length xxx
DATE TIME DEBUG: file-name-2 Sending chunk 0 length xxx

then on a summary

Transferring:

file-name-1 X% / SIZE speed M/s time in s
file-name-2 Y% / SIZE speed M/s time in s

4

Can you share the actual log?

5

[rubiohigueydr@instance-1 ~]$ rclone -vv --ignore-existing --tpslimit 8 --transfers=8 --no-traverse --no-check-certificate --drive-chunk-size=512M copy gd-uniquo: gd-domcamb:
2019/02/24 16:47:19 DEBUG : rclone: Version “v1.46” starting with parameters [“rclone” “-vv” “–ignore-existing” “–tpslimit” “8” “–transfers=8” “–no-traverse” “–no-check-certificate” “–drive-chunk-size=512M” “copy” “gd-uniquo:” “gd-domcamb:”]
2019/02/24 16:47:19 DEBUG : Using config file from “/home/rubiohigueydr/.config/rclone/rclone.conf”
2019/02/24 16:47:19 INFO : Starting HTTP transaction limiter: max 8 transactions/s with burst 1
2019/02/24 16:47:19 DEBUG : gd-uniquo: Loaded invalid token from config file - ignoring
2019/02/24 16:47:19 DEBUG : gd-uniquo: Saved new token in config file
2019/02/24 16:47:22 DEBUG : gd-domcamb: Loaded invalid token from config file - ignoring
2019/02/24 16:47:22 DEBUG : gd-domcamb: Saved new token in config file
2019/02/24 16:47:23 DEBUG : GRAFICOS.zip: Destination exists, skipping
2019/02/24 16:47:23 DEBUG : LRDF02.mp4: Destination exists, skipping
2019/02/24 16:47:23 DEBUG : LRDF01.mp4: Destination exists, skipping
2019/02/24 16:47:23 DEBUG : ParaisoTravel04_Proc.mp4: Destination exists, skipping
2019/02/24 16:47:25 DEBUG : pacer: Rate limited, sleeping for 1.164261452s (1 consecutive low level retries)
2019/02/24 16:47:25 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:47:25 DEBUG : pacer: Resetting sleep to minimum 100ms on success
2019/02/24 16:47:25 DEBUG : pacer: Rate limited, sleeping for 1.997643615s (1 consecutive low level retries)
2019/02/24 16:47:25 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:47:25 DEBUG : pacer: Rate limited, sleeping for 2.46831454s (2 consecutive low level retries)
2019/02/24 16:47:25 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:47:25 DEBUG : pacer: Rate limited, sleeping for 4.790581798s (3 consecutive low level retries)
2019/02/24 16:47:25 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:47:25 DEBUG : pacer: Resetting sleep to minimum 100ms on success
2019/02/24 16:47:25 DEBUG : pacer: Rate limited, sleeping for 1.826801102s (1 consecutive low level retries)
2019/02/24 16:47:25 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:47:25 DEBUG : pacer: Rate limited, sleeping for 1.550853304s (1 consecutive low level retries)
2019/02/24 16:47:25 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:47:26 DEBUG : pacer: Resetting sleep to minimum 100ms on success
2019/02/24 16:47:26 DEBUG : pacer: Resetting sleep to minimum 100ms on success
Exceeded)
2019/02/24 16:47:34 DEBUG : pacer: Resetting sleep to minimum 100ms on success
2019/02/24 16:47:34 DEBUG : pacer: Rate limited, sleeping for 1.49291847s (1 consecutive low level retries)
2019/02/24 16:47:34 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:47:34 DEBUG : pacer: Resetting sleep to minimum 100ms on success
2019/02/24 16:47:34 DEBUG : pacer: Rate limited, sleeping for 1.397887829s (1 consecutive low level retries)
2019/02/24 16:47:34 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:47:34 DEBUG : pacer: Resetting sleep to minimum 100ms on success
2019/02/24 16:47:34 DEBUG : pacer: Rate limited, sleeping for 2.059121444s (2 consecutive low level retries)
2019/02/24 16:47:34 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:47:34 DEBUG : pacer: Rate limited, sleeping for 4.569505534s (3 consecutive low level retries)
2019/02/24 16:47:34 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:47:35 DEBUG : pacer: Rate limited, sleeping for 8.171658774s (4 consecutive low level retries)
2019/02/24 16:47:35 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:47:35 DEBUG : pacer: Rate limited, sleeping for 16.693788374s (5 consecutive low level retries)
2019/02/24 16:47:35 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:47:35 DEBUG : pacer: Rate limited, sleeping for 1.545367477s (1 consecutive low level retries)
2019/02/24 16:47:35 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
Exceeded)
2019/02/24 16:47:47 DEBUG : pacer: Resetting sleep to minimum 100ms on success
2019/02/24 16:47:51 DEBUG : Content NFX/Tiro_de_Gracia_4500_Cap_21.mp4: Sending chunk 536870912 length 536870912
2019/02/24 16:47:52 DEBUG : pacer: Rate limited, sleeping for 1.347704657s (1 consecutive low level retries)
2019/02/24 16:47:52 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:47:52 DEBUG : pacer: Resetting sleep to minimum 100ms on success
2019/02/24 16:47:52 DEBUG : pacer: Rate limited, sleeping for 1.128331287s (1 consecutive low level retries)
2019/02/24 16:47:52 DEBUG : pacer: low level retry 3/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:47:52 DEBUG : pacer: Rate limited, sleeping for 2.314246836s (2 consecutive low level retries)
2019/02/24 16:47:52 DEBUG : pacer: low level retry 3/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:47:53 DEBUG : pacer: Rate limited, sleeping for 4.776115832s (3 consecutive low level retries)
2019/02/24 16:47:53 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:47:53 DEBUG : pacer: Rate limited, sleeping for 8.222867081s (4 consecutive low level retries)
2019/02/24 16:47:53 DEBUG : pacer: low level retry 3/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:47:53 DEBUG : pacer: Rate limited, sleeping for 16.282900372s (5 consecutive low level retries)
2019/02/24 16:47:53 DEBUG : pacer: low level retry 4/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:48:01 DEBUG : pacer: Resetting sleep to minimum 100ms on success
2019/02/24 16:48:01 DEBUG : Content NFX/Tiro_de_Gracia_4500_Cap_21.mp4: Sending chunk 1073741824 length 414507179
2019/02/24 16:48:02 DEBUG : Content Peli/Londres.bajo.Fuego.HD.2016.dual.mp4: Sending chunk 0 length 536870912
2019/02/24 16:48:02 DEBUG : Content Peli/Colonia.HD.2016.dual.mp4: Sending chunk 0 length 536870912
2019/02/24 16:48:02 DEBUG : Content Peli/Batman.vs.Superman.HD.2016.dual.mp4: Sending chunk 0 length 536870912
2019/02/24 16:48:04 DEBUG : pacer: Rate limited, sleeping for 1.205326595s (1 consecutive low level retries)
2019/02/24 16:48:04 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:48:04 DEBUG : pacer: Rate limited, sleeping for 4.66767414s (3 consecutive low level retries)
2019/02/24 16:48:04 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:48:04 DEBUG : pacer: Rate limited, sleeping for 8.320359143s (4 consecutive low level retries)
2019/02/24 16:48:04 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:48:05 DEBUG : pacer: Rate limited, sleeping for 16.506006871s (5 consecutive low level retries)
2019/02/24 16:48:05 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:48:05 DEBUG : pacer: Rate limited, sleeping for 16.266102274s (6 consecutive low level retries)
2019/02/24 16:48:05 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:48:05 DEBUG : pacer: Rate limited, sleeping for 16.138513592s (7 consecutive low level retries)
2019/02/24 16:48:05 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:48:05 DEBUG : pacer: Rate limited, sleeping for 16.356412909s (8 consecutive low level retries)
2019/02/24 16:48:05 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:48:05 DEBUG : pacer: Rate limited, sleeping for 16.523034024s (9 consecutive low level retries)
2019/02/24 16:48:05 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:48:05 DEBUG : pacer: Rate limited, sleeping for 16.305113271s (10 consecutive low level retries)
2019/02/24 16:48:05 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:48:05 DEBUG : pacer: Rate limited, sleeping for 16.058449426s (11 consecutive low level retries)
2019/02/24 16:48:05 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:48:06 DEBUG : pacer: Rate limited, sleeping for 16.849565956s (12 consecutive low level retries)
2019/02/24 16:48:06 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/02/24 16:48:06 DEBUG : pacer: Resetting sleep to minimum 100ms on success
2019/02/24 16:48:11 INFO : Content NFX/Tiro_de_Gracia_4500_Cap_21.mp4: Copied (new)
2019/02/24 16:48:19 INFO :
Transferred: 2.886G / 8.470 GBytes, 34%, 49.223 MBytes/s, ETA 1m56s
Errors: 0
Checks: 4 / 4, 100%
Transferred: 1 / 8, 13%
Elapsed time: 1m0s
Transferring:

  •       Content Others/Biblia/Biblia_08.mp4:  0% /817.921M, 0/s, -

  •       Content Others/Biblia/Biblia_09.mp4:  0% /821.624M, 0/s, -

  •     Content Peli/Colonia.HD.2016.dual.mp4: 42% /1.165G, 16.895M/s, 40s
  • Content Peli/Batman.vs…erman.HD.2016.dual.mp4: 30% /1.656G, 16.582M/s, 1m11s
  • Content Peli/Londres.b…Fuego.HD.2016.dual.mp4: 46% /1.066G, 15.878M/s, 36s
    2019/02/24 16:48:21 DEBUG : Content Others/Biblia/Biblia_06.mp4: Sending chunk 0 length 536870912
    2019/02/24 16:48:21 DEBUG : Content Peli/Londres.bajo.Fuego.HD.2016.dual.mp4: Sending chunk 536870912 length 536870912
    2019/02/24 16:48:21 DEBUG : Content Peli/Batman.vs.Superman.HD.2016.dual.mp4: Sending chunk 536870912 length 536870912
    2019/02/24 16:48:21 DEBUG : Content Peli/Colonia.HD.2016.dual.mp4: Sending chunk 536870912 length 536870912
    2019/02/24 16:48:21 DEBUG : pacer: Rate limited, sleeping for 1.850832744s (1 consecutive low level retries)
    2019/02/24 16:48:21 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
    2019/02/24 16:48:21 DEBUG : pacer: Rate limited, sleeping for 2.479262232s (2 consecutive low level retries)
    2019/02/24 16:48:21 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
    2019/02/24 16:48:22 DEBUG : pacer: Rate limited, sleeping for 16.398968479s (8 consecutive low level retries)
    2019/02/24 16:48:22 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
    2019/02/24 16:48:22 DEBUG : pacer: Rate limited, sleeping for 16.581935655s (9 consecutive low level retries)
    2019/02/24 16:48:22 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
    2019/02/24 16:48:22 DEBUG : pacer: Rate limited, sleeping for 16.091215356s (10 consecutive low level retries)
    2019/02/24 16:48:22 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
    2019/02/24 16:48:23 DEBUG : pacer: Rate limited, sleeping for 16.970641124s (11 consecutive low level retries)
    2019/02/24 16:48:23 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
    2019/02/24 16:48:23 DEBUG : pacer: Rate limited, sleeping for 16.35738791s (12 consecutive low level retries)
    2019/02/24 16:48:23 DEBUG : pacer: low level retry 3/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
    2019/02/24 16:48:23 DEBUG : pacer: Rate limited, sleeping for 16.97673174s (13 consecutive low level retries)
    2019/02/24 16:48:23 DEBUG : pacer: low level retry 3/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
    2019/02/24 16:48:31 DEBUG : pacer: Resetting sleep to minimum 100ms on success
    2019/02/24 16:48:40 DEBUG : Content Others/Biblia/Biblia_06.mp4: Sending chunk 536870912 length 318840220
    2019/02/24 16:48:40 DEBUG : Content Peli/Colonia.HD.2016.dual.mp4: Sending chunk 1073741824 length 177559842
    2019/02/24 16:48:40 DEBUG : Content Peli/Londres.bajo.Fuego.HD.2016.dual.mp4: Sending chunk 1073741824 length 70399580
    2019/02/24 16:48:40 DEBUG : Content Peli/Batman.vs.Superman.HD.2016.dual.mp4: Sending chunk 1073741824 length 536870912
    2019/02/24 16:48:40 DEBUG : Content Others/Biblia/Biblia_07.mp4: Sending chunk 0 length 536870912
    2019/02/24 16:48:41 DEBUG : Content Others/Biblia/Biblia_08.mp4: Sending chunk 0 length 536870912
    2019/02/24 16:48:42 DEBUG : Content Others/Biblia/Biblia_09.mp4: Sending chunk 0 length 536870912
    2019/02/24 16:48:43 DEBUG : pacer: Rate limited, sleeping for 1.475789027s (1 consecutive low level retries)
    2019/02/24 16:48:43 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
    Exceeded)
    2019/02/24 16:48:44 DEBUG : pacer: Rate limited, sleeping for 4.078616902s (3 consecutive low level retries)
    2019/02/24 16:48:44 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
    2019/02/24 16:48:44 DEBUG : pacer: Rate limited, sleeping for 1.800614698s (1 consecutive low level retries)
    2019/02/24 16:48:44 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
    2019/02/24 16:48:44 DEBUG : pacer: Rate limited, sleeping for 2.992853789s (2 consecutive low level retries)
    2019/02/24 16:48:44 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
    2019/02/24 16:48:44 DEBUG : pacer: Resetting sleep to minimum 100ms on success
    2019/02/24 16:48:44 INFO : Content Peli/Londres.bajo.Fuego.HD.2016.dual.mp4: Copied (new)
    2019/02/24 16:48:44 DEBUG : pacer: Rate limited, sleeping for 1.649663344s (1 consecutive low level retries)
    2019/02/24 16:48:44 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
    2019/02/24 16:48:44 DEBUG : pacer: Rate limited, sleeping for 2.143753558s (2 consecutive low level retries)
    2019/02/24 16:48:44 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
    2019/02/24 16:48:44 DEBUG : pacer: Rate limited, sleeping for 4.89213012s (3 consecutive low level retries)
    2019/02/24 16:48:44 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
    2019/02/24 16:48:44 DEBUG : pacer: Rate limited, sleeping for 8.499786217s (4 consecutive low level retries)
    2019/02/24 16:48:44 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
    2019/02/24 16:48:44 DEBUG : pacer: Rate limited, sleeping for 16.478480017s (5 consecutive low level retries)
    2019/02/24 16:48:44 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
    2019/02/24 16:48:45 DEBUG : pacer: Rate limited, sleeping for 4.996229503s (3 consecutive low level retries)
    2019/02/24 16:48:45 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
    2019/02/24 16:48:45 DEBUG : pacer: Rate limited, sleeping for 16.071636917s (6 consecutive low level retries)
    2019/02/24 16:48:45 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
    2019/02/24 16:48:45 DEBUG : pacer: Resetting sleep to minimum 100ms on success
    2019/02/24 16:48:45 INFO : Content Peli/Colonia.HD.2016.dual.mp4: Copied (new)
    2019/02/24 16:48:45 DEBUG : pacer: Rate limited, sleeping for 8.133901218s (4 consecutive low level retries)
    2019/02/24 16:48:45 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
    2019/02/24 16:48:47 INFO : Content Others/Biblia/Biblia_06.mp4: Copied (new)
6

You probably want to get your client ID/API key if you haven’t yet.

https://rclone.org/drive/#making-your-own-client-id

I’d turn down the transfers and checkers to match up so maybe 4/4 so you get less 403s. You can play with it and bump it up.

512M is huge for the chunk size and a sweet spot on some large scale testing seems to be 32M or 64M.

Any reason for the non-check-certificate?

What files are recopying that exist as I see good entries like:

2019/02/24 16:47:23 DEBUG : LRDF02.mp4: Destination exists, skipping
2019/02/24 16:47:23 DEBUG : LRDF01.mp4: Destination exists, skipping
2019/02/24 16:47:23 DEBUG : ParaisoTravel04_Proc.mp4: Destination exists, skipping

rclone doesn’t resume a stopped transfer so it would reupload the whole thing back if you stopped the process.

7

Honestly I just copied the whole command as I found it on reddit a year or so back. It was working fine on the old google instance, and kept copying only the newly uploaded files at source, from source-drive to destination-drive. Now after a year, on new Google cloud instance, with presumably a newer version of rclone, it seems it started to copy everything again, all 12 TB of data. I double checked that, a sit is copying the files from source, which are already on destination (let’s say a dump of a series with 100 episodes, if it tries to copy episodes 1…2…3…4…etc. and you see on destination all episodes 1-through-100 are present (and manually tested to be ok and not corrupt), it’s clear it’s copying everything again for some unknown reason.

8

By the logs, there are no files like that. Can you give me an example with log output that shows what you are talking about?

9

For example,

2019/02/24 16:48:40 DEBUG : Content Others/Biblia/Biblia_06.mp4: Sending chunk 536870912 length 318840220
2019/02/24 16:48:40 DEBUG : Content Peli/Colonia.HD.2016.dual.mp4: Sending chunk 1073741824 length 177559842
2019/02/24 16:48:40 DEBUG : Content Peli/Londres.bajo.Fuego.HD.2016.dual.mp4: Sending chunk 1073741824 length 70399580
2019/02/24 16:48:40 DEBUG : Content Peli/Batman.vs.Superman.HD.2016.dual.mp4: Sending chunk 1073741824 length 536870912
2019/02/24 16:48:40 DEBUG : Content Others/Biblia/Biblia_07.mp4: Sending chunk 0 length 536870912
2019/02/24 16:48:41 DEBUG : Content Others/Biblia/Biblia_08.mp4: Sending chunk 0 length 536870912
2019/02/24 16:48:42 DEBUG : Content Others/Biblia/Biblia_09.mp4: Sending chunk 0 length 536870912

All these files had been already on the destination drive since last year, yet they were being copied from source to destination again now, running rclone on the new google cloud instance.

10

Can you check the source and share the rclone ls for that file and that rclone ls for that file on the destination?

File recopies usually means you have dupes somewhere as well so a rclone dedupe might be in order.

11

Can you tell me please how exactly I do rclone ls ?

12

rclone ls remotename:/path/to/file/filename

https://rclone.org/commands/rclone_ls/

ls -al /GD/hosts
-rw-rw-r-- 1 felix felix 116 Feb 24 08:56 /GD/hosts

rclone ls gcrypt:hosts
      116 hosts