Gdriver server side copy dir error

rclone v1.51.0
debian 10 64bit
Gdrive

I am uploading from local to encrypted crypt_A then a script runs rclone with --drive-server-side-across-configs on the remote_A to copy it to remote_B - both on same gdrive account.

This works fine. What I have seen in the logs is that when a new directory is to be copied from remote_A to remote_B it also tries to copy just the dir itself and fails. This attempt doesn't appear from local to crypt_A so this appears to be --drive-server-side-across-configs specific?

  INFO  : Encrypted drive 'crypt_A:/BD': Waiting for transfers to finish
 INFO  : NC/[Woof] Kyokou Suiri ED (BDRip 1920x1080 x264 FLAC) [18B21729].mkv: Copied (new)
 INFO  : NC/[Woof] Kyokou Suiri OP (BDRip 1920x1080 x264 FLAC) [0C0ED13C].mkv: Copied (new)
 INFO  :
Transferred:        2.178G / 3.724 GBytes, 58%, 38.772 MBytes/s, ETA 40s
Transferred:            2 / 5, 40%
Elapsed time:        57.5s
Transferring:
 * [Woof] Kyokou Suiri 01…4 FLAC) [7A024CA4].mkv: 57% /1.117G, 12.770M/s, 38s
 * [Woof] Kyokou Suiri 02…4 FLAC) [06B0AECD].mkv: 57% /1.169G, 13.263M/s, 38s
 * [Woof] Kyokou Suiri 03…4 FLAC) [7BF84B2F].mkv: 53% /1.230G, 13.271M/s, 44s

 INFO  : [Woof] Kyokou Suiri 01 (BDRip 1920x1080 x264 FLAC) [7A024CA4].mkv: Copied (new)
 INFO  : [Woof] Kyokou Suiri 03 (BDRip 1920x1080 x264 FLAC) [7BF84B2F].mkv: Copied (new)
 INFO  : [Woof] Kyokou Suiri 02 (BDRip 1920x1080 x264 FLAC) [06B0AECD].mkv: Copied (new)
 INFO  :
Transferred:        3.725G / 3.725 GBytes, 100%, 38.413 MBytes/s, ETA 0s
Transferred:            5 / 5, 100%
Elapsed time:      1m39.3s

-- after rclone finishes the local to crypt_A copy the server side kicks in:

+ rclone cryptdecode --reverse crypt_A: /BD/[Woof] Kyokou Suiri
+ cryptdecode_response=/BD/[Woof] Kyokou Suiri         /path_1/path_2
+ rclone copy -v --drive-server-side-across-configs remote_A:/s_prefix/path_1/path_2 remote_B:/t_prefix/path_1
 ERROR : : error reading source directory: directory not found
 INFO  : Google drive root 't_prefix/path_1': Waiting for checks to finish
 INFO  : Google drive root 't_prefix/path_1': Waiting for transfers to finish
 ERROR : Attempt 1/3 failed with 1 errors and: directory not found
 ERROR : : error reading source directory: directory not found
 INFO  : Google drive root 't_prefix/path_1': Waiting for checks to finish
 INFO  : Google drive root 't_prefix/path_1': Waiting for transfers to finish
 ERROR : Attempt 2/3 failed with 1 errors and: directory not found
 ERROR : : error reading source directory: directory not found
 INFO  : Google drive root 't_prefix/path_1': Waiting for checks to finish
 INFO  : Google drive root 't_prefix/path_1': Waiting for transfers to finish
 ERROR : Attempt 3/3 failed with 1 errors and: directory not found
 Failed to copy: directory not found

--There are some delayed retries here with the same result, which I removed, otherwise the rest is exactly as it appears in the log

-- The below INFO block is indeed repeated with a 2min later timestamp compared to the previous and similarly happens for the rest

 INFO  : [Woof] Kyokou Suiri 01 (BDRip 1920x1080 x264 FLAC) [7A024CA4].mkv: Copied (new)
 INFO  :
Transferred:        1.117G / 1.117 GBytes, 100%, 40.024 MBytes/s, ETA 0s
Transferred:            1 / 1, 100%
Elapsed time:        28.5s

+ rclone cryptdecode --reverse crypt_A: /BD/[Woof] Kyokou Suiri/[Woof] Kyokou Suiri 01 (BDRip 1920x1080 x264 FLAC) [7A024CA4].mkv
+ cryptdecode_response=/BD/[Woof] Kyokou Suiri/[Woof] Kyokou Suiri 01 (BDRip 1920x1080 x264 FLAC) [7A024CA4].mkv       /path_1/path_2/filename
+ rclone copy -v --drive-server-side-across-configs remote_A:/s_prefix/path_1/path_2/filename remote_B:/t_prefix/path_1/path_2
 INFO  : filename: Copied (server side copy)
 INFO  :
Transferred:        1.117G / 1.117 GBytes, 100%, 373.521 MBytes/s, ETA 0s
Transferred:            1 / 1, 100%
Elapsed time:         3.0s

--rest files get server-side copied fine

I am also curious on why it initially shows them as 5/5 100% transferred and then it shows it again per file!

Could you try to make a simple example of this and show all the rclone commands and their output? I'm a bit confused looking at your logs above.

Imagine that was my attempt to make it simple :smiley:
I guess all the substitution of paths etc makes it harder to read.

Let's put this on hold, took a second look and it appears that the cause of the above behaviour is unrelated to rclone.

Whew! If you do find it is a problem with rclone then please pop back in!

And it was a bug in my script between inotify and rclone. Apologies for blaming rclone!

1 Like

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.